[2025-09-29T00:00:03.735076] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:03.810512] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-29T00:00:04.412471] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:04.412903] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-29T00:00:04.412997] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:12.064989] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:12.127591] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-29T00:00:12.388551] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:12.389106] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-29T00:00:12.417269] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:12.469947] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-29T00:00:12.503963] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:12.805897] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:12.910763] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-29T00:00:12.961526] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:16.612088] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:16.659430] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-29T00:00:17.099799] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T00:00:17.100897] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-29T00:00:17.363509] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T00:00:17.417984] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-29T00:00:17.848791] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T00:00:17.939377] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-29T00:00:18.260460] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T00:00:18.348864] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-29T00:00:18.769536] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T00:00:18.798599] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-29T00:00:19.090432] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-29T00:00:19.092837] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-29T00:00:19.561990] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-29T00:00:19.564265] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-29T00:00:19.949766] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-29T00:00:19.962015] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-29T00:00:20.300356] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-29T00:00:20.326447] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-29T00:00:20.629517] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-29T00:00:20.632036] [INFO ] [REMOTE ] JMM: Full fetch complete (2292 records). [2025-09-29T00:00:22.515903] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:22.575794] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-29T00:00:23.745769] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T00:00:23.760041] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-29T00:00:25.001300] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T00:00:25.116266] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-29T00:00:25.923245] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:25.934456] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-29T00:00:26.062054] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:26.062490] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-29T00:00:26.101074] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:26.101395] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-29T00:00:26.101482] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:26.174599] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:26.175043] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-29T00:00:26.175134] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:26.213895] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T00:00:26.224718] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-29T00:00:27.935007] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T00:00:27.947858] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-29T00:00:29.755211] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T00:00:29.767497] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-29T00:00:31.551457] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T00:00:31.564705] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-29T00:00:33.357967] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T00:00:33.369323] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-29T00:00:35.369479] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T00:00:35.381907] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-29T00:00:37.070985] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T00:00:37.087472] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-29T00:00:38.994623] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T00:00:39.005276] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-29T00:00:43.063862] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:43.117689] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-29T00:00:45.501943] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:45.518139] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-29T00:00:45.787912] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:45.818182] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-29T00:00:45.818680] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:46.103222] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.99 seconds). [2025-09-29T00:00:46.122182] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-29T00:00:47.733663] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:47.734347] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-29T00:00:48.527930] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T00:00:48.564583] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-29T00:00:48.947542] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-29T00:00:48.968058] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-29T00:00:49.652367] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T00:00:49.659475] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-29T00:00:50.278917] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:50.279387] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-29T00:00:50.520319] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T00:00:50.522629] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-29T00:00:50.613113] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:50.613469] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-29T00:00:50.613557] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:51.350044] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-29T00:00:51.364942] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-29T00:00:51.497219] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T00:00:51.510383] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-29T00:00:51.850138] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T00:00:51.852855] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-29T00:00:52.322028] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T00:00:52.324044] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-29T00:00:52.765416] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:00:52.766917] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-29T00:00:53.079278] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T00:00:53.080589] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-29T00:00:53.666159] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T00:00:53.668020] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-29T00:00:53.915780] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-29T00:00:53.928000] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-29T00:00:54.449401] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-29T00:00:54.451627] [INFO ] [REMOTE ] KUKE: Full fetch complete (8120 records). [2025-09-29T00:00:56.464955] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-29T00:00:56.477281] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-29T00:00:59.037841] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-29T00:00:59.050841] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-29T00:01:01.768717] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-29T00:01:01.780548] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-29T00:01:04.541345] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-29T00:01:04.554210] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-29T00:01:07.318425] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-29T00:01:07.330453] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-29T00:01:09.688149] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-29T00:01:09.698226] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-29T00:01:20.713161] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:20.736357] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-29T00:01:21.900156] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:21.933148] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-29T00:01:22.235807] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:01:22.238768] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-29T00:01:22.239196] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:01:22.236971] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T00:01:22.247119] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-29T00:01:24.142968] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T00:01:24.242282] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-29T00:01:25.784345] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T00:01:25.826820] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-29T00:01:27.429393] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T00:01:27.529704] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-29T00:01:29.202380] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T00:01:29.339554] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-29T00:01:29.417636] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:29.418870] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-29T00:01:30.553626] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-29T00:01:30.560881] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-29T00:01:31.571379] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T00:01:31.583020] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-29T00:01:31.771131] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T00:01:31.778419] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-29T00:01:32.781498] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T00:01:32.788461] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-29T00:01:33.348228] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T00:01:33.359801] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-29T00:01:33.568142] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T00:01:33.575055] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-29T00:01:34.667864] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T00:01:34.675412] [INFO ] [REMOTE ] LUCK: Full fetch complete (40658 records). [2025-09-29T00:01:35.018905] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T00:01:35.030137] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-29T00:01:37.149889] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T00:01:37.161606] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-29T00:01:39.353709] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T00:01:39.368504] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-29T00:01:41.411376] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T00:01:41.423718] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-29T00:01:43.660319] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-29T00:01:43.672688] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-29T00:01:46.040558] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-29T00:01:46.055499] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-29T00:01:48.332708] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-29T00:01:48.345604] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-29T00:01:50.309929] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T00:01:50.321022] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-09-29T00:01:56.033264] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:56.060398] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-29T00:01:56.588813] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T00:01:56.611862] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-29T00:01:57.015697] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T00:01:57.042187] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-29T00:01:57.419797] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-29T00:01:57.420882] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-29T00:01:57.787586] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-29T00:01:57.899016] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-29T00:01:58.284119] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-29T00:01:58.316938] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-29T00:01:58.794816] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T00:01:58.835620] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-29T00:01:59.361754] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T00:01:59.401812] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-29T00:01:59.623407] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:59.624014] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-29T00:01:59.889714] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:01:59.878845] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T00:01:59.908808] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-29T00:01:59.910593] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-29T00:01:59.911247] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:00.526497] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T00:02:00.565479] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-29T00:02:00.885567] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:00.925163] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-29T00:02:01.484417] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T00:02:01.498099] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-29T00:02:01.699758] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T00:02:01.707275] [INFO ] [REMOTE ] MFSB: Full fetch complete (1610 records). [2025-09-29T00:02:01.780397] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:01.780933] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-29T00:02:02.075481] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:02.075970] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-29T00:02:02.076068] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:02.215767] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T00:02:02.217506] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-29T00:02:02.794430] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T00:02:02.795431] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-29T00:02:03.106867] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T00:02:03.108051] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-29T00:02:03.512138] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T00:02:03.513321] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-29T00:02:04.012801] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T00:02:04.014408] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-29T00:02:04.360960] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T00:02:04.362101] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-29T00:02:04.630388] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T00:02:04.631373] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-29T00:02:04.980835] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T00:02:04.981980] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-29T00:02:05.334897] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T00:02:05.336274] [INFO ] [REMOTE ] MHLA: Full fetch complete (1547 records). [2025-09-29T00:02:07.365339] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:07.426213] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-29T00:02:07.839369] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T00:02:07.872356] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-29T00:02:08.364439] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T00:02:08.409187] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-29T00:02:08.968803] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T00:02:08.997796] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-29T00:02:09.815491] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T00:02:09.840991] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-29T00:02:10.686034] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T00:02:10.780183] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-29T00:02:10.808850] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:10.862731] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-29T00:02:11.168129] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:11.198561] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-29T00:02:11.216441] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:11.223369] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-29T00:02:11.223514] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:11.329254] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T00:02:11.344693] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-29T00:02:11.560472] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T00:02:11.585738] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-29T00:02:11.803372] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T00:02:11.805246] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-29T00:02:12.021150] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T00:02:12.028512] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-29T00:02:12.238283] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T00:02:12.268881] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-29T00:02:12.582169] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T00:02:12.602086] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-29T00:02:12.680575] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T00:02:12.703273] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-29T00:02:13.030102] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:13.030882] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-29T00:02:13.299285] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-29T00:02:13.301028] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-29T00:02:13.295160] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T00:02:13.327309] [INFO ] [REMOTE ] MITN: Full fetch complete (2309 records). [2025-09-29T00:02:13.353506] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:13.385012] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-29T00:02:13.402734] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:13.563837] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:13.585728] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-29T00:02:13.824094] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T00:02:13.887770] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-29T00:02:14.424216] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T00:02:14.456197] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-29T00:02:15.023294] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T00:02:15.103740] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-29T00:02:15.581161] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T00:02:15.599571] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-29T00:02:16.049330] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-29T00:02:16.076691] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-29T00:02:16.387605] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-09-29T00:02:16.403192] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-29T00:02:16.539426] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-29T00:02:16.574103] [INFO ] [REMOTE ] MMKT: Full fetch complete (2099 records). [2025-09-29T00:02:18.829284] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-29T00:02:18.842030] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-29T00:02:20.849802] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-29T00:02:20.860404] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-29T00:02:23.261871] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-29T00:02:23.274066] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-29T00:02:25.714129] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-29T00:02:25.726468] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-29T00:02:28.082441] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-29T00:02:28.097383] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-29T00:02:30.378328] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-29T00:02:30.389625] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-29T00:02:32.604483] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-29T00:02:32.616726] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-29T00:02:34.881689] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-29T00:02:34.894973] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-29T00:02:36.661689] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T00:02:36.678175] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-29T00:02:38.752962] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:38.847597] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-29T00:02:39.228868] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:39.248958] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-29T00:02:39.260451] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:40.421230] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:40.464405] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-29T00:02:40.913282] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T00:02:40.950487] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-29T00:02:41.623350] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T00:02:41.636030] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-29T00:02:41.819819] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:41.856117] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-29T00:02:42.158265] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:42.191714] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-29T00:02:42.234835] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:42.265829] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T00:02:42.279437] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-29T00:02:42.749452] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-29T00:02:42.754771] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-29T00:02:43.166337] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T00:02:43.185676] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-29T00:02:43.669310] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T00:02:43.745805] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-29T00:02:44.297801] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T00:02:44.371784] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-29T00:02:44.770072] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:44.800245] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-29T00:02:44.944194] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T00:02:44.972399] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-29T00:02:45.440678] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T00:02:45.437482] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T00:02:45.464015] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-29T00:02:45.470807] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-29T00:02:45.991496] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T00:02:45.993122] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-29T00:02:46.108049] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T00:02:46.134772] [INFO ] [REMOTE ] MSC: Full fetch complete (2509 records). [2025-09-29T00:02:46.393792] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T00:02:46.421695] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-29T00:02:46.976190] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T00:02:47.098066] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-29T00:02:47.571581] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T00:02:47.573259] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-29T00:02:48.098084] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:48.145848] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T00:02:48.189757] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-29T00:02:48.146412] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-29T00:02:48.528481] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T00:02:48.552996] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-29T00:02:49.082377] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:49.085269] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-29T00:02:49.088577] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:49.089542] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T00:02:49.092353] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-29T00:02:49.567092] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T00:02:49.568486] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-29T00:02:49.912222] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-29T00:02:49.913374] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-29T00:02:50.274306] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T00:02:50.275512] [INFO ] [REMOTE ] MTR: Full fetch complete (2549 records). [2025-09-29T00:02:52.158425] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:52.207892] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-29T00:02:52.834275] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T00:02:52.875896] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-29T00:02:53.490900] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T00:02:53.544308] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-29T00:02:54.121168] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T00:02:54.160552] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-29T00:02:54.758146] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T00:02:54.853982] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-29T00:02:55.389998] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T00:02:55.396579] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-29T00:02:56.008978] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T00:02:56.045388] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-29T00:02:56.575343] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T00:02:56.626565] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-29T00:02:57.220561] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T00:02:57.257906] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-29T00:02:57.852628] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T00:02:57.854250] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-29T00:02:58.384919] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-29T00:02:58.472367] [INFO ] [REMOTE ] MXE: Full fetch complete (2667 records). [2025-09-29T00:03:03.710835] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:03.755024] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-29T00:03:04.074893] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:03:04.114970] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-29T00:03:04.179758] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:03:04.382229] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:04.399373] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-29T00:03:05.011495] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:05.057506] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-29T00:03:05.775178] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T00:03:05.898052] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-29T00:03:05.886189] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:05.898884] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-29T00:03:06.163268] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:03:06.198268] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-29T00:03:06.198485] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:03:06.690441] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-29T00:03:06.710412] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-29T00:03:07.356901] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T00:03:07.416843] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-29T00:03:08.091689] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (3.69 seconds). [2025-09-29T00:03:08.121327] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-29T00:03:08.127034] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T00:03:08.132615] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-29T00:03:08.850363] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T00:03:08.910434] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-29T00:03:09.881369] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T00:03:09.918081] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-29T00:03:10.089428] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:10.090024] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-29T00:03:10.765934] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T00:03:10.832809] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-29T00:03:10.835221] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-29T00:03:10.909316] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-29T00:03:11.577556] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:11.577947] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-29T00:03:11.692155] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T00:03:11.694313] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-29T00:03:11.791614] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:03:11.792226] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-29T00:03:11.792325] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:03:12.271310] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T00:03:12.276021] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-29T00:03:12.276587] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T00:03:12.279230] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-29T00:03:12.681873] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T00:03:12.682958] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-29T00:03:12.849193] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T00:03:12.851352] [INFO ] [REMOTE ] NL: Full fetch complete (6922 records). [2025-09-29T00:03:12.996907] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T00:03:13.023966] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-29T00:03:13.226794] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-29T00:03:13.237676] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-29T00:03:13.429351] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-29T00:03:13.430523] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-29T00:03:13.902057] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T00:03:13.903196] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-29T00:03:14.262546] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T00:03:14.263788] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-29T00:03:14.539484] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T00:03:14.541005] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-29T00:03:14.977151] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T00:03:14.978326] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-29T00:03:15.459061] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T00:03:15.460215] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-29T00:03:15.827359] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-29T00:03:15.839031] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-29T00:03:16.111406] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T00:03:16.112487] [INFO ] [REMOTE ] NOM: Full fetch complete (1626 records). [2025-09-29T00:03:18.600005] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-29T00:03:18.611882] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-29T00:03:21.010183] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-29T00:03:21.022441] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-29T00:03:23.581490] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-29T00:03:23.593385] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-29T00:03:26.297712] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-29T00:03:26.310767] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-29T00:03:28.586069] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-29T00:03:28.597696] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-29T00:03:30.978336] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-29T00:03:30.992526] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-29T00:03:32.975777] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:32.990775] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-29T00:03:34.000693] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T00:03:34.030295] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-29T00:03:35.520637] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T00:03:35.542351] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-29T00:03:37.025381] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:37.055135] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-29T00:03:37.103732] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T00:03:37.113004] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-29T00:03:37.544156] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T00:03:37.591072] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-29T00:03:38.089284] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:38.089856] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-29T00:03:38.250885] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T00:03:38.256165] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-29T00:03:38.885793] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T00:03:38.925977] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-29T00:03:39.027792] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T00:03:39.077228] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-29T00:03:39.479798] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T00:03:39.520327] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-29T00:03:40.049439] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-29T00:03:40.050576] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-29T00:03:40.335911] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-29T00:03:40.348222] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-29T00:03:40.610486] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T00:03:40.620950] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-29T00:03:40.905225] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T00:03:40.907737] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-29T00:03:41.500639] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T00:03:41.504706] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-29T00:03:42.142378] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T00:03:42.143605] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-29T00:03:42.175994] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T00:03:42.186845] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-29T00:03:42.483638] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-29T00:03:42.494806] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-29T00:03:42.708437] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T00:03:42.709585] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-29T00:03:43.121977] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-29T00:03:43.122864] [INFO ] [REMOTE ] NTEST: Full fetch complete (1986 records). [2025-09-29T00:03:43.520307] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T00:03:43.529111] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-29T00:03:44.829928] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-29T00:03:44.841406] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-29T00:03:45.170348] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T00:03:45.181031] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-29T00:03:46.821701] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T00:03:46.832882] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-29T00:03:47.344871] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-29T00:03:47.356234] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-29T00:03:48.343371] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T00:03:48.350968] [INFO ] [REMOTE ] NPKI: Full fetch complete (53554 records). [2025-09-29T00:03:49.477478] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T00:03:49.489382] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-29T00:03:51.221298] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T00:03:51.233073] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-29T00:03:53.146344] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T00:03:53.158035] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-29T00:03:55.081962] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T00:03:55.093984] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-29T00:03:56.859731] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T00:03:56.870778] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-29T00:03:58.814779] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T00:03:58.826368] [INFO ] [REMOTE ] NUE: Full fetch complete (74902 records). [2025-09-29T00:04:00.996860] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:01.028838] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-29T00:04:01.490330] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:04:01.517145] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-29T00:04:01.528322] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:04:02.480912] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:02.512716] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-29T00:04:03.095151] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-29T00:04:03.167596] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-29T00:04:03.443027] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:03.447811] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-29T00:04:03.743867] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T00:04:03.798835] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-29T00:04:04.245257] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T00:04:04.251053] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-29T00:04:04.778550] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T00:04:04.795470] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-29T00:04:05.263622] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T00:04:05.268310] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-29T00:04:05.649520] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-29T00:04:05.679843] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-29T00:04:06.117034] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:04:06.129518] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-29T00:04:06.417545] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.97 seconds). [2025-09-29T00:04:06.520553] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-29T00:04:06.570673] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T00:04:06.604542] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-29T00:04:06.951301] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T00:04:06.954275] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-29T00:04:07.459496] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T00:04:07.491441] [INFO ] [REMOTE ] NYC: Full fetch complete (1919 records). [2025-09-29T00:04:09.697780] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (3.18 seconds). [2025-09-29T00:04:09.709688] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-29T00:04:12.153079] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-29T00:04:12.164090] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-29T00:04:14.816935] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-29T00:04:14.828810] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-29T00:04:17.042331] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-29T00:04:17.054627] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-29T00:04:19.706832] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-29T00:04:19.718709] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-29T00:04:22.266860] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-29T00:04:22.279838] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-29T00:04:24.931217] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-29T00:04:24.945297] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-29T00:04:27.618904] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-29T00:04:27.630997] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-29T00:04:30.072889] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-29T00:04:30.088898] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-09-29T00:04:32.578083] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:32.604776] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-29T00:04:33.561048] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T00:04:33.676538] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-29T00:04:33.833434] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:33.881290] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-29T00:04:34.085542] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:34.120749] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-29T00:04:34.474134] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T00:04:34.477269] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-29T00:04:34.980019] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:34.980400] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-29T00:04:35.244976] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T00:04:35.246907] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-29T00:04:35.814712] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T00:04:35.824390] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-29T00:04:35.917068] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-29T00:04:35.928577] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-29T00:04:35.934275] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T00:04:35.936055] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-29T00:04:36.653294] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T00:04:36.662918] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-29T00:04:36.886812] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T00:04:36.889757] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-29T00:04:37.413708] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T00:04:37.424140] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-29T00:04:37.645521] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T00:04:37.648424] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-29T00:04:37.771308] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T00:04:37.780459] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-29T00:04:38.436263] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-29T00:04:38.448339] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-29T00:04:38.457868] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T00:04:38.461217] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-29T00:04:39.076827] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T00:04:39.086803] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-29T00:04:39.129626] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T00:04:39.132588] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-29T00:04:39.164495] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T00:04:39.173526] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-29T00:04:39.707855] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T00:04:39.710372] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-29T00:04:40.205038] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-29T00:04:40.207893] [INFO ] [REMOTE ] OPY: Full fetch complete (10014 records). [2025-09-29T00:04:40.700236] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T00:04:40.744694] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-29T00:04:40.878232] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-29T00:04:40.987914] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-29T00:04:41.013372] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T00:04:41.056722] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-29T00:04:41.447552] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:41.448169] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-29T00:04:41.664683] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:04:41.665290] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-29T00:04:41.665409] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:04:42.240815] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T00:04:42.251775] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-29T00:04:43.095001] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T00:04:43.107308] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-29T00:04:43.341669] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-29T00:04:43.354354] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-29T00:04:43.955425] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:43.955945] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-29T00:04:43.981866] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T00:04:43.991583] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-29T00:04:44.890579] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T00:04:44.901933] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-29T00:04:45.569080] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T00:04:45.579823] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-29T00:04:46.005591] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-29T00:04:46.017510] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-29T00:04:46.254878] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-29T00:04:46.266696] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-29T00:04:46.659028] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T00:04:46.669756] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-29T00:04:46.821807] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T00:04:46.831957] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-29T00:04:48.103634] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T00:04:48.113271] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-29T00:04:48.531362] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-29T00:04:48.543631] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-29T00:04:48.603787] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T00:04:48.615481] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-29T00:04:48.887440] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-29T00:04:48.898495] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-29T00:04:49.749997] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T00:04:49.759567] [INFO ] [REMOTE ] OSK: Full fetch complete (61451 records). [2025-09-29T00:04:50.446058] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T00:04:50.457872] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-29T00:04:51.388340] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-29T00:04:51.386494] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-29T00:04:51.411589] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-29T00:04:51.413226] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-29T00:04:52.221880] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:52.222447] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-29T00:04:52.249214] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T00:04:52.259569] [INFO ] [REMOTE ] ORI: Full fetch complete (70200 records). [2025-09-29T00:04:52.534521] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:04:52.572881] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-29T00:04:52.586201] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:04:54.066086] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-29T00:04:54.121172] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-29T00:04:54.473119] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-09-29T00:04:54.562345] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-29T00:04:56.760104] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-29T00:04:56.772938] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-29T00:04:57.171881] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-29T00:04:57.184682] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-29T00:04:59.440520] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-29T00:04:59.453019] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-29T00:04:59.700431] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-29T00:04:59.710989] [INFO ] [REMOTE ] ORCL: Full fetch complete (77532 records). [2025-09-29T00:05:01.925443] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-29T00:05:01.937236] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-29T00:05:04.839363] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-29T00:05:04.852174] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-29T00:05:07.511468] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-29T00:05:07.524663] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-29T00:05:09.860061] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-29T00:05:09.872126] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-29T00:05:13.752035] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:13.758396] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-29T00:05:14.200000] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T00:05:14.222506] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-29T00:05:14.544740] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-29T00:05:14.599964] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-29T00:05:15.161795] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T00:05:15.191702] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-29T00:05:15.787575] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T00:05:15.819186] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-29T00:05:16.386233] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T00:05:16.436416] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-29T00:05:16.857283] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:16.873176] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-29T00:05:16.909789] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T00:05:16.913292] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-29T00:05:17.116753] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:17.172032] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-29T00:05:17.240043] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:05:17.343023] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T00:05:17.345577] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-29T00:05:17.861843] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T00:05:17.873169] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-29T00:05:18.371608] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T00:05:18.383436] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-29T00:05:18.827118] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T00:05:18.873425] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-09-29T00:05:28.456101] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:28.489188] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-29T00:05:28.693845] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:28.699456] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-29T00:05:28.777792] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:28.792864] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-29T00:05:28.936393] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T00:05:28.954822] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-29T00:05:28.971054] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:28.991173] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-29T00:05:29.024320] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:29.024183] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:05:29.025370] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-29T00:05:29.025715] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:05:29.411929] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T00:05:29.479342] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-29T00:05:29.997378] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T00:05:30.009900] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-29T00:05:30.435459] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T00:05:30.490006] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-29T00:05:31.052618] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T00:05:31.053855] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-29T00:05:31.473479] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T00:05:31.474494] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-29T00:05:31.801612] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T00:05:31.802810] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-29T00:05:32.155258] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T00:05:32.156332] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-29T00:05:32.471968] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-29T00:05:32.472943] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-29T00:05:32.800128] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-29T00:05:32.801230] [INFO ] [REMOTE ] PMTU: Full fetch complete (1236 records). [2025-09-29T00:05:35.002277] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:35.054364] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-29T00:05:35.616261] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T00:05:35.641427] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-29T00:05:36.237787] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T00:05:36.240727] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-29T00:05:36.805914] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T00:05:36.825805] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-29T00:05:37.480291] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T00:05:37.587413] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-29T00:05:37.901395] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:37.914769] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-29T00:05:38.174260] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:38.186241] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-29T00:05:38.259921] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:05:38.420566] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T00:05:38.480782] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-29T00:05:38.683898] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:38.684896] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-29T00:05:39.090554] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T00:05:39.144184] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-29T00:05:39.172258] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T00:05:39.211255] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-29T00:05:39.549593] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T00:05:39.552254] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-29T00:05:39.864881] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T00:05:39.908885] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-29T00:05:39.913819] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T00:05:39.922160] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-29T00:05:40.449802] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T00:05:40.484426] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T00:05:40.488412] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-29T00:05:40.478467] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-29T00:05:40.893889] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T00:05:40.923060] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-29T00:05:41.061305] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T00:05:41.072767] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-29T00:05:41.228431] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T00:05:41.266556] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-29T00:05:41.559712] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-29T00:05:41.583127] [INFO ] [REMOTE ] PRCS: Full fetch complete (3804 records). [2025-09-29T00:05:41.700419] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T00:05:41.718576] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-29T00:05:42.193928] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T00:05:42.236365] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-29T00:05:42.641580] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T00:05:42.696008] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-29T00:05:43.133144] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T00:05:43.134163] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-09-29T00:05:49.257913] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:49.290031] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-29T00:05:49.299681] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:49.315953] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-29T00:05:49.902165] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T00:05:49.916729] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-29T00:05:49.915301] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T00:05:49.930878] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-29T00:05:50.464473] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T00:05:50.483150] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-29T00:05:50.623243] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T00:05:50.627671] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-29T00:05:51.113730] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T00:05:51.139345] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-29T00:05:51.144455] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T00:05:51.146578] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-29T00:05:51.747288] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T00:05:51.782965] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-29T00:05:51.833589] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T00:05:51.837189] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-29T00:05:52.398747] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-29T00:05:52.463368] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-29T00:05:52.487172] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-29T00:05:52.490348] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-29T00:05:53.083315] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T00:05:53.090069] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T00:05:53.112581] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-29T00:05:53.119013] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-29T00:05:53.652981] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T00:05:53.714686] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-29T00:05:53.733965] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T00:05:53.783371] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-29T00:05:54.201139] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T00:05:54.203844] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-29T00:05:54.393781] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T00:05:54.396177] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-29T00:05:54.715382] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-29T00:05:54.716524] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-29T00:05:54.878458] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T00:05:54.880500] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-29T00:05:54.972745] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-29T00:05:54.974089] [INFO ] [REMOTE ] RCB: Full fetch complete (3747 records). [2025-09-29T00:05:55.506834] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T00:05:55.508462] [INFO ] [REMOTE ] RCD: Full fetch complete (6867 records). [2025-09-29T00:05:57.175108] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:57.251522] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-29T00:05:57.682396] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:57.682869] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-29T00:05:57.683286] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:08.223760] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:08.252362] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-29T00:06:08.259424] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:08.273369] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-29T00:06:08.782933] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T00:06:08.828838] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-29T00:06:08.859967] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T00:06:08.942261] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:08.937350] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-29T00:06:08.944146] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-29T00:06:09.202859] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:09.225549] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-29T00:06:09.225735] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:09.525456] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T00:06:09.548756] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-29T00:06:09.606077] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T00:06:09.641266] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-29T00:06:09.931063] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-29T00:06:09.933076] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-29T00:06:10.163417] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T00:06:10.165441] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-29T00:06:10.505245] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T00:06:10.513771] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-29T00:06:10.527293] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T00:06:10.529807] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-29T00:06:11.071457] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T00:06:11.073673] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-29T00:06:11.604324] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T00:06:11.627629] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-29T00:06:11.630800] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T00:06:11.654247] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-29T00:06:12.205116] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T00:06:12.229159] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-29T00:06:12.297807] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T00:06:12.306838] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-29T00:06:12.474228] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:12.495514] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-29T00:06:12.619460] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T00:06:12.620796] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-29T00:06:12.918588] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T00:06:12.934449] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-29T00:06:12.974255] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T00:06:13.006537] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-29T00:06:13.017048] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-29T00:06:13.038571] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-29T00:06:13.316378] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T00:06:13.318011] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-29T00:06:13.616737] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T00:06:13.619467] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-29T00:06:13.671534] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T00:06:13.674034] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T00:06:13.680403] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-29T00:06:13.681525] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-29T00:06:13.958273] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T00:06:13.982682] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-29T00:06:14.182242] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T00:06:14.194757] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T00:06:14.201945] [INFO ] [REMOTE ] RWTO: Full fetch complete (4801 records). [2025-09-29T00:06:14.203469] [INFO ] [REMOTE ] RWTN: Full fetch complete (3130 records). [2025-09-29T00:06:14.403157] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:14.466567] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-29T00:06:14.460748] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-29T00:06:14.499207] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-29T00:06:15.014948] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-29T00:06:15.015128] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T00:06:15.063561] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-29T00:06:15.115501] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-29T00:06:15.555451] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:06:15.555703] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T00:06:15.631515] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-29T00:06:15.625392] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-29T00:06:15.933362] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:15.957562] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-29T00:06:16.000715] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:16.001319] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-29T00:06:16.003981] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T00:06:16.006184] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-29T00:06:16.125350] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T00:06:16.126438] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-29T00:06:16.314167] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T00:06:16.315396] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-29T00:06:16.361007] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T00:06:16.362045] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-29T00:06:16.385134] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T00:06:16.386317] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-29T00:06:16.440056] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T00:06:16.441253] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-29T00:06:16.596999] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T00:06:16.598940] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-29T00:06:16.619242] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-29T00:06:16.620230] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-09-29T00:06:16.718624] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T00:06:16.746035] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-29T00:06:16.754741] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-29T00:06:16.779405] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-29T00:06:16.867503] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-29T00:06:16.868821] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-29T00:06:17.202287] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T00:06:17.226018] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-29T00:06:17.234021] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T00:06:17.236239] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-29T00:06:17.347198] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T00:06:17.397181] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-29T00:06:17.536119] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:17.536500] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-29T00:06:17.581964] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T00:06:17.583038] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-29T00:06:17.733177] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T00:06:17.736855] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-29T00:06:17.736975] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T00:06:17.739054] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-29T00:06:17.746258] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:17.746633] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-29T00:06:17.746770] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:17.936335] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T00:06:17.937553] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-29T00:06:18.105306] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T00:06:18.105106] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T00:06:18.128160] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-29T00:06:18.150959] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-29T00:06:18.318790] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T00:06:18.323109] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-29T00:06:18.573573] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T00:06:18.606361] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-29T00:06:18.616320] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-29T00:06:18.617227] [INFO ] [REMOTE ] SAT: Full fetch complete (1599 records). [2025-09-29T00:06:18.691962] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T00:06:18.733109] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-29T00:06:18.920511] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T00:06:18.955476] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-29T00:06:19.174116] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:06:19.180962] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-29T00:06:19.337371] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T00:06:19.339125] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-29T00:06:19.578077] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-29T00:06:19.579221] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-29T00:06:19.697477] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T00:06:19.698441] [INFO ] [REMOTE ] SAY: Full fetch complete (1412 records). [2025-09-29T00:06:19.997707] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T00:06:19.999365] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-29T00:06:20.339322] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-29T00:06:20.340299] [INFO ] [REMOTE ] SAZ: Full fetch complete (1809 records). [2025-09-29T00:06:22.168574] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:22.242177] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-29T00:06:22.599073] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T00:06:22.632547] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-29T00:06:22.917747] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-29T00:06:22.957598] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-29T00:06:23.397837] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T00:06:23.506051] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-29T00:06:23.929318] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-29T00:06:23.947959] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-29T00:06:24.284499] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T00:06:24.288043] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-29T00:06:24.680616] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T00:06:24.720524] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-29T00:06:25.796288] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T00:06:25.878274] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-29T00:06:26.549211] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T00:06:26.584587] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-29T00:06:27.241552] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T00:06:27.273953] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-29T00:06:27.702771] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T00:06:27.721334] [INFO ] [REMOTE ] SBXD: Full fetch complete (3078 records). [2025-09-29T00:06:28.165278] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:28.219690] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-29T00:06:28.508443] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:28.524039] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-29T00:06:28.529801] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:30.881537] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:30.938852] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-29T00:06:31.665974] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:31.666328] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-29T00:06:31.666417] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:36.167070] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:36.179306] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-29T00:06:36.709056] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T00:06:36.783039] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-29T00:06:37.192750] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T00:06:37.289544] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-29T00:06:37.528371] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:37.551845] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-29T00:06:37.730626] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T00:06:37.769573] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-29T00:06:37.889791] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:37.890499] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-29T00:06:37.890592] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:38.225823] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-29T00:06:38.243068] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-29T00:06:38.686851] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-29T00:06:38.725761] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-29T00:06:39.149525] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T00:06:39.188746] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-29T00:06:39.678720] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-29T00:06:39.692821] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-29T00:06:40.148910] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-29T00:06:40.198104] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-29T00:06:40.591963] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-29T00:06:40.614691] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-29T00:06:41.118381] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T00:06:41.162012] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1060 records). [2025-09-29T00:06:43.726735] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:43.740298] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-29T00:06:43.999448] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:44.054381] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-29T00:06:44.072966] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:47.805005] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:47.806184] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-29T00:06:48.035506] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:48.061181] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-29T00:06:48.092059] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:51.914854] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:51.957172] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-29T00:06:52.585897] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T00:06:52.587448] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-29T00:06:53.060918] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T00:06:53.062175] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-29T00:06:53.434630] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T00:06:53.435792] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-29T00:06:53.787679] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T00:06:53.788851] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-29T00:06:54.235896] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T00:06:54.237463] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-29T00:06:54.675663] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T00:06:54.676922] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-29T00:06:55.113032] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:06:55.114592] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-29T00:06:55.470043] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T00:06:55.471211] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-29T00:06:55.811796] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-29T00:06:55.812850] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-29T00:06:56.170989] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T00:06:56.172453] [INFO ] [REMOTE ] SRL: Full fetch complete (1966 records). [2025-09-29T00:06:59.868017] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:59.924502] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-29T00:07:00.358725] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-29T00:07:00.420304] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-29T00:07:00.970332] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T00:07:01.039409] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-29T00:07:01.512462] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:01.526455] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-29T00:07:01.525542] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T00:07:01.576881] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-29T00:07:01.822340] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:01.823522] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-29T00:07:01.823694] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:02.015074] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T00:07:02.053953] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-29T00:07:02.592817] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T00:07:02.625024] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-29T00:07:03.131337] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-29T00:07:03.132867] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-29T00:07:03.728192] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T00:07:03.789545] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-29T00:07:03.965045] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:03.970307] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-29T00:07:04.380549] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T00:07:04.397756] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-29T00:07:04.673933] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T00:07:04.724342] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-29T00:07:04.922587] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T00:07:04.961955] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-29T00:07:05.244771] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T00:07:05.246856] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-29T00:07:05.424391] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T00:07:05.460834] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-29T00:07:05.714841] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-29T00:07:05.716166] [INFO ] [REMOTE ] STG: Full fetch complete (2496 records). [2025-09-29T00:07:05.823172] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T00:07:05.911666] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-29T00:07:06.511729] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T00:07:06.608140] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-29T00:07:07.052917] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T00:07:07.054817] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-29T00:07:07.399861] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T00:07:07.401137] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-29T00:07:07.815666] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-29T00:07:07.816932] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-29T00:07:08.354362] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T00:07:08.355454] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-29T00:07:08.706758] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T00:07:08.707686] [INFO ] [REMOTE ] STXM: Full fetch complete (1431 records). [2025-09-29T00:07:13.667593] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:13.733363] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-29T00:07:13.968726] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:13.969415] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-29T00:07:14.160300] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-29T00:07:14.192926] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-29T00:07:14.219206] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:14.226158] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-29T00:07:14.259144] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:14.683918] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T00:07:14.705834] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-29T00:07:15.111788] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T00:07:15.168835] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-29T00:07:15.721573] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T00:07:15.791949] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-29T00:07:16.175861] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:16.206037] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-29T00:07:16.265961] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T00:07:16.295049] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-29T00:07:16.503810] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:16.508130] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-29T00:07:16.539478] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:16.797695] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T00:07:16.858162] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-29T00:07:17.362968] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T00:07:17.425822] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-29T00:07:17.906115] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T00:07:17.970682] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-29T00:07:18.462201] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T00:07:18.539195] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-29T00:07:18.955804] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-29T00:07:18.989263] [INFO ] [REMOTE ] TBLU: Full fetch complete (1172 records). [2025-09-29T00:07:20.350477] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:20.350891] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-29T00:07:20.575785] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:20.576148] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-29T00:07:20.576237] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:25.232622] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:25.239515] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-29T00:07:25.516203] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:25.543064] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-29T00:07:25.559732] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:29.383818] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:29.418831] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-29T00:07:29.706278] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:29.722403] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-29T00:07:29.722589] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:37.542140] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:37.564333] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-29T00:07:37.914549] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:37.962051] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-29T00:07:37.980170] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:40.745978] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:40.746503] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-29T00:07:40.983141] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:40.983551] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-29T00:07:40.983687] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:56.090759] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:56.140346] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-29T00:07:56.409448] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:56.534786] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-29T00:07:56.540255] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:57.063254] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:57.080883] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-29T00:07:57.495419] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:57.571234] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-29T00:07:57.592313] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:02.758317] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:02.836545] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-29T00:08:03.153125] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:08:03.166605] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-29T00:08:03.172139] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:09.005127] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:09.061664] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-29T00:08:09.341842] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:08:09.365021] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-29T00:08:09.397409] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:16.756034] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:16.756955] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-29T00:08:17.169259] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T00:08:17.191224] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-29T00:08:17.573461] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T00:08:17.580243] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-29T00:08:18.034220] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T00:08:18.051449] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-29T00:08:18.504027] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T00:08:18.539560] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-29T00:08:19.110329] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T00:08:19.115404] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-29T00:08:19.512948] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-29T00:08:19.548068] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-29T00:08:19.975152] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T00:08:19.976554] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-29T00:08:20.400595] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-29T00:08:20.401982] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-29T00:08:20.861739] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T00:08:20.863059] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-29T00:08:21.208702] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T00:08:21.209594] [INFO ] [REMOTE ] WLTG: Full fetch complete (1661 records). [2025-09-29T00:08:24.674571] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:24.778959] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-29T00:08:25.447589] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T00:08:25.484597] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-29T00:08:26.197350] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T00:08:26.237484] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-29T00:08:26.538368] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:26.557566] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-29T00:08:26.814362] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T00:08:26.816267] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-29T00:08:26.822334] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:08:26.846550] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-29T00:08:26.878995] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:27.453299] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T00:08:27.466177] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-29T00:08:28.070042] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T00:08:28.099626] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-29T00:08:28.687480] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T00:08:28.707066] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-29T00:08:29.240425] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T00:08:29.261955] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-29T00:08:29.619814] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:29.689387] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-29T00:08:29.728959] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T00:08:29.743510] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-29T00:08:29.938908] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:08:29.963367] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-29T00:08:29.993782] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:30.438630] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-29T00:08:30.470984] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-29T00:08:31.209365] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T00:08:31.251004] [INFO ] [REMOTE ] WTM: Full fetch complete (2277 records). [2025-09-29T00:08:35.848202] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T00:08:37.274589] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T00:08:37.274820] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T01:57:20.048238] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-29T01:57:20.248862] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-09-29T01:57:20.249072] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-09-29T01:57:20.460941] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-09-29T01:57:20.461405] [WARN ] [STATE ] State set to: RUNNING [2025-09-29T01:57:20.461571] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-29T01:57:20.461775] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-29T01:57:20.461963] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-29T01:57:20.462071] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T01:57:21.422295] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T01:57:21.422484] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T01:57:21.422792] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-29T01:57:21.423479] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-29T01:57:21.423560] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-29T01:57:21.423632] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-29T01:57:21.423829] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-29T01:57:21.423910] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-29T01:57:21.423985] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T01:57:21.424426] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T01:57:21.424503] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T01:57:21.424757] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-29T01:57:21.424862] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-29T01:57:21.424954] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-29T01:57:21.425031] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-29T01:57:21.453828] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-29T01:57:21.481969] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-29T01:57:21.482114] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-29T01:57:21.482192] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-29T01:57:21.482264] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-29T01:57:21.482398] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T01:57:21.482871] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T01:57:21.482949] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T01:57:21.483025] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-29T01:57:21.483095] [INFO ] [MAIN ] Running in parallel mode [2025-09-29T01:57:21.483281] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-29T01:57:22.193049] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:22.207446] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:22.263140] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:22.255768] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-29T01:57:22.269258] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-29T01:57:22.271744] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-29T01:57:22.298057] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:22.298771] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-29T01:57:22.299017] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-29T01:57:22.299165] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-29T01:57:22.299257] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-29T01:57:22.299376] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-29T01:57:22.299579] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-29T01:57:22.301415] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-29T01:57:22.315695] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-29T01:57:22.327066] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-29T01:57:22.929970] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-29T01:57:22.972436] [INFO ] [MAIN ] A: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:23.010937] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. A took 1.5s. Estimated remaining: 1h 0m 21s. Rate: 39.3 symbols/min [2025-09-29T01:57:23.104708] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-29T01:57:23.164970] [INFO ] [MAIN ] AA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:23.296423] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:23.307257] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-29T01:57:23.307827] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AA took 1.8s. Estimated remaining: 36m 1s. Rate: 65.8 symbols/min [2025-09-29T01:57:23.382113] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:23.400602] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-29T01:57:23.516889] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:23.637931] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:23.671147] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:23.671976] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-29T01:57:23.672137] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:23.672239] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-29T01:57:23.672733] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:23.672828] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-29T01:57:23.672918] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-29T01:57:23.672990] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-29T01:57:23.673057] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-29T01:57:23.673125] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAMI took 2.1s. Estimated remaining: 28m 49s. Rate: 82.2 symbols/min [2025-09-29T01:57:23.871286] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T01:57:23.913802] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-29T01:57:23.946510] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-29T01:57:23.953321] [INFO ] [MAIN ] AAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:23.955514] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAP took 0.9s. Estimated remaining: 24m 23s. Rate: 97.1 symbols/min [2025-09-29T01:57:23.953186] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:23.954211] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-29T01:57:23.968117] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-29T01:57:23.979397] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-29T01:57:23.996732] [INFO ] [MAIN ] AAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:24.013691] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-29T01:57:24.013610] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAT took 0.6s. Estimated remaining: 19m 57s. Rate: 118.6 symbols/min [2025-09-29T01:57:24.038800] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-29T01:57:24.071525] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-29T01:57:24.088187] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-29T01:57:24.303687] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-29T01:57:24.368135] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-29T01:57:24.379867] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:24.493475] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:24.666780] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T01:57:24.704118] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-29T01:57:24.772677] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-29T01:57:24.812495] [INFO ] [MAIN ] AB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:24.839367] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:24.841595] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AB took 0.9s. Estimated remaining: 22m 4s. Rate: 107.2 symbols/min [2025-09-29T01:57:24.841959] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-29T01:57:24.945712] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-29T01:57:24.975081] [INFO ] [MAIN ] ABBV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:24.980958] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T01:57:24.981616] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. ABBV took 0.9s. Estimated remaining: 19m 41s. Rate: 120.1 symbols/min [2025-09-29T01:57:24.982803] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-29T01:57:25.046012] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:25.156020] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-29T01:57:25.170778] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:25.185929] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:25.191540] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-29T01:57:25.192025] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:25.203752] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-29T01:57:25.209198] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-29T01:57:25.214410] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-29T01:57:25.220261] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-29T01:57:25.242771] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AAUC took 1.6s. Estimated remaining: 18m 30s. Rate: 127.7 symbols/min [2025-09-29T01:57:25.278995] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:25.324610] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T01:57:25.355375] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-29T01:57:25.504549] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:25.505438] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-29T01:57:25.505803] [INFO ] [MAIN ] ABCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:25.506552] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 0.7s. Estimated remaining: 17m 36s. Rate: 134.2 symbols/min [2025-09-29T01:57:25.573417] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-29T01:57:25.594365] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-29T01:57:25.670113] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-29T01:57:25.690459] [INFO ] [MAIN ] ABG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:25.712568] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-29T01:57:25.752680] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABG took 0.5s. Estimated remaining: 16m 48s. Rate: 140.5 symbols/min [2025-09-29T01:57:25.778049] [INFO ] [MAIN ] ABEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:25.778205] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.18 seconds). [2025-09-29T01:57:25.796957] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-29T01:57:25.779376] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:25.823861] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 0.8s. Estimated remaining: 15m 31s. Rate: 152.1 symbols/min [2025-09-29T01:57:26.178491] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:26.172049] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-29T01:57:26.181733] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-29T01:57:26.214143] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:26.215733] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-29T01:57:26.220473] [INFO ] [MAIN ] ABM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:26.220719] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABM took 0.7s. Estimated remaining: 15m 31s. Rate: 152.0 symbols/min [2025-09-29T01:57:26.470079] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:26.495101] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-29T01:57:26.513039] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-29T01:57:26.518985] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-29T01:57:26.521702] [INFO ] [MAIN ] ABR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:26.538534] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABR took 0.8s. Estimated remaining: 15m 17s. Rate: 154.3 symbols/min [2025-09-29T01:57:26.588722] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-29T01:57:26.620126] [INFO ] [MAIN ] ABT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:26.634328] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ABT took 0.8s. Estimated remaining: 14m 27s. Rate: 163.1 symbols/min [2025-09-29T01:57:26.735820] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-29T01:57:26.792003] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-29T01:57:26.792943] [INFO ] [REMOTE ] AAM: Full fetch complete (966 records). [2025-09-29T01:57:26.870489] [INFO ] [MAIN ] ACA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:26.884186] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:26.889466] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ACA took 0.7s. Estimated remaining: 14m 9s. Rate: 166.5 symbols/min [2025-09-29T01:57:26.883172] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-29T01:57:27.003680] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.004303] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T01:57:27.004907] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:57:27.032265] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:57:27.055196] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-29T01:57:27.083718] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-29T01:57:27.084423] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-29T01:57:27.144073] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-29T01:57:27.174949] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.181626] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. AAM took 5.6s. Estimated remaining: 13m 59s. Rate: 168.5 symbols/min [2025-09-29T01:57:27.301495] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-29T01:57:27.319888] [INFO ] [MAIN ] ACEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:27.328533] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACEL took 0.7s. Estimated remaining: 13m 29s. Rate: 174.5 symbols/min [2025-09-29T01:57:27.307786] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-29T01:57:27.356112] [INFO ] [MAIN ] ACCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:27.414727] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACCO took 0.9s. Estimated remaining: 12m 55s. Rate: 182.1 symbols/min [2025-09-29T01:57:27.564131] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.777075] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.816912] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-29T01:57:27.875743] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.870786] [INFO ] [MAIN ] ACHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:27.876715] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACHR took 1.0s. Estimated remaining: 13m 11s. Rate: 178.3 symbols/min [2025-09-29T01:57:28.059004] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-29T01:57:28.160302] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:28.115825] [INFO ] [MAIN ] ACI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.164276] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 1.0s. Estimated remaining: 13m 5s. Rate: 179.6 symbols/min [2025-09-29T01:57:28.239498] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-29T01:57:28.275453] [INFO ] [MAIN ] ACM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.292866] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACM took 1.0s. Estimated remaining: 12m 42s. Rate: 185.0 symbols/min [2025-09-29T01:57:28.496083] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:28.497211] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-29T01:57:28.523686] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-29T01:57:28.546087] [INFO ] [MAIN ] ACP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.528973] [INFO ] [MAIN ] ACN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.546862] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 1.1s. Estimated remaining: 12m 34s. Rate: 186.9 symbols/min [2025-09-29T01:57:28.588974] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACP took 0.7s. Estimated remaining: 12m 5s. Rate: 194.2 symbols/min [2025-09-29T01:57:28.697706] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-29T01:57:28.714123] [INFO ] [MAIN ] ACR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.785719] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:28.816565] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 0.7s. Estimated remaining: 11m 57s. Rate: 196.4 symbols/min [2025-09-29T01:57:28.997044] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.141824] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.196386] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-29T01:57:29.197495] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-29T01:57:29.213971] [INFO ] [MAIN ] ACV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:29.222309] [INFO ] [MAIN ] ACRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:29.222773] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACV took 0.7s. Estimated remaining: 12m 6s. Rate: 193.8 symbols/min [2025-09-29T01:57:29.228420] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 0.9s. Estimated remaining: 11m 39s. Rate: 201.4 symbols/min [2025-09-29T01:57:29.364244] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.418725] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-29T01:57:29.424041] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-29T01:57:29.429505] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-29T01:57:29.453303] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-29T01:57:29.517365] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-29T01:57:29.540409] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-29T01:57:29.666366] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-29T01:57:29.796899] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.798328] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.814023] [INFO ] [MAIN ] ACVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:29.826674] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACVA took 1.1s. Estimated remaining: 12m 4s. Rate: 194.2 symbols/min [2025-09-29T01:57:30.135201] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-29T01:57:30.233830] [INFO ] [MAIN ] ADCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:30.275397] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:30.281006] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ADCT took 1.0s. Estimated remaining: 12m 16s. Rate: 191.0 symbols/min [2025-09-29T01:57:30.405003] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-29T01:57:30.441280] [INFO ] [MAIN ] ADC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:30.463944] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 1.2s. Estimated remaining: 12m 5s. Rate: 193.7 symbols/min [2025-09-29T01:57:30.596222] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:30.635896] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-29T01:57:30.797362] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:30.876396] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-29T01:57:30.898758] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:30.899553] [INFO ] [MAIN ] ADM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:30.900143] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADM took 1.0s. Estimated remaining: 12m 15s. Rate: 191.1 symbols/min [2025-09-29T01:57:30.949626] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:30.980460] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-29T01:57:31.003956] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:31.021702] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-29T01:57:31.025522] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:31.025867] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-29T01:57:31.041945] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-29T01:57:31.063088] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-29T01:57:31.087185] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-29T01:57:31.123083] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. AD took 2.3s. Estimated remaining: 12m 8s. Rate: 192.9 symbols/min [2025-09-29T01:57:31.127225] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:31.218450] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-29T01:57:31.259065] [INFO ] [MAIN ] ADNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:31.291734] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 1.0s. Estimated remaining: 11m 57s. Rate: 195.7 symbols/min [2025-09-29T01:57:31.396972] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-29T01:57:31.464315] [INFO ] [MAIN ] ADT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:31.445731] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:31.465029] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADT took 0.9s. Estimated remaining: 11m 47s. Rate: 198.4 symbols/min [2025-09-29T01:57:31.546899] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-29T01:57:31.577779] [INFO ] [MAIN ] ADX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:31.619119] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADX took 0.7s. Estimated remaining: 11m 37s. Rate: 201.3 symbols/min [2025-09-29T01:57:31.887866] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.007084] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.061637] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-29T01:57:32.115397] [INFO ] [MAIN ] AEFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.100329] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-29T01:57:32.138162] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.139022] [INFO ] [MAIN ] AEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.138435] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 0.8s. Estimated remaining: 11m 51s. Rate: 197.1 symbols/min [2025-09-29T01:57:32.146267] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 1.0s. Estimated remaining: 11m 32s. Rate: 202.6 symbols/min [2025-09-29T01:57:32.472857] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-29T01:57:32.559259] [INFO ] [MAIN ] AEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.583881] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.578999] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 1.1s. Estimated remaining: 11m 40s. Rate: 200.1 symbols/min [2025-09-29T01:57:32.604922] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.627711] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-29T01:57:32.628416] [INFO ] [MAIN ] AEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.629253] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 0.9s. Estimated remaining: 11m 24s. Rate: 204.6 symbols/min [2025-09-29T01:57:32.711043] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-29T01:57:32.711570] [INFO ] [MAIN ] AER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.712140] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 0.6s. Estimated remaining: 11m 11s. Rate: 208.4 symbols/min [2025-09-29T01:57:32.713471] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-29T01:57:32.713927] [INFO ] [MAIN ] AEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.714691] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 0.6s. Estimated remaining: 10m 55s. Rate: 213.7 symbols/min [2025-09-29T01:57:33.488949] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:33.540863] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:33.536509] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:33.546867] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:33.547992] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-29T01:57:33.549000] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-29T01:57:33.549136] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-29T01:57:33.549187] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-29T01:57:33.549245] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-29T01:57:33.549356] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-29T01:57:33.693925] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-29T01:57:33.780779] [INFO ] [MAIN ] AFB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:33.814513] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AFB took 1.1s. Estimated remaining: 11m 41s. Rate: 199.5 symbols/min [2025-09-29T01:57:34.074494] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-29T01:57:34.085966] [INFO ] [MAIN ] AES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:34.092203] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-29T01:57:34.098801] [INFO ] [MAIN ] AESI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:34.114951] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AES took 1.4s. Estimated remaining: 11m 40s. Rate: 199.5 symbols/min [2025-09-29T01:57:34.225710] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 1.4s. Estimated remaining: 11m 30s. Rate: 202.5 symbols/min [2025-09-29T01:57:34.203337] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:34.322432] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-29T01:57:34.434789] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:34.590607] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:34.683196] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:34.659472] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-29T01:57:34.704623] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:34.704884] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:34.705487] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-29T01:57:34.706366] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:34.706927] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-29T01:57:34.707460] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-29T01:57:34.717261] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-29T01:57:34.723149] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-29T01:57:34.723793] [INFO ] [MAIN ] AFGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:34.717610] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-29T01:57:34.724323] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-29T01:57:34.723936] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFGB took 0.5s. Estimated remaining: 11m 40s. Rate: 199.4 symbols/min [2025-09-29T01:57:34.725059] [INFO ] [MAIN ] AFGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:34.725452] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AEXA took 2.0s. Estimated remaining: 11m 24s. Rate: 203.9 symbols/min [2025-09-29T01:57:34.778784] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGC took 0.5s. Estimated remaining: 11m 12s. Rate: 207.6 symbols/min [2025-09-29T01:57:34.926724] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-29T01:57:35.019530] [INFO ] [MAIN ] AFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:35.045567] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFG took 1.2s. Estimated remaining: 11m 11s. Rate: 207.9 symbols/min [2025-09-29T01:57:35.247280] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.394416] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-29T01:57:35.425919] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.445419] [INFO ] [MAIN ] AFGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:35.474972] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.481420] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGD took 0.8s. Estimated remaining: 11m 17s. Rate: 205.7 symbols/min [2025-09-29T01:57:35.612026] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.641116] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-29T01:57:35.652984] [INFO ] [MAIN ] AFGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:35.658728] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 0.9s. Estimated remaining: 11m 12s. Rate: 207.4 symbols/min [2025-09-29T01:57:35.882163] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.933493] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-29T01:57:35.974110] [INFO ] [MAIN ] AFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:35.996102] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.011941] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 1.2s. Estimated remaining: 11m 14s. Rate: 206.5 symbols/min [2025-09-29T01:57:36.189587] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-29T01:57:36.214577] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-29T01:57:36.226591] [INFO ] [MAIN ] AG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:36.244167] [INFO ] [MAIN ] AGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:36.267006] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AG took 1.2s. Estimated remaining: 11m 13s. Rate: 207.0 symbols/min [2025-09-29T01:57:36.312339] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-29T01:57:36.331146] [INFO ] [MAIN ] AGCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:36.324188] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.303698] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 0.6s. Estimated remaining: 11m 1s. Rate: 210.5 symbols/min [2025-09-29T01:57:36.363275] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 0.9s. Estimated remaining: 10m 51s. Rate: 213.7 symbols/min [2025-09-29T01:57:36.760350] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.922594] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.927412] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.946949] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-29T01:57:36.948117] [INFO ] [MAIN ] AGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:36.948681] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGI took 0.9s. Estimated remaining: 11m 4s. Rate: 209.5 symbols/min [2025-09-29T01:57:37.055035] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-29T01:57:37.107437] [INFO ] [MAIN ] AGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.133558] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGM took 0.8s. Estimated remaining: 10m 59s. Rate: 210.9 symbols/min [2025-09-29T01:57:37.281972] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-29T01:57:37.330491] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:37.343245] [INFO ] [MAIN ] AGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.337717] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-29T01:57:37.364790] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGO took 1.0s. Estimated remaining: 10m 57s. Rate: 211.6 symbols/min [2025-09-29T01:57:37.376700] [INFO ] [MAIN ] AGL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.382828] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGL took 1.1s. Estimated remaining: 10m 45s. Rate: 215.1 symbols/min [2025-09-29T01:57:37.639323] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:37.836284] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:37.859792] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-29T01:57:37.903321] [INFO ] [MAIN ] AGRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.904719] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGRO took 1.0s. Estimated remaining: 10m 55s. Rate: 211.9 symbols/min [2025-09-29T01:57:37.925685] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:37.936355] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-29T01:57:37.936958] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-29T01:57:37.943730] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-29T01:57:37.938388] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-29T01:57:37.981988] [INFO ] [MAIN ] AGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.988066] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-29T01:57:37.988413] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGX took 0.8s. Estimated remaining: 10m 47s. Rate: 214.5 symbols/min [2025-09-29T01:57:38.018142] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-29T01:57:38.063745] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-29T01:57:38.388740] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-29T01:57:38.438245] [INFO ] [MAIN ] AHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:38.497907] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:38.507252] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:38.474448] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AHH took 1.1s. Estimated remaining: 10m 54s. Rate: 211.9 symbols/min [2025-09-29T01:57:38.703541] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-29T01:57:38.774887] [INFO ] [MAIN ] AHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:38.789516] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHT took 0.8s. Estimated remaining: 10m 55s. Rate: 211.5 symbols/min [2025-09-29T01:57:39.165199] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:39.208075] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-29T01:57:39.199335] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:39.238249] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-29T01:57:39.240029] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:39.242300] [INFO ] [MAIN ] AHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:39.244860] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHR took 1.3s. Estimated remaining: 11m 1s. Rate: 209.4 symbols/min [2025-09-29T01:57:39.382614] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:39.400784] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-29T01:57:39.415079] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:39.415302] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-29T01:57:39.436904] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:39.468445] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-29T01:57:39.468233] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:39.468917] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-29T01:57:39.468971] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-29T01:57:39.469221] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-29T01:57:39.469425] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-29T01:57:39.469134] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-29T01:57:39.469625] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-29T01:57:39.469773] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-29T01:57:39.469919] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHL took 2.1s. Estimated remaining: 10m 59s. Rate: 210.2 symbols/min [2025-09-29T01:57:39.470224] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-29T01:57:39.470306] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-29T01:57:39.621984] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-29T01:57:39.686339] [INFO ] [MAIN ] AI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:39.715597] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AI took 1.2s. Estimated remaining: 10m 57s. Rate: 210.6 symbols/min [2025-09-29T01:57:39.895245] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-29T01:57:39.961117] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:40.012971] [INFO ] [MAIN ] AIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:40.055097] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 1.3s. Estimated remaining: 10m 59s. Rate: 210.0 symbols/min [2025-09-29T01:57:40.479414] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-29T01:57:40.452932] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:40.518191] [INFO ] [MAIN ] AIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:40.604532] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:40.599623] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIN took 1.1s. Estimated remaining: 11m 8s. Rate: 207.2 symbols/min [2025-09-29T01:57:40.609075] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:40.626680] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-29T01:57:40.674801] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-29T01:57:40.721829] [INFO ] [MAIN ] AIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:40.737311] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIO took 1.0s. Estimated remaining: 11m 2s. Rate: 208.8 symbols/min [2025-09-29T01:57:40.820906] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:40.876349] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-29T01:57:40.932638] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:40.950069] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:40.954780] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-29T01:57:40.955344] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:40.972677] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-29T01:57:41.001362] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-29T01:57:40.967368] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-29T01:57:41.036341] [INFO ] [MAIN ] AIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:41.008110] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-29T01:57:41.042322] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:41.040988] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-29T01:57:41.040877] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIR took 0.9s. Estimated remaining: 11m 2s. Rate: 208.6 symbols/min [2025-09-29T01:57:41.043258] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AII took 1.8s. Estimated remaining: 10m 53s. Rate: 211.7 symbols/min [2025-09-29T01:57:41.321037] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-29T01:57:41.371284] [INFO ] [MAIN ] AIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:41.449149] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIT took 0.8s. Estimated remaining: 10m 56s. Rate: 210.4 symbols/min [2025-09-29T01:57:41.492100] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:41.507310] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-29T01:57:41.553590] [INFO ] [MAIN ] AIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:41.599096] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 0.8s. Estimated remaining: 10m 52s. Rate: 211.8 symbols/min [2025-09-29T01:57:41.593710] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:41.700592] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-29T01:57:41.766786] [INFO ] [MAIN ] AIZN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:41.787467] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZN took 0.7s. Estimated remaining: 10m 48s. Rate: 212.8 symbols/min [2025-09-29T01:57:42.088860] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:42.183781] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-29T01:57:42.205997] [INFO ] [MAIN ] AIZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:42.268473] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 1.2s. Estimated remaining: 10m 54s. Rate: 210.7 symbols/min [2025-09-29T01:57:42.357941] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:42.421289] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-29T01:57:42.504074] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-29T01:57:42.577982] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-29T01:57:42.572687] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:42.578346] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-29T01:57:42.579010] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-29T01:57:42.594975] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-29T01:57:42.641091] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-29T01:57:42.695390] [INFO ] [MAIN ] AJG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:42.743703] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:42.749710] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AJG took 1.2s. Estimated remaining: 11m 0s. Rate: 208.8 symbols/min [2025-09-29T01:57:43.012484] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-29T01:57:43.116050] [INFO ] [MAIN ] AKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.228974] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKR took 1.4s. Estimated remaining: 11m 6s. Rate: 206.9 symbols/min [2025-09-29T01:57:43.346751] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-29T01:57:43.340266] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:43.412876] [INFO ] [MAIN ] AL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.518184] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 1.2s. Estimated remaining: 11m 5s. Rate: 206.9 symbols/min [2025-09-29T01:57:43.560279] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:43.566389] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-29T01:57:43.685931] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:43.870384] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:43.874599] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-29T01:57:43.876212] [INFO ] [MAIN ] ALB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.876904] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. ALB took 1.1s. Estimated remaining: 11m 7s. Rate: 206.3 symbols/min [2025-09-29T01:57:43.903260] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T01:57:43.904925] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-29T01:57:43.935784] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-29T01:57:43.936260] [INFO ] [MAIN ] ALC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.936721] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALC took 0.7s. Estimated remaining: 11m 0s. Rate: 208.4 symbols/min [2025-09-29T01:57:43.948281] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-29T01:57:43.948626] [INFO ] [MAIN ] ALE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.948760] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 0.4s. Estimated remaining: 10m 52s. Rate: 211.0 symbols/min [2025-09-29T01:57:44.232240] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T01:57:44.233677] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-29T01:57:44.513630] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-29T01:57:44.515074] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-29T01:57:44.791502] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T01:57:44.792953] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-29T01:57:45.071227] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-29T01:57:45.072622] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-29T01:57:45.428164] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T01:57:45.429973] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-29T01:57:45.554236] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.12 seconds). [2025-09-29T01:57:45.555579] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-29T01:57:45.754572] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T01:57:45.755618] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-29T01:57:45.954863] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T01:57:45.955995] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-29T01:57:46.154966] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T01:57:46.155900] [INFO ] [REMOTE ] AKA: Full fetch complete (2428 records). [2025-09-29T01:57:46.156061] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-29T01:57:46.408578] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T01:57:46.408843] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:57:46.408954] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:57:46.409053] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-29T01:57:46.409197] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-29T01:57:46.409276] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-29T01:57:46.409394] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-29T01:57:46.409521] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. AKA took 4.8s. Estimated remaining: 11m 54s. Rate: 192.6 symbols/min [2025-09-29T01:57:47.116443] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.191697] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.195686] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.187938] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.217541] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-29T01:57:47.218107] [INFO ] [MAIN ] ALG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:47.218240] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 0.8s. Estimated remaining: 12m 8s. Rate: 188.8 symbols/min [2025-09-29T01:57:47.456397] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.498702] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-29T01:57:47.499200] [INFO ] [MAIN ] ALEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:47.499319] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 1.1s. Estimated remaining: 12m 6s. Rate: 189.1 symbols/min [2025-09-29T01:57:47.500550] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-29T01:57:47.506861] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-29T01:57:47.534183] [INFO ] [MAIN ] ALIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:47.534328] [INFO ] [MAIN ] ALK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:47.550894] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 1.1s. Estimated remaining: 11m 59s. Rate: 191.0 symbols/min [2025-09-29T01:57:47.585228] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALIT took 1.1s. Estimated remaining: 11m 51s. Rate: 193.1 symbols/min [2025-09-29T01:57:48.000431] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.143434] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.149009] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.073675] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-29T01:57:48.150011] [INFO ] [MAIN ] ALL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.151524] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 0.9s. Estimated remaining: 11m 57s. Rate: 191.2 symbols/min [2025-09-29T01:57:48.442926] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.445181] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-29T01:57:48.484115] [INFO ] [MAIN ] ALSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.484713] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALSN took 0.9s. Estimated remaining: 11m 57s. Rate: 191.1 symbols/min [2025-09-29T01:57:48.520231] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-29T01:57:48.491823] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-29T01:57:48.536536] [INFO ] [MAIN ] ALLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.537197] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 1.0s. Estimated remaining: 11m 50s. Rate: 192.9 symbols/min [2025-09-29T01:57:48.549374] [INFO ] [MAIN ] ALLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.566044] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALLE took 1.1s. Estimated remaining: 11m 43s. Rate: 195.0 symbols/min [2025-09-29T01:57:48.792186] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-29T01:57:48.894404] [INFO ] [MAIN ] ALTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.954128] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.974938] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 0.8s. Estimated remaining: 11m 45s. Rate: 194.2 symbols/min [2025-09-29T01:57:49.071152] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.196056] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.226229] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-29T01:57:49.259017] [INFO ] [MAIN ] ALUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:49.276697] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 0.8s. Estimated remaining: 11m 44s. Rate: 194.3 symbols/min [2025-09-29T01:57:49.402707] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.406312] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-29T01:57:49.422030] [INFO ] [MAIN ] ALX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:49.438996] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 0.8s. Estimated remaining: 11m 40s. Rate: 195.3 symbols/min [2025-09-29T01:57:49.687547] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.689378] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-29T01:57:49.690423] [INFO ] [MAIN ] ALV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:49.696325] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALV took 1.1s. Estimated remaining: 11m 39s. Rate: 195.7 symbols/min [2025-09-29T01:57:49.835718] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.978525] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-29T01:57:50.001727] [INFO ] [MAIN ] AM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:50.009359] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-29T01:57:50.039251] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AM took 1.0s. Estimated remaining: 11m 39s. Rate: 195.4 symbols/min [2025-09-29T01:57:50.040633] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:50.051705] [INFO ] [MAIN ] AMBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:50.064438] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-29T01:57:50.076285] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 0.8s. Estimated remaining: 11m 33s. Rate: 197.3 symbols/min [2025-09-29T01:57:50.114612] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-29T01:57:50.195283] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-29T01:57:50.195478] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-29T01:57:50.209136] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-29T01:57:50.216057] [INFO ] [MAIN ] AMBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:50.228535] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-29T01:57:50.241943] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-29T01:57:50.285889] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBP took 0.8s. Estimated remaining: 11m 30s. Rate: 197.9 symbols/min [2025-09-29T01:57:50.473400] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:50.786726] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:50.992378] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:51.091071] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-29T01:57:51.118204] [INFO ] [MAIN ] AMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:51.136440] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMC took 1.1s. Estimated remaining: 11m 43s. Rate: 194.2 symbols/min [2025-09-29T01:57:51.203400] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:51.221602] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-29T01:57:51.316385] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-29T01:57:51.340170] [INFO ] [MAIN ] AMCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:51.357289] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMCR took 1.2s. Estimated remaining: 11m 40s. Rate: 194.8 symbols/min [2025-09-29T01:57:51.398148] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:51.458756] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:51.453765] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-29T01:57:51.493301] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:51.545683] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-29T01:57:51.580723] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:51.587734] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-29T01:57:51.591290] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-29T01:57:51.591947] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-29T01:57:51.607994] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-29T01:57:51.597535] [INFO ] [MAIN ] AME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:51.682379] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:51.681296] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AME took 1.3s. Estimated remaining: 11m 40s. Rate: 194.7 symbols/min [2025-09-29T01:57:51.682536] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-29T01:57:51.683085] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMBQ took 2.0s. Estimated remaining: 11m 33s. Rate: 196.7 symbols/min [2025-09-29T01:57:51.759604] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-29T01:57:51.831530] [INFO ] [MAIN ] AMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:51.888923] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 0.7s. Estimated remaining: 11m 31s. Rate: 197.3 symbols/min [2025-09-29T01:57:52.115385] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:52.204487] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-29T01:57:52.264817] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:52.266601] [INFO ] [MAIN ] AMH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:52.279405] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 0.9s. Estimated remaining: 11m 32s. Rate: 196.8 symbols/min [2025-09-29T01:57:52.389234] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:52.611837] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-29T01:57:52.609436] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:52.610923] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-29T01:57:52.612450] [INFO ] [MAIN ] AMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:52.613039] [INFO ] [MAIN ] AMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:52.614077] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMN took 0.9s. Estimated remaining: 11m 33s. Rate: 196.6 symbols/min [2025-09-29T01:57:52.629539] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 0.9s. Estimated remaining: 11m 26s. Rate: 198.4 symbols/min [2025-09-29T01:57:52.883628] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-29T01:57:52.884773] [INFO ] [MAIN ] AMPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:52.895965] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 1.0s. Estimated remaining: 11m 25s. Rate: 198.6 symbols/min [2025-09-29T01:57:53.108112] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-29T01:57:53.167784] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:53.152792] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:53.173623] [INFO ] [MAIN ] AMPY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:53.179112] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPY took 0.9s. Estimated remaining: 11m 24s. Rate: 198.8 symbols/min [2025-09-29T01:57:53.367976] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:53.405485] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-29T01:57:53.421745] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-29T01:57:53.462781] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-29T01:57:53.485886] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-29T01:57:53.491316] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-29T01:57:53.514051] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:53.525887] [INFO ] [MAIN ] AMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:53.514274] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-29T01:57:53.526862] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMR took 0.9s. Estimated remaining: 11m 25s. Rate: 198.5 symbols/min [2025-09-29T01:57:53.526669] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-29T01:57:53.545547] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-29T01:57:53.593909] [INFO ] [MAIN ] AMRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:53.695413] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 1.0s. Estimated remaining: 11m 22s. Rate: 199.3 symbols/min [2025-09-29T01:57:54.256339] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:54.304597] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:54.337061] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-29T01:57:54.351082] [INFO ] [MAIN ] AMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:54.372975] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMT took 1.2s. Estimated remaining: 11m 29s. Rate: 197.0 symbols/min [2025-09-29T01:57:54.400691] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-29T01:57:54.413924] [INFO ] [MAIN ] AMTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:54.478390] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:54.489198] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-29T01:57:54.488888] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTD took 0.7s. Estimated remaining: 11m 25s. Rate: 198.1 symbols/min [2025-09-29T01:57:54.631744] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-29T01:57:54.690485] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:54.700839] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-29T01:57:54.673158] [INFO ] [MAIN ] AMTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:54.712064] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:54.718517] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTB took 1.2s. Estimated remaining: 11m 23s. Rate: 198.6 symbols/min [2025-09-29T01:57:54.729333] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-29T01:57:54.801030] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:54.870703] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-29T01:57:54.918609] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:54.891779] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:54.946357] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-29T01:57:54.953511] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-29T01:57:54.964182] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-29T01:57:54.979959] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMRZ took 2.1s. Estimated remaining: 11m 22s. Rate: 198.8 symbols/min [2025-09-29T01:57:55.111252] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-29T01:57:55.174846] [INFO ] [MAIN ] AMWL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:55.182782] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:55.193741] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMWL took 0.7s. Estimated remaining: 11m 20s. Rate: 199.3 symbols/min [2025-09-29T01:57:55.350959] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:55.438171] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-29T01:57:55.484846] [INFO ] [MAIN ] AMTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:55.513747] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMTM took 1.1s. Estimated remaining: 11m 20s. Rate: 199.2 symbols/min [2025-09-29T01:57:55.539951] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:55.656868] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-29T01:57:55.658630] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-29T01:57:55.676203] [INFO ] [MAIN ] AMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:55.688068] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 0.9s. Estimated remaining: 11m 17s. Rate: 200.0 symbols/min [2025-09-29T01:57:55.688500] [INFO ] [MAIN ] AN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:55.694772] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AN took 0.7s. Estimated remaining: 11m 11s. Rate: 201.7 symbols/min [2025-09-29T01:57:56.003121] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:56.187066] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:56.208350] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:56.225390] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-29T01:57:56.226020] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-29T01:57:56.226498] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-29T01:57:56.226616] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-29T01:57:56.226732] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-29T01:57:56.228362] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-29T01:57:56.227124] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-29T01:57:56.252282] [INFO ] [MAIN ] ANET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:56.253131] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANET took 1.0s. Estimated remaining: 11m 16s. Rate: 200.2 symbols/min [2025-09-29T01:57:56.569037] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-29T01:57:56.604993] [INFO ] [MAIN ] ANRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:56.604781] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-29T01:57:56.657679] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANRO took 1.0s. Estimated remaining: 11m 18s. Rate: 199.6 symbols/min [2025-09-29T01:57:56.706530] [INFO ] [MAIN ] ANF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:56.732121] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANF took 1.2s. Estimated remaining: 11m 13s. Rate: 200.9 symbols/min [2025-09-29T01:57:56.748386] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:56.926680] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:56.928104] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-29T01:57:56.928711] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-29T01:57:56.929194] [INFO ] [MAIN ] ANVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:56.929345] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANVS took 0.7s. Estimated remaining: 11m 11s. Rate: 201.4 symbols/min [2025-09-29T01:57:57.046969] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:57.047333] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-29T01:57:57.047423] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:57.047496] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-29T01:57:57.047562] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:57.047709] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-29T01:57:57.047818] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-29T01:57:57.047893] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-29T01:57:57.047991] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-29T01:57:57.048082] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANGX took 1.4s. Estimated remaining: 11m 7s. Rate: 202.4 symbols/min [2025-09-29T01:57:57.724665] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:57.771522] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:57.809162] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:57.798600] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-29T01:57:57.833541] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-29T01:57:57.864133] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:57.865181] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-29T01:57:57.865289] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-29T01:57:57.865357] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-29T01:57:57.865405] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-29T01:57:58.019396] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-29T01:57:58.064550] [INFO ] [MAIN ] AOMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:58.140474] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-29T01:57:58.149241] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMR took 1.0s. Estimated remaining: 11m 22s. Rate: 198.0 symbols/min [2025-09-29T01:57:58.172829] [INFO ] [MAIN ] AOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:58.247004] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOD took 1.2s. Estimated remaining: 11m 18s. Rate: 199.1 symbols/min [2025-09-29T01:57:58.369970] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-29T01:57:58.414705] [INFO ] [MAIN ] AON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:58.426426] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AON took 1.4s. Estimated remaining: 11m 15s. Rate: 199.8 symbols/min [2025-09-29T01:57:58.766210] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:58.801165] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:58.859259] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-29T01:57:58.948341] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.045298] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.059242] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:59.061455] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-29T01:57:59.061602] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-29T01:57:59.062232] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:59.062415] [INFO ] [MAIN ] AORT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:59.063320] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AORT took 0.9s. Estimated remaining: 11m 21s. Rate: 198.0 symbols/min [2025-09-29T01:57:59.062720] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-29T01:57:59.081758] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:59.123098] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-29T01:57:59.161444] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-29T01:57:59.178666] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-29T01:57:59.189781] [INFO ] [MAIN ] AP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:59.200359] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-29T01:57:59.200671] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-29T01:57:59.190117] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AP took 0.7s. Estimated remaining: 11m 18s. Rate: 198.9 symbols/min [2025-09-29T01:57:59.206262] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AOMD took 2.1s. Estimated remaining: 11m 12s. Rate: 200.4 symbols/min [2025-09-29T01:57:59.370082] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-29T01:57:59.457442] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.507860] [INFO ] [MAIN ] AOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:59.513740] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 1.2s. Estimated remaining: 11m 12s. Rate: 200.4 symbols/min [2025-09-29T01:57:59.794483] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.845381] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.964590] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-29T01:57:59.962878] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.965456] [INFO ] [MAIN ] APAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:59.966108] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 0.9s. Estimated remaining: 11m 14s. Rate: 199.6 symbols/min [2025-09-29T01:58:00.220106] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-29T01:58:00.245262] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:00.245714] [INFO ] [MAIN ] APD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.247142] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-29T01:58:00.248015] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 1.0s. Estimated remaining: 11m 14s. Rate: 199.7 symbols/min [2025-09-29T01:58:00.254371] [INFO ] [MAIN ] APG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.269816] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 0.9s. Estimated remaining: 11m 9s. Rate: 201.1 symbols/min [2025-09-29T01:58:00.583552] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-29T01:58:00.676062] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:00.681467] [INFO ] [MAIN ] APH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.706892] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 1.2s. Estimated remaining: 11m 11s. Rate: 200.4 symbols/min [2025-09-29T01:58:00.755083] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:00.781292] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-29T01:58:00.828945] [INFO ] [MAIN ] APLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.873350] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 0.9s. Estimated remaining: 11m 8s. Rate: 201.1 symbols/min [2025-09-29T01:58:00.883424] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-29T01:58:00.884267] [INFO ] [MAIN ] APOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.884611] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APOS took 0.6s. Estimated remaining: 11m 3s. Rate: 202.5 symbols/min [2025-09-29T01:58:01.189543] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:01.384673] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:01.386271] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-29T01:58:01.426203] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:01.427334] [INFO ] [MAIN ] APO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:01.428011] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APO took 1.2s. Estimated remaining: 11m 7s. Rate: 201.3 symbols/min [2025-09-29T01:58:01.511055] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-29T01:58:01.545711] [INFO ] [MAIN ] AQNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:01.579818] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 0.6s. Estimated remaining: 11m 4s. Rate: 202.0 symbols/min [2025-09-29T01:58:01.694392] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:01.677931] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-29T01:58:01.724169] [INFO ] [MAIN ] APTV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:01.763723] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 1.0s. Estimated remaining: 11m 2s. Rate: 202.6 symbols/min [2025-09-29T01:58:01.923378] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-29T01:58:02.001832] [INFO ] [MAIN ] AQN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.075304] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.080808] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 1.2s. Estimated remaining: 11m 2s. Rate: 202.5 symbols/min [2025-09-29T01:58:02.219898] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.360924] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-29T01:58:02.361684] [INFO ] [MAIN ] AR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.411276] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 1.0s. Estimated remaining: 11m 2s. Rate: 202.3 symbols/min [2025-09-29T01:58:02.434979] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.435638] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-29T01:58:02.490120] [INFO ] [MAIN ] ARDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.523487] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 0.7s. Estimated remaining: 10m 59s. Rate: 203.2 symbols/min [2025-09-29T01:58:02.496319] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-29T01:58:02.572840] [INFO ] [MAIN ] ARCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.638224] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARCO took 1.0s. Estimated remaining: 10m 56s. Rate: 204.1 symbols/min [2025-09-29T01:58:02.937902] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.965788] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-29T01:58:02.970183] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.996303] [INFO ] [MAIN ] ARDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.996676] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 0.9s. Estimated remaining: 10m 57s. Rate: 203.8 symbols/min [2025-09-29T01:58:03.159905] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:03.307233] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:03.350549] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-29T01:58:03.361318] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-29T01:58:03.362135] [INFO ] [MAIN ] ARE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:03.362757] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARE took 0.9s. Estimated remaining: 10m 57s. Rate: 203.4 symbols/min [2025-09-29T01:58:03.372446] [INFO ] [MAIN ] ARES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:03.383771] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 0.8s. Estimated remaining: 10m 53s. Rate: 204.8 symbols/min [2025-09-29T01:58:03.555590] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-29T01:58:03.598277] [INFO ] [MAIN ] ARI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:03.637144] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 1.0s. Estimated remaining: 10m 52s. Rate: 205.0 symbols/min [2025-09-29T01:58:03.753215] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:03.853325] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:03.854808] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-29T01:58:03.871149] [INFO ] [MAIN ] ARIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:03.911620] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 0.9s. Estimated remaining: 10m 51s. Rate: 205.1 symbols/min [2025-09-29T01:58:04.166422] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:04.213638] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-29T01:58:04.225992] [INFO ] [MAIN ] ARLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:04.302556] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:04.298337] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 0.9s. Estimated remaining: 10m 52s. Rate: 204.6 symbols/min [2025-09-29T01:58:04.373192] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-29T01:58:04.407119] [INFO ] [MAIN ] ARMK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:04.418619] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 1.0s. Estimated remaining: 10m 50s. Rate: 205.4 symbols/min [2025-09-29T01:58:04.661345] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:04.681729] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-29T01:58:04.726830] [INFO ] [MAIN ] AROC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:04.734087] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-29T01:58:04.735000] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. AROC took 1.1s. Estimated remaining: 10m 50s. Rate: 205.3 symbols/min [2025-09-29T01:58:04.775159] [INFO ] [MAIN ] ARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:04.825102] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARR took 0.9s. Estimated remaining: 10m 46s. Rate: 206.3 symbols/min [2025-09-29T01:58:04.829476] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:04.863567] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-29T01:58:04.886736] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-29T01:58:04.887014] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-29T01:58:04.887106] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-29T01:58:04.887184] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-29T01:58:04.918405] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-29T01:58:05.282455] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-29T01:58:05.310548] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:05.351412] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:05.346475] [INFO ] [MAIN ] ARW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:05.395534] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARW took 1.1s. Estimated remaining: 10m 50s. Rate: 205.0 symbols/min [2025-09-29T01:58:05.609306] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-29T01:58:05.645830] [INFO ] [MAIN ] ASA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:05.706038] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ASA took 0.9s. Estimated remaining: 10m 50s. Rate: 204.9 symbols/min [2025-09-29T01:58:05.816659] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:05.952996] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-29T01:58:05.990947] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:06.033325] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-29T01:58:06.032901] [INFO ] [MAIN ] AS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:06.041508] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. AS took 1.3s. Estimated remaining: 10m 50s. Rate: 204.7 symbols/min [2025-09-29T01:58:06.184302] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:06.287179] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:06.349395] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:06.344447] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-29T01:58:06.367050] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:06.367198] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-29T01:58:06.367324] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:06.367473] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-29T01:58:06.367628] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-29T01:58:06.367751] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-29T01:58:06.368021] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-29T01:58:06.368184] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ARX took 1.9s. Estimated remaining: 10m 51s. Rate: 204.5 symbols/min [2025-09-29T01:58:06.381859] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-29T01:58:06.405477] [INFO ] [MAIN ] ASAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:06.437929] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 1.0s. Estimated remaining: 10m 47s. Rate: 205.5 symbols/min [2025-09-29T01:58:06.424551] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-29T01:58:06.454477] [INFO ] [MAIN ] ASBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:06.511479] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASBA took 0.5s. Estimated remaining: 10m 44s. Rate: 206.5 symbols/min [2025-09-29T01:58:06.752755] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-29T01:58:06.849071] [INFO ] [MAIN ] ASB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:06.853473] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:06.880684] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 1.1s. Estimated remaining: 10m 45s. Rate: 206.2 symbols/min [2025-09-29T01:58:06.982772] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:07.074562] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:07.241933] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:07.262444] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-29T01:58:07.263898] [INFO ] [MAIN ] ASC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:07.271703] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 0.9s. Estimated remaining: 10m 46s. Rate: 205.7 symbols/min [2025-09-29T01:58:07.273933] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-29T01:58:07.279831] [INFO ] [MAIN ] ASGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:07.280885] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASGI took 0.7s. Estimated remaining: 10m 41s. Rate: 207.0 symbols/min [2025-09-29T01:58:07.281304] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-29T01:58:07.281772] [INFO ] [MAIN ] ASG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:07.281893] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASG took 0.8s. Estimated remaining: 10m 37s. Rate: 208.3 symbols/min [2025-09-29T01:58:07.313387] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-29T01:58:07.313780] [INFO ] [MAIN ] ASGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:07.313886] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 0.4s. Estimated remaining: 10m 33s. Rate: 209.5 symbols/min [2025-09-29T01:58:08.012431] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.096103] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.097286] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.118451] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.135476] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-29T01:58:08.136205] [INFO ] [MAIN ] ASR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:08.136369] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 0.8s. Estimated remaining: 10m 40s. Rate: 207.1 symbols/min [2025-09-29T01:58:08.302393] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-29T01:58:08.311081] [INFO ] [MAIN ] ASIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:08.386033] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 1.1s. Estimated remaining: 10m 40s. Rate: 207.2 symbols/min [2025-09-29T01:58:08.388522] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-29T01:58:08.387357] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-29T01:58:08.420196] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.420341] [INFO ] [MAIN ] ASPN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:08.430679] [INFO ] [MAIN ] ASH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:08.431443] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASPN took 1.1s. Estimated remaining: 10m 36s. Rate: 208.3 symbols/min [2025-09-29T01:58:08.447529] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASH took 1.1s. Estimated remaining: 10m 32s. Rate: 209.5 symbols/min [2025-09-29T01:58:08.859711] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.971377] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:09.031898] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:09.050824] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-29T01:58:09.053536] [INFO ] [MAIN ] ASX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.054343] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 0.9s. Estimated remaining: 10m 36s. Rate: 208.1 symbols/min [2025-09-29T01:58:09.272812] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-29T01:58:09.301474] [INFO ] [MAIN ] ATEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.302001] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATEN took 0.9s. Estimated remaining: 10m 35s. Rate: 208.3 symbols/min [2025-09-29T01:58:09.300583] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:09.366314] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-29T01:58:09.394980] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-29T01:58:09.400980] [INFO ] [MAIN ] ATHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.411628] [INFO ] [MAIN ] ATGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.443035] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATHM took 1.0s. Estimated remaining: 10m 33s. Rate: 208.9 symbols/min [2025-09-29T01:58:09.449498] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATGE took 1.0s. Estimated remaining: 10m 29s. Rate: 210.1 symbols/min [2025-09-29T01:58:09.471375] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-29T01:58:09.515158] [INFO ] [MAIN ] ATHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.581127] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 0.5s. Estimated remaining: 10m 27s. Rate: 210.8 symbols/min [2025-09-29T01:58:09.778916] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:09.990266] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:10.165356] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:10.160965] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:10.218212] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-29T01:58:10.230270] [INFO ] [MAIN ] ATI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:10.233064] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 0.9s. Estimated remaining: 10m 31s. Rate: 209.2 symbols/min [2025-09-29T01:58:10.393773] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-29T01:58:10.400636] [INFO ] [MAIN ] ATMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:10.401331] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATMU took 0.9s. Estimated remaining: 10m 29s. Rate: 209.7 symbols/min [2025-09-29T01:58:10.402189] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-29T01:58:10.488343] [INFO ] [MAIN ] ATKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:10.578375] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:10.578491] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATKR took 1.1s. Estimated remaining: 10m 28s. Rate: 210.2 symbols/min [2025-09-29T01:58:10.575900] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-29T01:58:10.612527] [INFO ] [MAIN ] ATO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:10.613278] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 0.9s. Estimated remaining: 10m 24s. Rate: 211.3 symbols/min [2025-09-29T01:58:10.935671] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.006370] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-29T01:58:11.072967] [INFO ] [MAIN ] ATR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.100913] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 0.9s. Estimated remaining: 10m 26s. Rate: 210.4 symbols/min [2025-09-29T01:58:11.149485] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.143927] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.192002] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-29T01:58:11.203677] [INFO ] [MAIN ] ATS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.215114] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 0.8s. Estimated remaining: 10m 24s. Rate: 211.1 symbols/min [2025-09-29T01:58:11.546031] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.591483] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-29T01:58:11.592756] [INFO ] [MAIN ] ATUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.594780] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 1.0s. Estimated remaining: 10m 25s. Rate: 210.7 symbols/min [2025-09-29T01:58:11.623697] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.762959] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-29T01:58:11.773279] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-29T01:58:11.774184] [INFO ] [MAIN ] AUNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.774318] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUNA took 0.6s. Estimated remaining: 10m 23s. Rate: 211.2 symbols/min [2025-09-29T01:58:11.779812] [INFO ] [MAIN ] AU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.851512] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AU took 1.2s. Estimated remaining: 10m 21s. Rate: 212.0 symbols/min [2025-09-29T01:58:11.955151] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:12.112036] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-29T01:58:12.176339] [INFO ] [MAIN ] AUB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:12.193991] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUB took 1.0s. Estimated remaining: 10m 21s. Rate: 211.8 symbols/min [2025-09-29T01:58:12.256486] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:12.479507] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:12.479900] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-29T01:58:12.486404] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-29T01:58:12.486965] [INFO ] [MAIN ] AVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:12.492584] [INFO ] [MAIN ] AVAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:12.535695] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVAL took 0.8s. Estimated remaining: 10m 21s. Rate: 211.5 symbols/min [2025-09-29T01:58:12.578433] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 0.9s. Estimated remaining: 10m 18s. Rate: 212.5 symbols/min [2025-09-29T01:58:12.598921] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:12.697213] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-29T01:58:12.781477] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-29T01:58:12.846495] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-29T01:58:12.858004] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-29T01:58:12.874985] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-29T01:58:12.885289] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-29T01:58:12.972492] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:13.063944] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-29T01:58:13.057188] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:13.081860] [INFO ] [MAIN ] AVB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:13.087674] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVB took 1.1s. Estimated remaining: 10m 21s. Rate: 211.6 symbols/min [2025-09-29T01:58:13.307154] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-29T01:58:13.430064] [INFO ] [MAIN ] AVK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:13.436262] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-29T01:58:13.501728] [INFO ] [MAIN ] AVD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:13.502678] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVK took 0.9s. Estimated remaining: 10m 22s. Rate: 211.1 symbols/min [2025-09-29T01:58:13.535958] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:13.542098] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 1.0s. Estimated remaining: 10m 19s. Rate: 212.1 symbols/min [2025-09-29T01:58:14.060857] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:14.075073] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:14.076354] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-29T01:58:14.102718] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-29T01:58:14.101881] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:14.105583] [INFO ] [MAIN ] AVNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:14.107615] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVNS took 1.0s. Estimated remaining: 10m 22s. Rate: 210.9 symbols/min [2025-09-29T01:58:14.268428] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:14.319257] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-29T01:58:14.362759] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:14.363187] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-29T01:58:14.348010] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:14.365097] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-29T01:58:14.363431] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:14.365612] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-29T01:58:14.365982] [INFO ] [MAIN ] AVNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:14.366297] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNT took 0.8s. Estimated remaining: 10m 21s. Rate: 211.0 symbols/min [2025-09-29T01:58:14.366172] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-29T01:58:14.389496] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-29T01:58:14.406068] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-29T01:58:14.416684] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVBC took 2.2s. Estimated remaining: 10m 18s. Rate: 212.0 symbols/min [2025-09-29T01:58:14.542622] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-29T01:58:14.575109] [INFO ] [MAIN ] AVTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:14.617404] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 1.0s. Estimated remaining: 10m 17s. Rate: 212.3 symbols/min [2025-09-29T01:58:14.790189] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:14.791719] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-29T01:58:14.871234] [INFO ] [MAIN ] AVY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:14.916470] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVY took 0.8s. Estimated remaining: 10m 17s. Rate: 212.2 symbols/min [2025-09-29T01:58:15.161827] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.163669] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.208200] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-29T01:58:15.230123] [INFO ] [MAIN ] AWF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.235836] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 0.9s. Estimated remaining: 10m 17s. Rate: 212.1 symbols/min [2025-09-29T01:58:15.432793] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.546625] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.564449] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-29T01:58:15.565328] [INFO ] [MAIN ] AWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.565453] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 1.1s. Estimated remaining: 10m 17s. Rate: 211.9 symbols/min [2025-09-29T01:58:15.722527] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-29T01:58:15.731557] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-29T01:58:15.723303] [INFO ] [MAIN ] AWP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.742952] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 0.8s. Estimated remaining: 10m 16s. Rate: 212.3 symbols/min [2025-09-29T01:58:15.816788] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-29T01:58:15.743104] [INFO ] [MAIN ] AWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.836169] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWK took 1.2s. Estimated remaining: 10m 13s. Rate: 213.1 symbols/min [2025-09-29T01:58:15.847720] [INFO ] [MAIN ] AWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.852327] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.852819] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 0.6s. Estimated remaining: 10m 10s. Rate: 214.1 symbols/min [2025-09-29T01:58:16.353244] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-29T01:58:16.439758] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.463088] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.470597] [INFO ] [MAIN ] AX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:16.491871] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 0.9s. Estimated remaining: 10m 14s. Rate: 212.7 symbols/min [2025-09-29T01:58:16.498472] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.628581] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-29T01:58:16.633911] [INFO ] [MAIN ] AXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:16.640527] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXR took 0.7s. Estimated remaining: 10m 12s. Rate: 213.2 symbols/min [2025-09-29T01:58:16.828196] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.908403] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-29T01:58:16.951492] [INFO ] [MAIN ] AXL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:16.967376] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-29T01:58:16.990986] [INFO ] [MAIN ] AXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:16.990827] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.991790] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXL took 1.2s. Estimated remaining: 10m 13s. Rate: 212.9 symbols/min [2025-09-29T01:58:16.992889] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 1.1s. Estimated remaining: 10m 9s. Rate: 214.0 symbols/min [2025-09-29T01:58:17.026360] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-29T01:58:17.026916] [INFO ] [MAIN ] AXS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:17.030848] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 0.5s. Estimated remaining: 10m 6s. Rate: 215.0 symbols/min [2025-09-29T01:58:17.081676] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-29T01:58:17.082134] [INFO ] [MAIN ] AXTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:17.082728] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 0.4s. Estimated remaining: 10m 4s. Rate: 215.8 symbols/min [2025-09-29T01:58:17.867294] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:17.878221] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:17.904630] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:17.905083] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-29T01:58:17.914069] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-29T01:58:17.937938] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:17.938552] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-29T01:58:17.938787] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-29T01:58:17.938952] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-29T01:58:17.939397] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-29T01:58:18.070693] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-29T01:58:18.112420] [INFO ] [MAIN ] AZO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:18.114045] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-29T01:58:18.130194] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AZO took 1.0s. Estimated remaining: 10m 12s. Rate: 212.9 symbols/min [2025-09-29T01:58:18.135557] [INFO ] [MAIN ] AZZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:18.235344] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-29T01:58:18.242213] [INFO ] [MAIN ] AYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:18.216379] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZZ took 1.1s. Estimated remaining: 10m 9s. Rate: 213.6 symbols/min [2025-09-29T01:58:18.316940] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 1.2s. Estimated remaining: 10m 7s. Rate: 214.3 symbols/min [2025-09-29T01:58:18.823996] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:18.928595] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:19.021062] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.026565] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.027054] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-29T01:58:19.155557] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-29T01:58:19.157004] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-29T01:58:19.156128] [INFO ] [MAIN ] BA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:19.158033] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. BA took 1.0s. Estimated remaining: 10m 13s. Rate: 212.2 symbols/min [2025-09-29T01:58:19.159227] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-29T01:58:19.159379] [INFO ] [MAIN ] BABA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:19.183820] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BABA took 0.9s. Estimated remaining: 10m 10s. Rate: 213.2 symbols/min [2025-09-29T01:58:19.183353] [INFO ] [MAIN ] BAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:19.236499] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAC took 0.9s. Estimated remaining: 10m 7s. Rate: 214.0 symbols/min [2025-09-29T01:58:19.579334] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.764109] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.787032] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.822517] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T01:58:19.831007] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-29T01:58:19.890528] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-29T01:58:19.906744] [INFO ] [MAIN ] BAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:19.906947] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAK took 0.7s. Estimated remaining: 10m 11s. Rate: 212.6 symbols/min [2025-09-29T01:58:20.050260] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-29T01:58:20.078703] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-29T01:58:20.099767] [INFO ] [MAIN ] BALL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:20.078981] [INFO ] [MAIN ] BAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:20.105976] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAH took 0.9s. Estimated remaining: 10m 10s. Rate: 212.9 symbols/min [2025-09-29T01:58:20.178732] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:20.150005] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BALL took 0.8s. Estimated remaining: 10m 7s. Rate: 213.7 symbols/min [2025-09-29T01:58:20.238831] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-29T01:58:20.253453] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-29T01:58:20.280157] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-29T01:58:20.295768] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-29T01:58:20.366995] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-29T01:58:20.390810] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-29T01:58:20.650721] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:20.779366] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:20.798852] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T01:58:20.822705] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-29T01:58:21.019381] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:21.063919] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-29T01:58:21.091324] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:21.115923] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-29T01:58:21.133883] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-29T01:58:21.151113] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:21.164302] [INFO ] [MAIN ] BAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:21.213606] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:21.216501] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-29T01:58:21.215734] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-29T01:58:21.217164] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAM took 1.1s. Estimated remaining: 10m 15s. Rate: 210.9 symbols/min [2025-09-29T01:58:21.217728] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-29T01:58:21.218974] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-29T01:58:21.219092] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-29T01:58:21.224932] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. B took 4.1s. Estimated remaining: 10m 12s. Rate: 211.9 symbols/min [2025-09-29T01:58:21.226061] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-29T01:58:21.292785] [INFO ] [MAIN ] BANC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:21.339960] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BANC took 1.1s. Estimated remaining: 10m 10s. Rate: 212.5 symbols/min [2025-09-29T01:58:21.656987] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:21.779905] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:21.878821] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:21.896479] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T01:58:21.914692] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-29T01:58:21.927850] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-29T01:58:21.928547] [INFO ] [MAIN ] BAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:21.928689] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BAP took 0.7s. Estimated remaining: 10m 12s. Rate: 211.4 symbols/min [2025-09-29T01:58:22.087850] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-29T01:58:22.114343] [INFO ] [MAIN ] BARK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:22.155210] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BARK took 0.9s. Estimated remaining: 10m 12s. Rate: 211.6 symbols/min [2025-09-29T01:58:22.182194] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:22.269802] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-29T01:58:22.316317] [INFO ] [MAIN ] BAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:22.322232] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BAX took 0.9s. Estimated remaining: 10m 10s. Rate: 212.0 symbols/min [2025-09-29T01:58:22.535489] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:22.611085] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-29T01:58:22.649121] [INFO ] [MAIN ] BB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:22.663924] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BB took 0.7s. Estimated remaining: 10m 10s. Rate: 211.8 symbols/min [2025-09-29T01:58:22.696670] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T01:58:22.717820] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:22.795290] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-29T01:58:22.939366] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:22.950692] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-29T01:58:22.951678] [INFO ] [MAIN ] BBAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:22.952251] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BBAI took 0.8s. Estimated remaining: 10m 10s. Rate: 211.8 symbols/min [2025-09-29T01:58:23.078837] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-29T01:58:23.084091] [INFO ] [MAIN ] BBAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:23.100333] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 0.8s. Estimated remaining: 10m 9s. Rate: 212.3 symbols/min [2025-09-29T01:58:23.203088] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:23.307543] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-29T01:58:23.311108] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-29T01:58:23.382500] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-29T01:58:23.413364] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:23.423023] [INFO ] [MAIN ] BBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:23.424097] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBD took 0.8s. Estimated remaining: 10m 9s. Rate: 212.1 symbols/min [2025-09-29T01:58:23.561773] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-29T01:58:23.563824] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-29T01:58:23.627208] [INFO ] [MAIN ] BBDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:23.649728] [INFO ] [MAIN ] BBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:23.649898] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDO took 0.5s. Estimated remaining: 10m 8s. Rate: 212.3 symbols/min [2025-09-29T01:58:23.650237] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDC took 0.7s. Estimated remaining: 10m 5s. Rate: 213.3 symbols/min [2025-09-29T01:58:23.649361] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:23.978061] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-29T01:58:23.970578] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T01:58:24.005461] [INFO ] [MAIN ] BBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:24.015421] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBN took 0.6s. Estimated remaining: 10m 5s. Rate: 213.0 symbols/min [2025-09-29T01:58:24.006752] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:24.015878] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-29T01:58:24.031901] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-29T01:58:24.065037] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-29T01:58:24.066521] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-29T01:58:24.078316] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-29T01:58:24.139465] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-29T01:58:24.161251] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:24.177977] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-29T01:58:24.298975] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-29T01:58:24.349286] [INFO ] [MAIN ] BBU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:24.389829] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBU took 0.7s. Estimated remaining: 10m 6s. Rate: 212.7 symbols/min [2025-09-29T01:58:24.425744] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:24.629877] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T01:58:24.697233] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-29T01:58:24.696760] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-29T01:58:24.737807] [INFO ] [MAIN ] BBUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:24.801870] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBUC took 0.7s. Estimated remaining: 10m 7s. Rate: 212.3 symbols/min [2025-09-29T01:58:24.904003] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.116673] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:25.138670] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-29T01:58:25.211092] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.233176] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-29T01:58:25.233738] [INFO ] [MAIN ] BBVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:25.234869] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBVA took 0.8s. Estimated remaining: 10m 8s. Rate: 211.8 symbols/min [2025-09-29T01:58:25.296719] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:25.344429] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-29T01:58:25.345609] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T01:58:25.357040] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:25.375512] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-29T01:58:25.376498] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-29T01:58:25.386028] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:25.404573] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-29T01:58:25.453147] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-29T01:58:25.470128] [INFO ] [MAIN ] BBW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:25.441099] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-29T01:58:25.470390] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-29T01:58:25.475984] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.476137] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBW took 0.6s. Estimated remaining: 10m 7s. Rate: 211.9 symbols/min [2025-09-29T01:58:25.476522] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-29T01:58:25.483603] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBT took 1.8s. Estimated remaining: 10m 4s. Rate: 212.8 symbols/min [2025-09-29T01:58:25.830565] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.889822] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.903083] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T01:58:25.908947] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-29T01:58:25.936059] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-29T01:58:25.937000] [INFO ] [MAIN ] BBWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:25.938451] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBWI took 0.7s. Estimated remaining: 10m 6s. Rate: 212.2 symbols/min [2025-09-29T01:58:26.161629] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:26.199137] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-29T01:58:26.199947] [INFO ] [MAIN ] BBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:26.201578] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBY took 0.7s. Estimated remaining: 10m 5s. Rate: 212.3 symbols/min [2025-09-29T01:58:26.350784] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-29T01:58:26.421079] [INFO ] [MAIN ] BC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:26.425432] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:26.438218] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BC took 0.9s. Estimated remaining: 10m 5s. Rate: 212.5 symbols/min [2025-09-29T01:58:26.448019] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-29T01:58:26.446773] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T01:58:26.485417] [INFO ] [MAIN ] BCAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:26.500462] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BCAT took 0.6s. Estimated remaining: 10m 2s. Rate: 213.2 symbols/min [2025-09-29T01:58:26.505907] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-29T01:58:26.709237] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-29T01:58:26.787546] [INFO ] [MAIN ] BCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:26.796932] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCC took 0.6s. Estimated remaining: 10m 2s. Rate: 213.1 symbols/min [2025-09-29T01:58:26.827275] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:26.952936] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:26.995195] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T01:58:27.037171] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-29T01:58:27.128377] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:27.168158] [DEBUG] [LOCAL ] BCH: Loaded 30039 existing records from primary storage. [2025-09-29T01:58:27.170315] [INFO ] [MAIN ] BCH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:27.171248] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCH took 0.6s. Estimated remaining: 10m 3s. Rate: 212.8 symbols/min [2025-09-29T01:58:27.200563] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-29T01:58:27.243194] [INFO ] [MAIN ] BCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:27.270117] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 0.8s. Estimated remaining: 10m 1s. Rate: 213.4 symbols/min [2025-09-29T01:58:27.360243] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-29T01:58:27.378535] [INFO ] [MAIN ] BCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:27.402601] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCO took 0.6s. Estimated remaining: 9m 59s. Rate: 213.9 symbols/min [2025-09-29T01:58:27.513215] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:27.729195] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-29T01:58:27.759132] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:27.769335] [INFO ] [REMOTE ] BALY: Full fetch complete (17169 records). [2025-09-29T01:58:27.780761] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-29T01:58:27.901990] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:27.999973] [DEBUG] [LOCAL ] BCS: Loaded 54242 existing records from primary storage. [2025-09-29T01:58:28.050027] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-29T01:58:28.049082] [INFO ] [MAIN ] BCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:28.099929] [INFO ] [MAIN ] BCSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:28.119610] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCS took 0.9s. Estimated remaining: 10m 3s. Rate: 212.5 symbols/min [2025-09-29T01:58:28.124094] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 0.8s. Estimated remaining: 10m 0s. Rate: 213.4 symbols/min [2025-09-29T01:58:28.137065] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T01:58:28.150432] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:58:28.156865] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:58:28.178722] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-29T01:58:28.213996] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-29T01:58:28.219256] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-29T01:58:28.237568] [INFO ] [MAIN ] BCX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:28.244762] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-29T01:58:28.257411] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCX took 0.8s. Estimated remaining: 9m 58s. Rate: 213.9 symbols/min [2025-09-29T01:58:28.298946] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-29T01:58:28.312861] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BALY took 8.4s. Estimated remaining: 9m 56s. Rate: 214.6 symbols/min [2025-09-29T01:58:28.333626] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:28.364444] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-29T01:58:28.364909] [INFO ] [MAIN ] BDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:28.365033] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 0.2s. Estimated remaining: 9m 54s. Rate: 215.3 symbols/min [2025-09-29T01:58:28.911842] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.021296] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.059293] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.133493] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.182506] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-29T01:58:29.184961] [INFO ] [MAIN ] BDJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:29.186440] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 0.8s. Estimated remaining: 9m 58s. Rate: 213.6 symbols/min [2025-09-29T01:58:29.264366] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-29T01:58:29.312120] [INFO ] [MAIN ] BE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:29.343149] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BE took 1.0s. Estimated remaining: 9m 57s. Rate: 214.0 symbols/min [2025-09-29T01:58:29.416172] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-29T01:58:29.573311] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-29T01:58:29.573975] [INFO ] [MAIN ] BDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:29.526389] [INFO ] [MAIN ] BDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:29.571949] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.575004] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDN took 1.2s. Estimated remaining: 9m 56s. Rate: 214.1 symbols/min [2025-09-29T01:58:29.587266] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-29T01:58:29.581434] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDX took 1.2s. Estimated remaining: 9m 54s. Rate: 215.0 symbols/min [2025-09-29T01:58:29.650223] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-29T01:58:29.746614] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.805877] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-29T01:58:29.863939] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-29T01:58:29.897291] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-29T01:58:29.909339] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-29T01:58:30.019460] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:30.184432] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:30.366178] [DEBUG] [LOCAL ] BEKE: Loaded 54025 existing records from primary storage. [2025-09-29T01:58:30.410528] [INFO ] [MAIN ] BEKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:30.423770] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEKE took 1.1s. Estimated remaining: 9m 58s. Rate: 213.2 symbols/min [2025-09-29T01:58:30.635177] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-29T01:58:30.707678] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:30.703321] [INFO ] [MAIN ] BEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:30.708278] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-29T01:58:30.661807] [DEBUG] [LOCAL ] BEP: Loaded 39244 existing records from primary storage. [2025-09-29T01:58:30.708834] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEN took 1.1s. Estimated remaining: 9m 58s. Rate: 213.2 symbols/min [2025-09-29T01:58:30.720296] [INFO ] [MAIN ] BEP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:30.758859] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 1.1s. Estimated remaining: 9m 56s. Rate: 213.9 symbols/min [2025-09-29T01:58:30.898695] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.097783] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.112576] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T01:58:31.144967] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-29T01:58:31.179526] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.184577] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-29T01:58:31.184985] [INFO ] [MAIN ] BEPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:31.185620] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEPH took 0.5s. Estimated remaining: 9m 57s. Rate: 213.5 symbols/min [2025-09-29T01:58:31.270578] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-29T01:58:31.319596] [INFO ] [MAIN ] BEPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:31.343869] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPI took 0.5s. Estimated remaining: 9m 55s. Rate: 213.9 symbols/min [2025-09-29T01:58:31.346272] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-29T01:58:31.415417] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T01:58:31.439471] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-29T01:58:31.397206] [INFO ] [MAIN ] BEPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:31.495352] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.500939] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPC took 1.0s. Estimated remaining: 9m 54s. Rate: 214.2 symbols/min [2025-09-29T01:58:31.619670] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-29T01:58:31.704136] [INFO ] [MAIN ] BEPJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:31.714129] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.727313] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T01:58:31.725085] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPJ took 0.5s. Estimated remaining: 9m 53s. Rate: 214.4 symbols/min [2025-09-29T01:58:31.747004] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-29T01:58:31.936782] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.045309] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.057851] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-29T01:58:32.058851] [INFO ] [MAIN ] BFAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.058960] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BFAM took 0.7s. Estimated remaining: 9m 53s. Rate: 214.2 symbols/min [2025-09-29T01:58:32.101472] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T01:58:32.138869] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-29T01:58:32.254740] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-29T01:58:32.268372] [INFO ] [MAIN ] BFK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.292334] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.307369] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFK took 0.6s. Estimated remaining: 9m 53s. Rate: 214.3 symbols/min [2025-09-29T01:58:32.334764] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-29T01:58:32.372612] [INFO ] [MAIN ] BFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.395788] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFH took 0.9s. Estimated remaining: 9m 51s. Rate: 214.9 symbols/min [2025-09-29T01:58:32.579394] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-29T01:58:32.622575] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.624483] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-29T01:58:32.679449] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-29T01:58:32.704310] [INFO ] [MAIN ] BFLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.750873] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFLY took 0.7s. Estimated remaining: 9m 51s. Rate: 214.7 symbols/min [2025-09-29T01:58:32.774138] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.767700] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-29T01:58:32.819681] [INFO ] [MAIN ] BFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.825071] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFS took 0.5s. Estimated remaining: 9m 49s. Rate: 215.3 symbols/min [2025-09-29T01:58:32.901631] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T01:58:32.949422] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-29T01:58:33.077069] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-29T01:58:33.099141] [INFO ] [MAIN ] BFZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:33.104450] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFZ took 0.7s. Estimated remaining: 9m 49s. Rate: 215.3 symbols/min [2025-09-29T01:58:33.294082] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T01:58:33.312414] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-29T01:58:33.310340] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.348205] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.448860] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.459451] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-29T01:58:33.460018] [INFO ] [MAIN ] BGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:33.460455] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BGB took 0.6s. Estimated remaining: 9m 49s. Rate: 215.1 symbols/min [2025-09-29T01:58:33.557025] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-29T01:58:33.607444] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-29T01:58:33.600951] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-29T01:58:33.620556] [INFO ] [MAIN ] BGH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:33.665513] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 0.5s. Estimated remaining: 9m 49s. Rate: 215.3 symbols/min [2025-09-29T01:58:33.702853] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.822365] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-29T01:58:33.804118] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-29T01:58:33.837994] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-29T01:58:33.869863] [INFO ] [MAIN ] BG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:33.893404] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BG took 1.1s. Estimated remaining: 9m 48s. Rate: 215.4 symbols/min [2025-09-29T01:58:33.932000] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.967090] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-29T01:58:33.996582] [INFO ] [MAIN ] BGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:34.015548] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGR took 0.6s. Estimated remaining: 9m 46s. Rate: 215.9 symbols/min [2025-09-29T01:58:34.233032] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:34.238363] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-29T01:58:34.259210] [INFO ] [REMOTE ] BEDU: Full fetch complete (1429 records). [2025-09-29T01:58:34.293340] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-29T01:58:34.401711] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:34.402997] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-29T01:58:34.403414] [INFO ] [MAIN ] BGSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:34.419286] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGSF took 0.5s. Estimated remaining: 9m 47s. Rate: 215.5 symbols/min [2025-09-29T01:58:34.512922] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-29T01:58:34.585338] [INFO ] [MAIN ] BGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:34.607279] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGS took 0.9s. Estimated remaining: 9m 46s. Rate: 215.8 symbols/min [2025-09-29T01:58:34.730547] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-29T01:58:34.789940] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-29T01:58:34.871371] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:58:34.871620] [INFO ] [MAIN ] BGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:34.934845] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:34.902915] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:58:34.940236] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-29T01:58:34.945521] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGT took 0.9s. Estimated remaining: 9m 46s. Rate: 215.6 symbols/min [2025-09-29T01:58:34.945826] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-29T01:58:34.968944] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-29T01:58:34.996048] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-29T01:58:35.054411] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BEDU took 5.9s. Estimated remaining: 9m 45s. Rate: 216.1 symbols/min [2025-09-29T01:58:35.147159] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-29T01:58:35.200558] [INFO ] [MAIN ] BGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:35.237764] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGX took 0.8s. Estimated remaining: 9m 44s. Rate: 216.4 symbols/min [2025-09-29T01:58:35.217097] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:35.396972] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:35.586605] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:35.585016] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-29T01:58:35.642061] [INFO ] [MAIN ] BGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:35.666449] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 1.0s. Estimated remaining: 9m 45s. Rate: 216.0 symbols/min [2025-09-29T01:58:35.661305] [DEBUG] [LOCAL ] BH: Loaded 15938 existing records from primary storage. [2025-09-29T01:58:35.667287] [INFO ] [MAIN ] BH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:35.665794] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:35.679470] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 0.7s. Estimated remaining: 9m 42s. Rate: 216.7 symbols/min [2025-09-29T01:58:36.073396] [DEBUG] [LOCAL ] BHE: Loaded 25353 existing records from primary storage. [2025-09-29T01:58:36.103169] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-29T01:58:36.129994] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:36.130612] [INFO ] [MAIN ] BHE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:36.131142] [INFO ] [MAIN ] BHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:36.124900] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:36.131997] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHE took 0.9s. Estimated remaining: 9m 43s. Rate: 216.2 symbols/min [2025-09-29T01:58:36.138678] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHC took 1.1s. Estimated remaining: 9m 41s. Rate: 217.0 symbols/min [2025-09-29T01:58:36.523191] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-29T01:58:36.568988] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:36.554109] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:36.569370] [INFO ] [MAIN ] BHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:36.570072] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-29T01:58:36.570221] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 0.9s. Estimated remaining: 9m 42s. Rate: 216.5 symbols/min [2025-09-29T01:58:36.570421] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-29T01:58:36.576436] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-29T01:58:36.585621] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-29T01:58:36.596117] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-29T01:58:36.624116] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-29T01:58:36.644591] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-29T01:58:36.726020] [INFO ] [MAIN ] BHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:36.788023] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHP took 1.1s. Estimated remaining: 9m 41s. Rate: 216.7 symbols/min [2025-09-29T01:58:36.879756] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-29T01:58:37.009089] [INFO ] [MAIN ] BHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:37.087919] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHR took 1.0s. Estimated remaining: 9m 41s. Rate: 216.7 symbols/min [2025-09-29T01:58:37.124757] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:37.448985] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:37.621869] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:37.657794] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:37.658799] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-29T01:58:37.687066] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-29T01:58:37.687902] [INFO ] [MAIN ] BHVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:37.688688] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHVN took 1.1s. Estimated remaining: 9m 43s. Rate: 215.7 symbols/min [2025-09-29T01:58:37.880235] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-29T01:58:37.913246] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-29T01:58:37.903012] [INFO ] [MAIN ] BIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:37.916469] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T01:58:37.939236] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:37.942130] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BIO took 0.8s. Estimated remaining: 9m 43s. Rate: 215.8 symbols/min [2025-09-29T01:58:37.941265] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-29T01:58:37.941583] [INFO ] [MAIN ] BILL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:37.957089] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BILL took 1.1s. Estimated remaining: 9m 40s. Rate: 216.5 symbols/min [2025-09-29T01:58:38.200520] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T01:58:38.234302] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-29T01:58:38.327004] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:38.359844] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-29T01:58:38.379407] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:38.380245] [INFO ] [MAIN ] BIP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:38.380740] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIP took 0.7s. Estimated remaining: 9m 41s. Rate: 216.1 symbols/min [2025-09-29T01:58:38.385531] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-29T01:58:38.386127] [INFO ] [MAIN ] BIPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:38.386230] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPH took 0.4s. Estimated remaining: 9m 39s. Rate: 216.9 symbols/min [2025-09-29T01:58:38.429147] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-29T01:58:38.429545] [INFO ] [MAIN ] BIPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:38.429677] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIPC took 0.5s. Estimated remaining: 9m 37s. Rate: 217.6 symbols/min [2025-09-29T01:58:38.523098] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T01:58:38.524161] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-29T01:58:38.721463] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T01:58:38.722532] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-29T01:58:38.916981] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.19 seconds). [2025-09-29T01:58:38.918105] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-29T01:58:39.183746] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-29T01:58:39.185069] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-29T01:58:39.383070] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T01:58:39.384104] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-29T01:58:39.591780] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T01:58:39.592924] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-29T01:58:39.795295] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T01:58:39.796535] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-29T01:58:40.068843] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-29T01:58:40.070030] [INFO ] [REMOTE ] BHV: Full fetch complete (1368 records). [2025-09-29T01:58:40.070128] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-29T01:58:40.287318] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T01:58:40.287529] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:58:40.287622] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:58:40.287749] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-29T01:58:40.287894] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-29T01:58:40.287972] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-29T01:58:40.288093] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-29T01:58:40.288197] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BHV took 4.1s. Estimated remaining: 9m 49s. Rate: 213.2 symbols/min [2025-09-29T01:58:41.009148] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.083618] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.126309] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.132130] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.140486] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-29T01:58:41.141335] [INFO ] [MAIN ] BIPJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:41.143073] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 0.9s. Estimated remaining: 9m 52s. Rate: 211.6 symbols/min [2025-09-29T01:58:41.188593] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-29T01:58:41.214007] [INFO ] [MAIN ] BIPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:41.229962] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 0.9s. Estimated remaining: 9m 51s. Rate: 212.2 symbols/min [2025-09-29T01:58:41.370157] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-29T01:58:41.440088] [INFO ] [MAIN ] BIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:41.466915] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 1.2s. Estimated remaining: 9m 50s. Rate: 212.3 symbols/min [2025-09-29T01:58:41.497418] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.664449] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-29T01:58:41.730454] [INFO ] [MAIN ] BIRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:41.777813] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.801331] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 1.5s. Estimated remaining: 9m 50s. Rate: 212.2 symbols/min [2025-09-29T01:58:41.901855] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.049516] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-29T01:58:42.083745] [INFO ] [MAIN ] BJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:42.084340] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 0.9s. Estimated remaining: 9m 50s. Rate: 212.2 symbols/min [2025-09-29T01:58:42.180971] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.276534] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-29T01:58:42.300609] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-29T01:58:42.301764] [INFO ] [MAIN ] BK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:42.318170] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 1.0s. Estimated remaining: 9m 49s. Rate: 212.3 symbols/min [2025-09-29T01:58:42.301885] [INFO ] [MAIN ] BKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:42.319061] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKD took 0.8s. Estimated remaining: 9m 47s. Rate: 213.0 symbols/min [2025-09-29T01:58:42.511697] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.638104] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-29T01:58:42.679460] [INFO ] [MAIN ] BKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:42.704694] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 0.9s. Estimated remaining: 9m 47s. Rate: 212.8 symbols/min [2025-09-29T01:58:42.846383] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.873175] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.987888] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-29T01:58:43.037893] [INFO ] [MAIN ] BKN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.065217] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:43.067295] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-29T01:58:43.067819] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKN took 0.7s. Estimated remaining: 9m 48s. Rate: 212.5 symbols/min [2025-09-29T01:58:43.074174] [INFO ] [MAIN ] BKH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.080394] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKH took 1.0s. Estimated remaining: 9m 46s. Rate: 213.2 symbols/min [2025-09-29T01:58:43.210991] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-29T01:58:43.267016] [INFO ] [MAIN ] BKKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.308523] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 1.0s. Estimated remaining: 9m 45s. Rate: 213.4 symbols/min [2025-09-29T01:58:43.562105] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:43.590775] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:43.624377] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-29T01:58:43.683463] [INFO ] [MAIN ] BKSY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.704714] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKSY took 1.0s. Estimated remaining: 9m 45s. Rate: 213.1 symbols/min [2025-09-29T01:58:43.710969] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:43.749145] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-29T01:58:43.814161] [INFO ] [MAIN ] BKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.837621] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKT took 0.8s. Estimated remaining: 9m 44s. Rate: 213.5 symbols/min [2025-09-29T01:58:43.993551] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:44.026743] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-29T01:58:44.065793] [INFO ] [MAIN ] BKU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.067214] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-29T01:58:44.066425] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKU took 1.0s. Estimated remaining: 9m 43s. Rate: 213.6 symbols/min [2025-09-29T01:58:44.084566] [INFO ] [MAIN ] BKV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.123606] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 0.8s. Estimated remaining: 9m 42s. Rate: 214.2 symbols/min [2025-09-29T01:58:44.217730] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:44.384749] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-29T01:58:44.435549] [INFO ] [MAIN ] BLCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.538532] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:44.539501] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 0.8s. Estimated remaining: 9m 42s. Rate: 213.8 symbols/min [2025-09-29T01:58:44.574380] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-29T01:58:44.608475] [INFO ] [MAIN ] BLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.619406] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:44.619689] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLD took 0.8s. Estimated remaining: 9m 41s. Rate: 214.3 symbols/min [2025-09-29T01:58:44.838387] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-29T01:58:44.854900] [INFO ] [MAIN ] BLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.910499] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 0.8s. Estimated remaining: 9m 40s. Rate: 214.3 symbols/min [2025-09-29T01:58:44.962501] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:45.148091] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:45.149899] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-29T01:58:45.168422] [INFO ] [MAIN ] BLDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:45.169144] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLDR took 1.1s. Estimated remaining: 9m 40s. Rate: 214.4 symbols/min [2025-09-29T01:58:45.350426] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:45.381613] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-29T01:58:45.392884] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-29T01:58:45.393162] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-29T01:58:45.437023] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-29T01:58:45.410238] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-29T01:58:45.473217] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-29T01:58:45.476083] [INFO ] [MAIN ] BLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:45.490173] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 0.9s. Estimated remaining: 9m 40s. Rate: 214.3 symbols/min [2025-09-29T01:58:45.489843] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:45.490302] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-29T01:58:45.700754] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-29T01:58:45.732089] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-29T01:58:45.756697] [INFO ] [MAIN ] BLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:45.751333] [INFO ] [MAIN ] BLND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:45.762131] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLW took 0.6s. Estimated remaining: 9m 40s. Rate: 214.3 symbols/min [2025-09-29T01:58:45.783618] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLND took 1.1s. Estimated remaining: 9m 38s. Rate: 214.9 symbols/min [2025-09-29T01:58:46.025687] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:46.349736] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:46.539439] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-29T01:58:46.565926] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:46.561666] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:46.567474] [INFO ] [MAIN ] BLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:46.567635] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLX took 1.1s. Estimated remaining: 9m 41s. Rate: 213.7 symbols/min [2025-09-29T01:58:46.567231] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-29T01:58:46.712913] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-29T01:58:46.733695] [INFO ] [MAIN ] BME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:46.745356] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-29T01:58:46.756843] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:46.745528] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BME took 0.9s. Estimated remaining: 9m 40s. Rate: 213.9 symbols/min [2025-09-29T01:58:46.756045] [INFO ] [MAIN ] BMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:46.805604] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-29T01:58:46.815023] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:46.821279] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:46.832504] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-09-29T01:58:46.832977] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:46.832625] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 1.1s. Estimated remaining: 9m 38s. Rate: 214.4 symbols/min [2025-09-29T01:58:46.844053] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-29T01:58:46.920086] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-29T01:58:47.029384] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-29T01:58:47.137755] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:47.138243] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-29T01:58:47.171051] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BLSH took 2.2s. Estimated remaining: 9m 38s. Rate: 214.3 symbols/min [2025-09-29T01:58:47.171784] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-29T01:58:47.213912] [INFO ] [MAIN ] BMEZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:47.255802] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:47.266874] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 0.7s. Estimated remaining: 9m 37s. Rate: 214.7 symbols/min [2025-09-29T01:58:47.452982] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-29T01:58:47.478241] [INFO ] [MAIN ] BMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:47.484092] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 0.6s. Estimated remaining: 9m 36s. Rate: 214.9 symbols/min [2025-09-29T01:58:47.490468] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-29T01:58:47.559764] [INFO ] [MAIN ] BMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:47.672503] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:47.626936] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMI took 0.8s. Estimated remaining: 9m 35s. Rate: 215.2 symbols/min [2025-09-29T01:58:47.779221] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:47.974378] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:48.069310] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:48.102814] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-29T01:58:48.103408] [INFO ] [MAIN ] BMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.104612] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 0.9s. Estimated remaining: 9m 36s. Rate: 214.7 symbols/min [2025-09-29T01:58:48.260373] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-29T01:58:48.287687] [INFO ] [MAIN ] BMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.319285] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 1.1s. Estimated remaining: 9m 35s. Rate: 214.9 symbols/min [2025-09-29T01:58:48.423678] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:48.420080] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-29T01:58:48.495360] [INFO ] [MAIN ] BNED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.501871] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-29T01:58:48.527514] [INFO ] [MAIN ] BN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.525122] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BNED took 0.8s. Estimated remaining: 9m 34s. Rate: 215.1 symbols/min [2025-09-29T01:58:48.580633] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-29T01:58:48.615842] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:48.613943] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 1.0s. Estimated remaining: 9m 33s. Rate: 215.5 symbols/min [2025-09-29T01:58:48.648896] [INFO ] [MAIN ] BNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.703800] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNH took 0.6s. Estimated remaining: 9m 31s. Rate: 216.0 symbols/min [2025-09-29T01:58:48.794308] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-29T01:58:48.840729] [INFO ] [MAIN ] BNJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.873088] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 0.5s. Estimated remaining: 9m 30s. Rate: 216.3 symbols/min [2025-09-29T01:58:49.210573] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.267026] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.355600] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.475426] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.479050] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-29T01:58:49.480962] [INFO ] [MAIN ] BNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.481107] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNT took 0.7s. Estimated remaining: 9m 32s. Rate: 215.5 symbols/min [2025-09-29T01:58:49.630470] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-29T01:58:49.647261] [INFO ] [MAIN ] BNY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.715200] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNY took 0.8s. Estimated remaining: 9m 32s. Rate: 215.6 symbols/min [2025-09-29T01:58:49.714343] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.748806] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-29T01:58:49.747505] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-29T01:58:49.749351] [INFO ] [MAIN ] BNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.749492] [INFO ] [MAIN ] BNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.750053] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNS took 1.1s. Estimated remaining: 9m 30s. Rate: 216.2 symbols/min [2025-09-29T01:58:49.750801] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNL took 1.1s. Estimated remaining: 9m 28s. Rate: 216.8 symbols/min [2025-09-29T01:58:49.768459] [DEBUG] [LOCAL ] BOC: Loaded 18626 existing records from primary storage. [2025-09-29T01:58:49.768764] [INFO ] [MAIN ] BOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.768864] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 0.3s. Estimated remaining: 9m 26s. Rate: 217.5 symbols/min [2025-09-29T01:58:50.331106] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:50.426528] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:50.536839] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:50.562792] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:50.601728] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-29T01:58:50.630468] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-29T01:58:50.631118] [INFO ] [MAIN ] BOND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:50.631242] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOND took 0.9s. Estimated remaining: 9m 29s. Rate: 216.0 symbols/min [2025-09-29T01:58:50.631393] [INFO ] [MAIN ] BOE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:50.637108] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOE took 0.9s. Estimated remaining: 9m 27s. Rate: 216.7 symbols/min [2025-09-29T01:58:50.843730] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-29T01:58:50.912952] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-29T01:58:50.929363] [INFO ] [MAIN ] BOH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:50.929559] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOH took 1.2s. Estimated remaining: 9m 27s. Rate: 216.7 symbols/min [2025-09-29T01:58:50.942554] [INFO ] [MAIN ] BOOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:50.991256] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 1.2s. Estimated remaining: 9m 26s. Rate: 217.2 symbols/min [2025-09-29T01:58:51.061155] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.229589] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.426344] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.455934] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-29T01:58:51.500266] [INFO ] [MAIN ] BOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:51.515964] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 0.9s. Estimated remaining: 9m 27s. Rate: 216.6 symbols/min [2025-09-29T01:58:51.550713] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.639618] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-29T01:58:51.661299] [INFO ] [MAIN ] BORR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:51.673129] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 1.0s. Estimated remaining: 9m 26s. Rate: 216.9 symbols/min [2025-09-29T01:58:51.926471] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.942848] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-29T01:58:51.955225] [INFO ] [MAIN ] BOX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.004320] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 1.1s. Estimated remaining: 9m 26s. Rate: 216.7 symbols/min [2025-09-29T01:58:52.034871] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.088019] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-29T01:58:52.120138] [INFO ] [MAIN ] BP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.120775] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BP took 1.1s. Estimated remaining: 9m 25s. Rate: 217.1 symbols/min [2025-09-29T01:58:52.398125] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-29T01:58:52.400185] [INFO ] [MAIN ] BR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.406041] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 0.9s. Estimated remaining: 9m 24s. Rate: 217.1 symbols/min [2025-09-29T01:58:52.400001] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.579110] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.614553] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-29T01:58:52.632384] [INFO ] [MAIN ] BRBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.680072] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRBR took 1.0s. Estimated remaining: 9m 24s. Rate: 217.1 symbols/min [2025-09-29T01:58:52.702474] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.783830] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-29T01:58:52.836341] [INFO ] [MAIN ] BRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.867119] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRC took 0.8s. Estimated remaining: 9m 23s. Rate: 217.3 symbols/min [2025-09-29T01:58:52.932620] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.946775] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-29T01:58:52.978499] [INFO ] [MAIN ] BRCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.995124] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRCC took 0.8s. Estimated remaining: 9m 22s. Rate: 217.7 symbols/min [2025-09-29T01:58:53.215464] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-29T01:58:53.268593] [INFO ] [MAIN ] BRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:53.387012] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRO took 1.0s. Estimated remaining: 9m 22s. Rate: 217.4 symbols/min [2025-09-29T01:58:53.436879] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:53.459221] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:53.460935] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-29T01:58:53.515007] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-29T01:58:53.515680] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-29T01:58:53.515790] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-29T01:58:53.515879] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-29T01:58:53.522936] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-29T01:58:53.584160] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-29T01:58:53.665562] [INFO ] [MAIN ] BROS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:53.783399] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BROS took 1.1s. Estimated remaining: 9m 23s. Rate: 217.1 symbols/min [2025-09-29T01:58:53.931444] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-29T01:58:53.932250] [INFO ] [MAIN ] BRSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:53.932478] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 0.9s. Estimated remaining: 9m 22s. Rate: 217.4 symbols/min [2025-09-29T01:58:54.285427] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:54.614634] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-29T01:58:54.685127] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:54.725459] [INFO ] [MAIN ] BRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:54.849691] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 1.4s. Estimated remaining: 9m 25s. Rate: 215.9 symbols/min [2025-09-29T01:58:54.864839] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:54.887883] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:54.900401] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-29T01:58:55.022559] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-29T01:58:55.023117] [INFO ] [MAIN ] BRW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.029356] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRW took 1.2s. Estimated remaining: 9m 25s. Rate: 216.1 symbols/min [2025-09-29T01:58:55.089445] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:55.121743] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-29T01:58:55.121030] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:55.144161] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:55.191103] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-09-29T01:58:55.233959] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:55.238451] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-29T01:58:55.311005] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-29T01:58:55.281099] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-29T01:58:55.329720] [INFO ] [MAIN ] BRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.313381] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-29T01:58:55.334261] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:55.334781] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRX took 1.4s. Estimated remaining: 9m 24s. Rate: 216.1 symbols/min [2025-09-29T01:58:55.341556] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-29T01:58:55.370737] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BRSL took 2.4s. Estimated remaining: 9m 23s. Rate: 216.6 symbols/min [2025-09-29T01:58:55.629996] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-29T01:58:55.680869] [INFO ] [MAIN ] BSAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.680496] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:55.681157] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSAC took 0.8s. Estimated remaining: 9m 23s. Rate: 216.6 symbols/min [2025-09-29T01:58:55.842486] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-29T01:58:55.879239] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:55.877330] [DEBUG] [LOCAL ] BSL: Loaded 8196 existing records from primary storage. [2025-09-29T01:58:55.884673] [INFO ] [MAIN ] BSBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.895850] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSBR took 0.8s. Estimated remaining: 9m 22s. Rate: 216.7 symbols/min [2025-09-29T01:58:55.911995] [INFO ] [MAIN ] BSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.923123] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSL took 0.6s. Estimated remaining: 9m 20s. Rate: 217.3 symbols/min [2025-09-29T01:58:56.159908] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.421312] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.396375] [DEBUG] [LOCAL ] BSM: Loaded 32809 existing records from primary storage. [2025-09-29T01:58:56.434828] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-29T01:58:56.457299] [INFO ] [MAIN ] BSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:56.456721] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.458221] [INFO ] [MAIN ] BST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:56.458480] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSM took 1.1s. Estimated remaining: 9m 22s. Rate: 216.7 symbols/min [2025-09-29T01:58:56.459214] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BST took 0.8s. Estimated remaining: 9m 20s. Rate: 217.3 symbols/min [2025-09-29T01:58:56.784396] [DEBUG] [LOCAL ] BSTZ: Loaded 25188 existing records from primary storage. [2025-09-29T01:58:56.873367] [INFO ] [MAIN ] BSTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:56.929875] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSTZ took 1.0s. Estimated remaining: 9m 21s. Rate: 216.9 symbols/min [2025-09-29T01:58:56.927824] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.908301] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.956602] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-29T01:58:57.007298] [INFO ] [MAIN ] BSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.038594] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSX took 1.1s. Estimated remaining: 9m 19s. Rate: 217.3 symbols/min [2025-09-29T01:58:57.088749] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-29T01:58:57.122108] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-29T01:58:57.158680] [INFO ] [MAIN ] BTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.191825] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BTA took 0.7s. Estimated remaining: 9m 18s. Rate: 217.5 symbols/min [2025-09-29T01:58:57.193095] [INFO ] [MAIN ] BTCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.263213] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 0.8s. Estimated remaining: 9m 17s. Rate: 218.0 symbols/min [2025-09-29T01:58:57.253082] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:57.730392] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:57.754516] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:57.794177] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:57.828799] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-29T01:58:57.834288] [INFO ] [MAIN ] BTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.823969] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-29T01:58:57.834498] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 0.6s. Estimated remaining: 9m 18s. Rate: 217.3 symbols/min [2025-09-29T01:58:57.835161] [INFO ] [MAIN ] BTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.858162] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 0.9s. Estimated remaining: 9m 16s. Rate: 217.9 symbols/min [2025-09-29T01:58:57.967739] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-29T01:58:57.995358] [INFO ] [MAIN ] BTT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:58.000789] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTT took 0.7s. Estimated remaining: 9m 15s. Rate: 218.2 symbols/min [2025-09-29T01:58:58.376679] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:58.406219] [DEBUG] [LOCAL ] BTI: Loaded 54335 existing records from primary storage. [2025-09-29T01:58:58.432532] [INFO ] [MAIN ] BTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:58.433182] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTI took 1.4s. Estimated remaining: 9m 16s. Rate: 217.8 symbols/min [2025-09-29T01:58:58.398878] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:58.514433] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:58.526012] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-29T01:58:58.562201] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-29T01:58:58.584795] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-29T01:58:58.597012] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-29T01:58:58.603117] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-29T01:58:58.618900] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-29T01:58:58.718551] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:58.833018] [DEBUG] [LOCAL ] BTZ: Loaded 23002 existing records from primary storage. [2025-09-29T01:58:58.859445] [INFO ] [MAIN ] BTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:58.886561] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTZ took 0.9s. Estimated remaining: 9m 17s. Rate: 217.4 symbols/min [2025-09-29T01:58:58.908706] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-29T01:58:58.946304] [INFO ] [MAIN ] BTU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:59.002099] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTU took 1.2s. Estimated remaining: 9m 16s. Rate: 217.8 symbols/min [2025-09-29T01:58:59.407337] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:59.556401] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:59.487270] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-29T01:58:59.579383] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:59.582023] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-29T01:58:59.583118] [INFO ] [MAIN ] BUD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:59.583803] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BUD took 1.1s. Estimated remaining: 9m 17s. Rate: 217.1 symbols/min [2025-09-29T01:58:59.672838] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-29T01:58:59.691967] [INFO ] [MAIN ] BUI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:59.703572] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUI took 0.8s. Estimated remaining: 9m 16s. Rate: 217.5 symbols/min [2025-09-29T01:58:59.748049] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:59.797746] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-29T01:58:59.838777] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:59.910869] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:59.900935] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-09-29T01:58:59.956495] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:59.993332] [DEBUG] [LOCAL ] BUR: Loaded 45700 existing records from primary storage. [2025-09-29T01:59:00.015277] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-29T01:59:00.023896] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-29T01:59:00.028700] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-29T01:59:00.015935] [INFO ] [MAIN ] BUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:00.048456] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:00.049185] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUR took 1.0s. Estimated remaining: 9m 16s. Rate: 217.3 symbols/min [2025-09-29T01:59:00.049528] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-29T01:59:00.050133] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BTX took 2.2s. Estimated remaining: 9m 14s. Rate: 217.9 symbols/min [2025-09-29T01:59:00.081437] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-29T01:59:00.081798] [INFO ] [MAIN ] BUXX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:00.082081] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUXX took 0.4s. Estimated remaining: 9m 13s. Rate: 218.5 symbols/min [2025-09-29T01:59:00.103264] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-29T01:59:00.103764] [INFO ] [MAIN ] BURL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:00.104920] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 0.5s. Estimated remaining: 9m 11s. Rate: 219.0 symbols/min [2025-09-29T01:59:00.801202] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:00.883743] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:00.931418] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:00.933163] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:01.031051] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-29T01:59:01.033310] [INFO ] [MAIN ] BV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:01.048180] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 0.9s. Estimated remaining: 9m 14s. Rate: 217.5 symbols/min [2025-09-29T01:59:01.095878] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-29T01:59:01.088881] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-29T01:59:01.101981] [INFO ] [MAIN ] BVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:01.113044] [DEBUG] [LOCAL ] BWA: Loaded 52976 existing records from primary storage. [2025-09-29T01:59:01.102088] [INFO ] [MAIN ] BW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:01.151242] [INFO ] [MAIN ] BWA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:01.126803] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BVN took 1.0s. Estimated remaining: 9m 13s. Rate: 218.0 symbols/min [2025-09-29T01:59:01.189200] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BW took 1.1s. Estimated remaining: 9m 12s. Rate: 218.4 symbols/min [2025-09-29T01:59:01.268193] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 1.1s. Estimated remaining: 9m 10s. Rate: 218.9 symbols/min [2025-09-29T01:59:01.628119] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:01.862529] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:01.906193] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:01.935169] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-29T01:59:02.002116] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:02.004890] [INFO ] [MAIN ] BWG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.005819] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWG took 0.9s. Estimated remaining: 9m 12s. Rate: 217.9 symbols/min [2025-09-29T01:59:02.024540] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-29T01:59:02.058442] [INFO ] [MAIN ] BWMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.081179] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWMX took 0.9s. Estimated remaining: 9m 11s. Rate: 218.3 symbols/min [2025-09-29T01:59:02.081532] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-29T01:59:02.128560] [INFO ] [MAIN ] BWNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.213330] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWNB took 0.9s. Estimated remaining: 9m 10s. Rate: 218.6 symbols/min [2025-09-29T01:59:02.396570] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-29T01:59:02.411796] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:02.456633] [INFO ] [MAIN ] BWLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.513064] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 1.3s. Estimated remaining: 9m 10s. Rate: 218.5 symbols/min [2025-09-29T01:59:02.618289] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:02.671975] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-29T01:59:02.708523] [INFO ] [MAIN ] BWSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.715239] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 0.7s. Estimated remaining: 9m 9s. Rate: 218.7 symbols/min [2025-09-29T01:59:03.033390] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.041811] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.191900] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.200468] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-29T01:59:03.201503] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-29T01:59:03.202103] [INFO ] [MAIN ] BXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:03.201705] [INFO ] [MAIN ] BWXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:03.202314] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BXC took 0.6s. Estimated remaining: 9m 10s. Rate: 218.2 symbols/min [2025-09-29T01:59:03.208071] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 1.1s. Estimated remaining: 9m 8s. Rate: 218.8 symbols/min [2025-09-29T01:59:03.578312] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-29T01:59:03.604142] [INFO ] [MAIN ] BX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:03.641682] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 1.4s. Estimated remaining: 9m 9s. Rate: 218.5 symbols/min [2025-09-29T01:59:03.651533] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.787146] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.820969] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-29T01:59:03.840415] [INFO ] [MAIN ] BXMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:03.855236] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMT took 1.1s. Estimated remaining: 9m 8s. Rate: 218.6 symbols/min [2025-09-29T01:59:03.993126] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:04.091440] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-29T01:59:04.103170] [INFO ] [MAIN ] BXMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:04.117691] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 0.9s. Estimated remaining: 9m 8s. Rate: 218.6 symbols/min [2025-09-29T01:59:04.219779] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:04.269750] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-29T01:59:04.287179] [INFO ] [MAIN ] BXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:04.298753] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXP took 1.1s. Estimated remaining: 9m 7s. Rate: 218.8 symbols/min [2025-09-29T01:59:04.564159] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-29T01:59:04.549772] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:04.569487] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-29T01:59:04.569733] [INFO ] [MAIN ] BXSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:04.571050] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXSL took 0.9s. Estimated remaining: 9m 7s. Rate: 218.8 symbols/min [2025-09-29T01:59:04.594481] [INFO ] [MAIN ] BY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:04.615706] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BY took 0.8s. Estimated remaining: 9m 5s. Rate: 219.3 symbols/min [2025-09-29T01:59:04.797803] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.021081] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.021633] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-29T01:59:05.092110] [INFO ] [MAIN ] BYM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.098541] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BYM took 0.8s. Estimated remaining: 9m 6s. Rate: 218.9 symbols/min [2025-09-29T01:59:05.113929] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-29T01:59:05.123036] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.174743] [INFO ] [MAIN ] BYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.197352] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYD took 1.1s. Estimated remaining: 9m 5s. Rate: 219.3 symbols/min [2025-09-29T01:59:05.434366] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.466990] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-29T01:59:05.468086] [INFO ] [MAIN ] BZH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.473882] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 0.9s. Estimated remaining: 9m 5s. Rate: 219.3 symbols/min [2025-09-29T01:59:05.669154] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.775016] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-29T01:59:05.757509] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-29T01:59:05.775638] [INFO ] [MAIN ] CAAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.791616] [INFO ] [MAIN ] C: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.776204] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 0.7s. Estimated remaining: 9m 5s. Rate: 219.2 symbols/min [2025-09-29T01:59:05.812613] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. C took 1.1s. Estimated remaining: 9m 3s. Rate: 219.7 symbols/min [2025-09-29T01:59:05.903588] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-29T01:59:05.951913] [INFO ] [MAIN ] CABO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.918467] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.983455] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. CABO took 0.8s. Estimated remaining: 9m 2s. Rate: 219.9 symbols/min [2025-09-29T01:59:06.352372] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:06.416688] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-29T01:59:06.442500] [INFO ] [MAIN ] CACI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:06.455023] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 1.0s. Estimated remaining: 9m 3s. Rate: 219.5 symbols/min [2025-09-29T01:59:06.448451] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:06.605181] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:06.738021] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-29T01:59:06.785907] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:06.789323] [INFO ] [MAIN ] CAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:06.791025] [DEBUG] [LOCAL ] CADE: Loaded 49496 existing records from primary storage. [2025-09-29T01:59:06.792281] [INFO ] [MAIN ] CADE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:06.792436] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 0.7s. Estimated remaining: 9m 3s. Rate: 219.4 symbols/min [2025-09-29T01:59:06.809776] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CADE took 1.0s. Estimated remaining: 9m 2s. Rate: 219.9 symbols/min [2025-09-29T01:59:06.850799] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-29T01:59:06.856612] [INFO ] [MAIN ] CAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:06.875698] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAE took 0.9s. Estimated remaining: 9m 0s. Rate: 220.3 symbols/min [2025-09-29T01:59:07.366454] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:07.389518] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:07.392002] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-29T01:59:07.409180] [INFO ] [MAIN ] CAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:07.421006] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 1.0s. Estimated remaining: 9m 1s. Rate: 219.8 symbols/min [2025-09-29T01:59:07.525074] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:07.715318] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:07.732111] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-29T01:59:07.743924] [INFO ] [MAIN ] CAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:07.744099] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 0.9s. Estimated remaining: 9m 1s. Rate: 219.6 symbols/min [2025-09-29T01:59:07.913203] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-29T01:59:07.937863] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-29T01:59:07.948607] [INFO ] [MAIN ] CAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:07.968624] [INFO ] [MAIN ] CALX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:07.985852] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 1.2s. Estimated remaining: 9m 1s. Rate: 219.7 symbols/min [2025-09-29T01:59:08.017429] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.012733] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 1.1s. Estimated remaining: 8m 59s. Rate: 220.2 symbols/min [2025-09-29T01:59:08.073058] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-29T01:59:08.141555] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-29T01:59:08.152327] [INFO ] [MAIN ] CANG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:08.183740] [INFO ] [MAIN ] CAPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:08.209734] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CANG took 0.8s. Estimated remaining: 8m 59s. Rate: 220.4 symbols/min [2025-09-29T01:59:08.261260] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 0.5s. Estimated remaining: 8m 57s. Rate: 220.8 symbols/min [2025-09-29T01:59:08.519947] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.612609] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.842848] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.899766] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.944389] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-29T01:59:08.946846] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-29T01:59:08.948106] [INFO ] [MAIN ] CARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:08.948291] [INFO ] [MAIN ] CATO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:08.949118] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARR took 0.9s. Estimated remaining: 8m 59s. Rate: 220.0 symbols/min [2025-09-29T01:59:08.963831] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CATO took 0.7s. Estimated remaining: 8m 58s. Rate: 220.5 symbols/min [2025-09-29T01:59:09.095185] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-29T01:59:09.121849] [INFO ] [MAIN ] CARS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.188678] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CARS took 1.2s. Estimated remaining: 8m 57s. Rate: 220.6 symbols/min [2025-09-29T01:59:09.457908] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:09.480142] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-29T01:59:09.495579] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:09.517166] [INFO ] [MAIN ] CAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.533166] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 1.3s. Estimated remaining: 8m 57s. Rate: 220.5 symbols/min [2025-09-29T01:59:09.626841] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:09.661045] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-29T01:59:09.675394] [INFO ] [MAIN ] CBAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.675627] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 0.5s. Estimated remaining: 8m 56s. Rate: 220.7 symbols/min [2025-09-29T01:59:09.716045] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-29T01:59:09.714969] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-29T01:59:09.716587] [INFO ] [MAIN ] CAVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.717293] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 0.8s. Estimated remaining: 8m 55s. Rate: 221.2 symbols/min [2025-09-29T01:59:09.716722] [INFO ] [MAIN ] CB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.717869] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 0.7s. Estimated remaining: 8m 53s. Rate: 221.7 symbols/min [2025-09-29T01:59:10.371550] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.521257] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.571313] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.556106] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.574323] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-29T01:59:10.575900] [INFO ] [MAIN ] CBNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:10.576067] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBNA took 0.9s. Estimated remaining: 8m 56s. Rate: 220.5 symbols/min [2025-09-29T01:59:10.575408] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-29T01:59:10.581774] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-29T01:59:10.591035] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-29T01:59:10.607612] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-29T01:59:10.635680] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-29T01:59:10.642887] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-29T01:59:10.801602] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-29T01:59:10.898160] [INFO ] [MAIN ] CBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:10.933118] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.936469] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBL took 1.2s. Estimated remaining: 8m 56s. Rate: 220.4 symbols/min [2025-09-29T01:59:11.044870] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-29T01:59:11.161164] [INFO ] [MAIN ] CBRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:11.228521] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBRE took 1.5s. Estimated remaining: 8m 56s. Rate: 220.3 symbols/min [2025-09-29T01:59:11.391630] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-29T01:59:11.447094] [INFO ] [MAIN ] CBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:11.557280] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBT took 1.0s. Estimated remaining: 8m 56s. Rate: 220.2 symbols/min [2025-09-29T01:59:11.604162] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:11.657374] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:11.720070] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-29T01:59:11.794930] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:11.807092] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-29T01:59:11.829154] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-29T01:59:11.862259] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-29T01:59:11.863088] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-29T01:59:11.869361] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-29T01:59:11.881111] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-29T01:59:11.987419] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-29T01:59:11.995807] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:12.014971] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-29T01:59:12.061589] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:12.026681] [INFO ] [MAIN ] CBU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:12.090622] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-09-29T01:59:12.085281] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:12.082953] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBU took 1.1s. Estimated remaining: 8m 57s. Rate: 219.7 symbols/min [2025-09-29T01:59:12.095767] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:12.131425] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-29T01:59:12.182075] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-29T01:59:12.182385] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-29T01:59:12.199261] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-29T01:59:12.246302] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBO took 2.5s. Estimated remaining: 8m 56s. Rate: 219.9 symbols/min [2025-09-29T01:59:12.698023] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:12.755895] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-29T01:59:12.756707] [INFO ] [MAIN ] CBZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:12.776540] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBZ took 1.2s. Estimated remaining: 8m 57s. Rate: 219.4 symbols/min [2025-09-29T01:59:12.857717] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:12.901064] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-29T01:59:12.905292] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:13.087351] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:13.111750] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:13.113984] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-29T01:59:13.114320] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:13.114146] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-29T01:59:13.114610] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-29T01:59:13.138798] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-09-29T01:59:13.139625] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:13.139773] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-29T01:59:13.139949] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-29T01:59:13.139997] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-29T01:59:13.142625] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-29T01:59:13.142958] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-29T01:59:13.143627] [INFO ] [MAIN ] CC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:13.143746] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-29T01:59:13.144821] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CC took 1.0s. Estimated remaining: 8m 57s. Rate: 219.2 symbols/min [2025-09-29T01:59:13.144938] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-29T01:59:13.140329] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-29T01:59:13.150771] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBX took 1.9s. Estimated remaining: 8m 56s. Rate: 219.8 symbols/min [2025-09-29T01:59:13.201789] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-29T01:59:13.555092] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-29T01:59:13.587397] [INFO ] [MAIN ] CCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:13.614196] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CCI took 1.3s. Estimated remaining: 8m 56s. Rate: 219.4 symbols/min [2025-09-29T01:59:13.797574] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:13.817951] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:14.134018] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-29T01:59:14.138293] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:14.155378] [INFO ] [MAIN ] CCIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:14.160839] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIF took 1.0s. Estimated remaining: 8m 57s. Rate: 218.9 symbols/min [2025-09-29T01:59:14.410529] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:14.413014] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-29T01:59:14.437226] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-29T01:59:14.474025] [INFO ] [MAIN ] CCJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:14.506412] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCJ took 1.3s. Estimated remaining: 8m 57s. Rate: 218.7 symbols/min [2025-09-29T01:59:14.508296] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:14.651107] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-29T01:59:14.678696] [INFO ] [MAIN ] CCK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:14.728568] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCK took 1.1s. Estimated remaining: 8m 57s. Rate: 218.8 symbols/min [2025-09-29T01:59:14.727929] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:14.743000] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T01:59:14.755269] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-29T01:59:14.896338] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-29T01:59:14.923612] [INFO ] [MAIN ] CCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:14.930841] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCL took 0.8s. Estimated remaining: 8m 56s. Rate: 219.0 symbols/min [2025-09-29T01:59:14.983244] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.095503] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T01:59:15.119897] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-29T01:59:15.170553] [DEBUG] [LOCAL ] CCRD: Loaded 9100 existing records from primary storage. [2025-09-29T01:59:15.194872] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.197709] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-29T01:59:15.195662] [INFO ] [MAIN ] CCRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:15.198419] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCRD took 0.5s. Estimated remaining: 8m 56s. Rate: 219.0 symbols/min [2025-09-29T01:59:15.198603] [INFO ] [MAIN ] CCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:15.221678] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCO took 0.7s. Estimated remaining: 8m 55s. Rate: 219.5 symbols/min [2025-09-29T01:59:15.479995] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T01:59:15.518282] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.551190] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-29T01:59:15.582523] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-29T01:59:15.616008] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.616292] [INFO ] [MAIN ] CCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:15.616943] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-29T01:59:15.617238] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-29T01:59:15.617154] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCS took 0.7s. Estimated remaining: 8m 55s. Rate: 219.2 symbols/min [2025-09-29T01:59:15.617602] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-29T01:59:15.617860] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-29T01:59:15.641038] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-29T01:59:15.710183] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-29T01:59:15.905224] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-29T01:59:15.912569] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T01:59:15.927780] [INFO ] [MAIN ] CCU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:15.934249] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-29T01:59:15.959563] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.945263] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCU took 0.7s. Estimated remaining: 8m 55s. Rate: 219.1 symbols/min [2025-09-29T01:59:16.252812] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-29T01:59:16.291427] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-29T01:59:16.437786] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:16.497479] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:16.500247] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-29T01:59:16.505265] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-29T01:59:16.507885] [INFO ] [MAIN ] CDE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:16.508477] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CDE took 0.9s. Estimated remaining: 8m 56s. Rate: 218.6 symbols/min [2025-09-29T01:59:16.594975] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-29T01:59:16.613343] [INFO ] [MAIN ] CDLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:16.595211] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T01:59:16.635160] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-29T01:59:16.634836] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CDLR took 0.7s. Estimated remaining: 8m 55s. Rate: 218.8 symbols/min [2025-09-29T01:59:16.805027] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-29T01:59:16.814623] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:16.815611] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-29T01:59:16.914782] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T01:59:16.918401] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:16.919754] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-29T01:59:16.968428] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-29T01:59:16.978041] [INFO ] [MAIN ] CDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:16.978518] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDP took 0.5s. Estimated remaining: 8m 55s. Rate: 218.7 symbols/min [2025-09-29T01:59:16.979168] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-29T01:59:17.007347] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.19 seconds). [2025-09-29T01:59:17.019857] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-29T01:59:17.046707] [INFO ] [MAIN ] CDRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:17.090047] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDRE took 0.5s. Estimated remaining: 8m 54s. Rate: 219.0 symbols/min [2025-09-29T01:59:17.156208] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-29T01:59:17.243279] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:17.239141] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-29T01:59:17.263350] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-29T01:59:17.271439] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-29T01:59:17.400997] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:17.416671] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-29T01:59:17.417230] [INFO ] [MAIN ] CEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:17.418029] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CEE took 0.3s. Estimated remaining: 8m 54s. Rate: 218.9 symbols/min [2025-09-29T01:59:17.466521] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T01:59:17.513562] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-29T01:59:17.597355] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-29T01:59:17.638972] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-29T01:59:17.666686] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-29T01:59:17.671324] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:17.664928] [INFO ] [MAIN ] CE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:17.672808] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CE took 0.7s. Estimated remaining: 8m 54s. Rate: 219.0 symbols/min [2025-09-29T01:59:17.803809] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-29T01:59:17.810680] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-29T01:59:17.898685] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-29T01:59:17.900012] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:17.900678] [INFO ] [MAIN ] CEPU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:17.901114] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CEPU took 0.5s. Estimated remaining: 8m 53s. Rate: 219.0 symbols/min [2025-09-29T01:59:17.986345] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.18 seconds). [2025-09-29T01:59:17.986543] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T01:59:18.019063] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-29T01:59:18.029028] [INFO ] [REMOTE ] CCIA: Full fetch complete (2044 records). [2025-09-29T01:59:18.035950] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-29T01:59:18.160450] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:18.212877] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:18.242575] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-29T01:59:18.274146] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:18.285180] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-09-29T01:59:18.302622] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-29T01:59:18.302852] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:18.328061] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-29T01:59:18.346829] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-29T01:59:18.334368] [INFO ] [MAIN ] CF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:18.374805] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T01:59:18.366445] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CF took 0.7s. Estimated remaining: 8m 54s. Rate: 218.7 symbols/min [2025-09-29T01:59:18.374974] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-29T01:59:18.375313] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:18.399542] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-29T01:59:18.393195] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:18.426622] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CCZ took 3.2s. Estimated remaining: 8m 52s. Rate: 219.1 symbols/min [2025-09-29T01:59:18.476475] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-29T01:59:18.528560] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-29T01:59:18.634787] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-29T01:59:18.588953] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-29T01:59:18.681342] [INFO ] [MAIN ] CFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:18.726225] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFG took 0.8s. Estimated remaining: 8m 52s. Rate: 219.0 symbols/min [2025-09-29T01:59:18.739335] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-29T01:59:18.806549] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CCIA took 6.0s. Estimated remaining: 8m 51s. Rate: 219.4 symbols/min [2025-09-29T01:59:18.806390] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:18.830182] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-29T01:59:18.935869] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:18.984441] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-29T01:59:19.027082] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-29T01:59:19.074723] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-29T01:59:19.084820] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-29T01:59:19.090731] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-29T01:59:19.339113] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:19.303616] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:19.418909] [DEBUG] [LOCAL ] CGV: Loaded 1431 existing records from primary storage. [2025-09-29T01:59:19.419865] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-29T01:59:19.477086] [INFO ] [MAIN ] CGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:19.477489] [INFO ] [MAIN ] CFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:19.477917] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CGV took 0.6s. Estimated remaining: 8m 53s. Rate: 218.7 symbols/min [2025-09-29T01:59:19.507559] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFR took 1.0s. Estimated remaining: 8m 51s. Rate: 219.1 symbols/min [2025-09-29T01:59:20.018846] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.037806] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-29T01:59:20.093399] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.096686] [INFO ] [MAIN ] CGAU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:20.097745] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CGAU took 1.3s. Estimated remaining: 8m 52s. Rate: 218.5 symbols/min [2025-09-29T01:59:20.101900] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:20.114897] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-29T01:59:20.273282] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:20.279410] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-29T01:59:20.284941] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-29T01:59:20.308154] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:20.328936] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-09-29T01:59:20.308043] [INFO ] [MAIN ] CHCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:20.339488] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.339734] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:20.339898] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CHCT took 0.9s. Estimated remaining: 8m 52s. Rate: 218.6 symbols/min [2025-09-29T01:59:20.339994] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-29T01:59:20.340750] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-29T01:59:20.353308] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-29T01:59:20.359691] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-29T01:59:20.389715] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CFND took 2.0s. Estimated remaining: 8m 51s. Rate: 219.0 symbols/min [2025-09-29T01:59:20.600974] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-29T01:59:20.636940] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-29T01:59:20.700027] [INFO ] [MAIN ] CHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:20.744130] [INFO ] [MAIN ] CHE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:20.791160] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.787146] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHD took 1.2s. Estimated remaining: 8m 51s. Rate: 218.8 symbols/min [2025-09-29T01:59:20.788499] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.791933] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHE took 0.7s. Estimated remaining: 8m 50s. Rate: 219.3 symbols/min [2025-09-29T01:59:21.293377] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-29T01:59:21.294536] [INFO ] [MAIN ] CHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:21.291983] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:21.287849] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:21.294704] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHH took 0.9s. Estimated remaining: 8m 50s. Rate: 218.8 symbols/min [2025-09-29T01:59:21.311978] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-29T01:59:21.313633] [INFO ] [MAIN ] CHGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:21.314111] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHGG took 1.0s. Estimated remaining: 8m 49s. Rate: 219.3 symbols/min [2025-09-29T01:59:21.317968] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-29T01:59:21.318155] [INFO ] [MAIN ] CHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:21.318335] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 0.5s. Estimated remaining: 8m 47s. Rate: 219.8 symbols/min [2025-09-29T01:59:21.337053] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-29T01:59:21.337337] [INFO ] [MAIN ] CHMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:21.337438] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 0.5s. Estimated remaining: 8m 46s. Rate: 220.3 symbols/min [2025-09-29T01:59:21.917545] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:21.948755] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:22.071926] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:22.112131] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:22.129452] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-29T01:59:22.129925] [INFO ] [MAIN ] CHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.130050] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 0.8s. Estimated remaining: 8m 48s. Rate: 219.3 symbols/min [2025-09-29T01:59:22.380887] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:22.415950] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-29T01:59:22.434565] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-29T01:59:22.434882] [INFO ] [MAIN ] CI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.435488] [INFO ] [MAIN ] CHWY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.437413] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-29T01:59:22.435938] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHWY took 1.1s. Estimated remaining: 8m 48s. Rate: 219.3 symbols/min [2025-09-29T01:59:22.443848] [INFO ] [MAIN ] CHPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.443749] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CI took 1.1s. Estimated remaining: 8m 46s. Rate: 219.7 symbols/min [2025-09-29T01:59:22.506782] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 1.1s. Estimated remaining: 8m 45s. Rate: 220.1 symbols/min [2025-09-29T01:59:22.637281] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-29T01:59:22.657982] [INFO ] [MAIN ] CIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.663601] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CIA took 0.5s. Estimated remaining: 8m 44s. Rate: 220.3 symbols/min [2025-09-29T01:59:22.943433] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.189295] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.124001] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.225487] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-29T01:59:23.226455] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.227424] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-29T01:59:23.227538] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-29T01:59:23.227586] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-29T01:59:23.227633] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-29T01:59:23.227713] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-29T01:59:23.335380] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-29T01:59:23.383560] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-29T01:59:23.381898] [INFO ] [MAIN ] CIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:23.390287] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIF took 0.7s. Estimated remaining: 8m 46s. Rate: 219.5 symbols/min [2025-09-29T01:59:23.406949] [INFO ] [MAIN ] CIB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:23.457801] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 1.0s. Estimated remaining: 8m 45s. Rate: 219.9 symbols/min [2025-09-29T01:59:23.939155] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-29T01:59:23.949633] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.961834] [INFO ] [MAIN ] CIEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:23.962492] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIEN took 1.4s. Estimated remaining: 8m 46s. Rate: 219.5 symbols/min [2025-09-29T01:59:24.174616] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:24.211624] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:24.244139] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-29T01:59:24.350881] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:24.373718] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-29T01:59:24.374952] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-29T01:59:24.375164] [INFO ] [MAIN ] CIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:24.375663] [INFO ] [MAIN ] CII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:24.376145] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIG took 1.0s. Estimated remaining: 8m 46s. Rate: 219.2 symbols/min [2025-09-29T01:59:24.376681] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 0.8s. Estimated remaining: 8m 45s. Rate: 219.7 symbols/min [2025-09-29T01:59:24.640004] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T01:59:24.670744] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-29T01:59:24.839105] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:24.846848] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-29T01:59:24.846088] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:24.847777] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-29T01:59:24.849800] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-29T01:59:24.851078] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-29T01:59:24.851380] [INFO ] [MAIN ] CIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:24.852540] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-29T01:59:24.852911] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIM took 0.9s. Estimated remaining: 8m 45s. Rate: 219.3 symbols/min [2025-09-29T01:59:24.853013] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-29T01:59:24.895788] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-29T01:59:24.944013] [INFO ] [MAIN ] CIMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:24.895441] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-29T01:59:24.956940] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMN took 0.6s. Estimated remaining: 8m 44s. Rate: 219.6 symbols/min [2025-09-29T01:59:25.158286] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T01:59:25.255376] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-29T01:59:25.292779] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:25.321408] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-29T01:59:25.328154] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-29T01:59:25.361324] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-29T01:59:25.361736] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-29T01:59:25.373183] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-29T01:59:25.418308] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-29T01:59:25.732213] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T01:59:25.702881] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:25.764335] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-29T01:59:26.137120] [DEBUG] [LOCAL ] CINT: Loaded 18868 existing records from primary storage. [2025-09-29T01:59:26.130206] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:26.150572] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-29T01:59:26.166492] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-29T01:59:26.156630] [INFO ] [MAIN ] CINT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:26.182756] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CINT took 1.2s. Estimated remaining: 8m 48s. Rate: 218.0 symbols/min [2025-09-29T01:59:26.170370] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-29T01:59:26.349710] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:26.379586] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-29T01:59:26.469530] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:26.494345] [DEBUG] [LOCAL ] CIO: Loaded 20406 existing records from primary storage. [2025-09-29T01:59:26.494739] [INFO ] [MAIN ] CIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:26.494869] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIO took 0.3s. Estimated remaining: 8m 48s. Rate: 217.9 symbols/min [2025-09-29T01:59:26.561204] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:26.571822] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T01:59:26.609755] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-29T01:59:26.607900] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-29T01:59:26.616915] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:26.642265] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-09-29T01:59:26.653682] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:26.661225] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-29T01:59:26.661400] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-29T01:59:26.667767] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-29T01:59:26.683283] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-29T01:59:26.688546] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMP took 1.8s. Estimated remaining: 8m 47s. Rate: 218.0 symbols/min [2025-09-29T01:59:26.776600] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:26.876712] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T01:59:26.885771] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T01:59:26.918742] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-29T01:59:26.912496] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-29T01:59:26.984071] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:27.015598] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-29T01:59:27.016056] [INFO ] [MAIN ] CION: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.016168] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CION took 0.5s. Estimated remaining: 8m 47s. Rate: 218.0 symbols/min [2025-09-29T01:59:27.248037] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-29T01:59:27.249478] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:27.250094] [INFO ] [MAIN ] CIVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.250790] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIVI took 0.5s. Estimated remaining: 8m 47s. Rate: 218.0 symbols/min [2025-09-29T01:59:27.268728] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T01:59:27.291857] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-29T01:59:27.357799] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T01:59:27.385971] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-29T01:59:27.469498] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:27.514526] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-29T01:59:27.515470] [INFO ] [MAIN ] CL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.515986] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CL took 0.5s. Estimated remaining: 8m 46s. Rate: 218.0 symbols/min [2025-09-29T01:59:27.642954] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T01:59:27.659466] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-29T01:59:27.695162] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-29T01:59:27.755999] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:27.757826] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T01:59:27.758018] [INFO ] [MAIN ] CLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.758817] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CLB took 0.5s. Estimated remaining: 8m 46s. Rate: 218.1 symbols/min [2025-09-29T01:59:27.760507] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-29T01:59:27.891007] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-29T01:59:27.891170] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-29T01:59:27.903704] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-29T01:59:27.909182] [INFO ] [MAIN ] CLCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.943778] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLCO took 0.4s. Estimated remaining: 8m 45s. Rate: 218.2 symbols/min [2025-09-29T01:59:27.980867] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:28.066556] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.16 seconds). [2025-09-29T01:59:28.096797] [INFO ] [REMOTE ] CICB: Full fetch complete (2111 records). [2025-09-29T01:59:28.113283] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-29T01:59:28.134852] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-29T01:59:28.220802] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-29T01:59:28.224609] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:28.307531] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-29T01:59:28.320119] [INFO ] [MAIN ] CLDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:28.325957] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CLDT took 0.6s. Estimated remaining: 8m 46s. Rate: 218.1 symbols/min [2025-09-29T01:59:28.456670] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T01:59:28.499818] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:28.520865] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:28.546803] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-29T01:59:28.558948] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-29T01:59:28.559149] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-29T01:59:28.624283] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-29T01:59:28.645055] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-29T01:59:28.642707] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:28.652048] [INFO ] [MAIN ] CLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:28.645676] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CICB took 6.2s. Estimated remaining: 8m 45s. Rate: 218.0 symbols/min [2025-09-29T01:59:28.653062] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T01:59:28.658578] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLF took 0.7s. Estimated remaining: 8m 44s. Rate: 218.4 symbols/min [2025-09-29T01:59:28.699576] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-29T01:59:29.003370] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.068274] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.080546] [DEBUG] [LOCAL ] CLH: Loaded 28493 existing records from primary storage. [2025-09-29T01:59:29.080957] [INFO ] [MAIN ] CLH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.081067] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLH took 0.7s. Estimated remaining: 8m 44s. Rate: 218.2 symbols/min [2025-09-29T01:59:29.138013] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T01:59:29.155282] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-29T01:59:29.222719] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-29T01:59:29.223798] [INFO ] [MAIN ] CLPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.224288] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLPR took 0.6s. Estimated remaining: 8m 44s. Rate: 218.4 symbols/min [2025-09-29T01:59:29.407728] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.439846] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T01:59:29.481286] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-29T01:59:29.495702] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-29T01:59:29.528837] [INFO ] [MAIN ] CLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.529776] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLS took 0.8s. Estimated remaining: 8m 43s. Rate: 218.4 symbols/min [2025-09-29T01:59:29.587043] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.775243] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.800630] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-29T01:59:29.814038] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-29T01:59:29.815619] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-29T01:59:29.802612] [INFO ] [MAIN ] CLVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.816553] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-29T01:59:29.818295] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLVT took 0.7s. Estimated remaining: 8m 43s. Rate: 218.3 symbols/min [2025-09-29T01:59:29.818743] [INFO ] [MAIN ] CLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.825344] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLW took 0.6s. Estimated remaining: 8m 42s. Rate: 218.8 symbols/min [2025-09-29T01:59:30.227708] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:30.273420] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:30.273882] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T01:59:30.277566] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-29T01:59:30.281063] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-29T01:59:30.282462] [INFO ] [MAIN ] CLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:30.283035] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLX took 0.7s. Estimated remaining: 8m 42s. Rate: 218.5 symbols/min [2025-09-29T01:59:30.493994] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:30.521251] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-29T01:59:30.540246] [INFO ] [REMOTE ] CIMO: Full fetch complete (5472 records). [2025-09-29T01:59:30.542084] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-29T01:59:30.557141] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-29T01:59:30.557480] [INFO ] [MAIN ] CM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:30.570853] [DEBUG] [LOCAL ] CMA: Loaded 50721 existing records from primary storage. [2025-09-29T01:59:30.607554] [INFO ] [MAIN ] CMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:30.576630] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CM took 0.8s. Estimated remaining: 8m 42s. Rate: 218.4 symbols/min [2025-09-29T01:59:30.674574] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMA took 0.8s. Estimated remaining: 8m 41s. Rate: 218.7 symbols/min [2025-09-29T01:59:30.930300] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-29T01:59:30.991683] [INFO ] [MAIN ] CMBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:31.007540] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 0.7s. Estimated remaining: 8m 41s. Rate: 218.6 symbols/min [2025-09-29T01:59:31.066531] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T01:59:31.143425] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:31.264740] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.263203] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:31.270210] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-29T01:59:31.202878] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.271106] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-29T01:59:31.278460] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-29T01:59:31.284568] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-29T01:59:31.286587] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CIMO took 6.9s. Estimated remaining: 8m 41s. Rate: 218.6 symbols/min [2025-09-29T01:59:31.355709] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-29T01:59:31.372231] [INFO ] [MAIN ] CMCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:31.392003] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMCM took 0.7s. Estimated remaining: 8m 40s. Rate: 218.9 symbols/min [2025-09-29T01:59:31.581219] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.602293] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-29T01:59:31.629917] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-29T01:59:31.716138] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-29T01:59:31.737698] [INFO ] [MAIN ] CMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:31.743008] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-29T01:59:31.759431] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-29T01:59:31.767461] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMC took 1.1s. Estimated remaining: 8m 40s. Rate: 218.8 symbols/min [2025-09-29T01:59:31.855280] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-29T01:59:31.851834] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.890339] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.868506] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-29T01:59:32.244897] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:32.502626] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-29T01:59:32.525193] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-29T01:59:32.551757] [INFO ] [MAIN ] CMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:32.552062] [INFO ] [MAIN ] CMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:32.558782] [DEBUG] [LOCAL ] CMP: Loaded 36848 existing records from primary storage. [2025-09-29T01:59:32.569938] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMG took 1.3s. Estimated remaining: 8m 42s. Rate: 217.9 symbols/min [2025-09-29T01:59:32.610520] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMI took 1.2s. Estimated remaining: 8m 41s. Rate: 218.3 symbols/min [2025-09-29T01:59:32.610313] [INFO ] [MAIN ] CMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:32.685466] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMP took 0.8s. Estimated remaining: 8m 40s. Rate: 218.6 symbols/min [2025-09-29T01:59:32.732025] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:32.768161] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-29T01:59:32.850418] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:32.897515] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-29T01:59:32.897950] [INFO ] [MAIN ] CMPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:32.898058] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMPO took 0.3s. Estimated remaining: 8m 39s. Rate: 218.7 symbols/min [2025-09-29T01:59:32.920693] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:32.921098] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-29T01:59:32.921192] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:32.921277] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-09-29T01:59:32.921347] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:32.921426] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-29T01:59:32.921537] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-29T01:59:32.921628] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-29T01:59:32.921759] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-29T01:59:32.921848] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMDB took 1.8s. Estimated remaining: 8m 38s. Rate: 219.1 symbols/min [2025-09-29T01:59:33.620659] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:33.696592] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:33.721570] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:33.719583] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:33.730398] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-29T01:59:33.732217] [INFO ] [MAIN ] CMSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:33.732836] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSA took 0.8s. Estimated remaining: 8m 40s. Rate: 218.2 symbols/min [2025-09-29T01:59:33.748856] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-29T01:59:33.780156] [INFO ] [MAIN ] CMSC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:33.807169] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSC took 0.9s. Estimated remaining: 8m 39s. Rate: 218.6 symbols/min [2025-09-29T01:59:34.051984] [DEBUG] [LOCAL ] CMRE: Loaded 36068 existing records from primary storage. [2025-09-29T01:59:34.071775] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.097924] [INFO ] [MAIN ] CMRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.126308] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-29T01:59:34.129542] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMRE took 1.2s. Estimated remaining: 8m 39s. Rate: 218.5 symbols/min [2025-09-29T01:59:34.130948] [INFO ] [MAIN ] CMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.179157] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 1.3s. Estimated remaining: 8m 37s. Rate: 218.8 symbols/min [2025-09-29T01:59:34.293759] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-29T01:59:34.336784] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.337104] [INFO ] [MAIN ] CMSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.347678] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMSD took 0.6s. Estimated remaining: 8m 37s. Rate: 219.0 symbols/min [2025-09-29T01:59:34.665513] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.744703] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.839856] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.843848] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-29T01:59:34.844880] [INFO ] [MAIN ] CMTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.845130] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 1.0s. Estimated remaining: 8m 37s. Rate: 218.7 symbols/min [2025-09-29T01:59:34.850133] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-29T01:59:34.863537] [INFO ] [MAIN ] CMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.875393] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 0.7s. Estimated remaining: 8m 36s. Rate: 219.1 symbols/min [2025-09-29T01:59:35.211944] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:35.246684] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-29T01:59:35.284857] [INFO ] [MAIN ] CNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:35.284693] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:35.288236] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNA took 1.1s. Estimated remaining: 8m 36s. Rate: 218.8 symbols/min [2025-09-29T01:59:35.317272] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-09-29T01:59:35.353963] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-29T01:59:35.378870] [INFO ] [MAIN ] CNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:35.389671] [INFO ] [MAIN ] CNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:35.400448] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNC took 1.0s. Estimated remaining: 8m 35s. Rate: 219.1 symbols/min [2025-09-29T01:59:35.452074] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNF took 0.6s. Estimated remaining: 8m 34s. Rate: 219.5 symbols/min [2025-09-29T01:59:35.599898] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:35.839270] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-29T01:59:35.875714] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:35.888567] [INFO ] [MAIN ] CNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:35.925273] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNH took 1.0s. Estimated remaining: 8m 35s. Rate: 219.1 symbols/min [2025-09-29T01:59:35.952602] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:36.208853] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:36.165405] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-29T01:59:36.209875] [INFO ] [MAIN ] CNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:36.210676] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNI took 0.9s. Estimated remaining: 8m 35s. Rate: 219.1 symbols/min [2025-09-29T01:59:36.363623] [DEBUG] [LOCAL ] CNK: Loaded 53658 existing records from primary storage. [2025-09-29T01:59:36.378096] [INFO ] [MAIN ] CNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:36.414148] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNK took 1.0s. Estimated remaining: 8m 34s. Rate: 219.2 symbols/min [2025-09-29T01:59:36.513667] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:36.464182] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-29T01:59:36.514891] [INFO ] [MAIN ] CNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:36.529764] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNM took 1.0s. Estimated remaining: 8m 33s. Rate: 219.5 symbols/min [2025-09-29T01:59:36.561062] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-29T01:59:36.599346] [INFO ] [MAIN ] CNMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:36.641271] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNMD took 0.7s. Estimated remaining: 8m 32s. Rate: 219.7 symbols/min [2025-09-29T01:59:36.993124] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:37.078701] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:37.120883] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-29T01:59:37.133534] [INFO ] [MAIN ] CNNE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:37.171568] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:37.171916] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 1.0s. Estimated remaining: 8m 33s. Rate: 219.3 symbols/min [2025-09-29T01:59:37.411951] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:37.425597] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-29T01:59:37.426109] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-29T01:59:37.426461] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-29T01:59:37.426581] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-29T01:59:37.426810] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-29T01:59:37.429277] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-29T01:59:37.450974] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-29T01:59:37.498684] [INFO ] [MAIN ] CNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:37.517858] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 1.0s. Estimated remaining: 8m 33s. Rate: 219.2 symbols/min [2025-09-29T01:59:37.511833] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-29T01:59:37.539760] [INFO ] [MAIN ] CNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:37.570753] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNP took 1.0s. Estimated remaining: 8m 32s. Rate: 219.6 symbols/min [2025-09-29T01:59:37.750101] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-29T01:59:37.802921] [INFO ] [MAIN ] CNQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:37.855508] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNQ took 1.2s. Estimated remaining: 8m 32s. Rate: 219.5 symbols/min [2025-09-29T01:59:38.222990] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:38.326078] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:38.441164] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:38.527820] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:38.528489] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-29T01:59:38.542921] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-29T01:59:38.543385] [INFO ] [MAIN ] CNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:38.543854] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 1.0s. Estimated remaining: 8m 33s. Rate: 218.9 symbols/min [2025-09-29T01:59:38.692237] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:38.728529] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-29T01:59:38.745351] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-29T01:59:38.765576] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:38.751099] [INFO ] [MAIN ] CODI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:38.766044] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-09-29T01:59:38.779316] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CODI took 0.9s. Estimated remaining: 8m 32s. Rate: 218.9 symbols/min [2025-09-29T01:59:38.787053] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-29T01:59:38.779763] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:38.803866] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-29T01:59:38.850282] [INFO ] [MAIN ] CNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:38.866773] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-29T01:59:38.899153] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNX took 1.3s. Estimated remaining: 8m 32s. Rate: 219.2 symbols/min [2025-09-29T01:59:38.898514] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-29T01:59:38.925824] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:38.947952] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-29T01:59:39.005206] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNR took 1.8s. Estimated remaining: 8m 31s. Rate: 219.5 symbols/min [2025-09-29T01:59:39.306787] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:39.451318] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:39.481617] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:39.506739] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-29T01:59:39.507549] [INFO ] [MAIN ] COF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:39.508492] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 1.0s. Estimated remaining: 8m 31s. Rate: 219.1 symbols/min [2025-09-29T01:59:39.745335] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-29T01:59:39.746265] [INFO ] [MAIN ] COHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:39.747264] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COHR took 1.0s. Estimated remaining: 8m 31s. Rate: 219.1 symbols/min [2025-09-29T01:59:39.817314] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:39.919059] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-29T01:59:39.970992] [INFO ] [MAIN ] COMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.014153] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COMP took 1.0s. Estimated remaining: 8m 31s. Rate: 219.2 symbols/min [2025-09-29T01:59:40.018936] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:40.043926] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-29T01:59:40.122221] [INFO ] [MAIN ] COLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.150615] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COLD took 1.2s. Estimated remaining: 8m 30s. Rate: 219.4 symbols/min [2025-09-29T01:59:40.230310] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-29T01:59:40.258434] [INFO ] [MAIN ] COOK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.303737] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. COOK took 0.6s. Estimated remaining: 8m 29s. Rate: 219.6 symbols/min [2025-09-29T01:59:40.321376] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:40.356940] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-29T01:59:40.443074] [INFO ] [MAIN ] CON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.464242] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. CON took 1.0s. Estimated remaining: 8m 28s. Rate: 219.7 symbols/min [2025-09-29T01:59:40.692690] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:40.770668] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:40.832862] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-29T01:59:40.860268] [INFO ] [MAIN ] COP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.885462] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 0.9s. Estimated remaining: 8m 29s. Rate: 219.5 symbols/min [2025-09-29T01:59:40.886768] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.137590] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.189456] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-29T01:59:41.187725] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-29T01:59:41.190348] [INFO ] [MAIN ] COTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:41.203781] [INFO ] [MAIN ] COR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:41.204479] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COTY took 0.9s. Estimated remaining: 8m 29s. Rate: 219.4 symbols/min [2025-09-29T01:59:41.207390] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COR took 1.0s. Estimated remaining: 8m 27s. Rate: 219.9 symbols/min [2025-09-29T01:59:41.245747] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-29T01:59:41.282202] [INFO ] [MAIN ] COUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:41.340357] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. COUR took 0.8s. Estimated remaining: 8m 27s. Rate: 220.1 symbols/min [2025-09-29T01:59:41.653190] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.833884] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-29T01:59:41.838404] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.868704] [INFO ] [MAIN ] CP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:41.868959] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-29T01:59:41.869939] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CP took 1.0s. Estimated remaining: 8m 27s. Rate: 219.7 symbols/min [2025-09-29T01:59:41.868353] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.869179] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-29T01:59:41.905297] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-29T01:59:41.905578] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-29T01:59:41.905716] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-29T01:59:41.905795] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-29T01:59:42.139029] [DEBUG] [LOCAL ] CPA: Loaded 29208 existing records from primary storage. [2025-09-29T01:59:42.203689] [INFO ] [MAIN ] CPA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:42.267623] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:42.268575] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPA took 1.1s. Estimated remaining: 8m 27s. Rate: 219.5 symbols/min [2025-09-29T01:59:42.474925] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-29T01:59:42.517912] [INFO ] [MAIN ] CPAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:42.570246] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CPAY took 1.2s. Estimated remaining: 8m 27s. Rate: 219.4 symbols/min [2025-09-29T01:59:42.602434] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-29T01:59:42.653426] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:42.679630] [INFO ] [MAIN ] CPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:42.728716] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPF took 0.9s. Estimated remaining: 8m 27s. Rate: 219.6 symbols/min [2025-09-29T01:59:42.807803] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:42.849989] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-29T01:59:42.910761] [DEBUG] [LOCAL ] CPK: Loaded 13588 existing records from primary storage. [2025-09-29T01:59:42.939715] [INFO ] [MAIN ] CPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:42.939429] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:42.940012] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 0.7s. Estimated remaining: 8m 26s. Rate: 219.7 symbols/min [2025-09-29T01:59:43.000201] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-29T01:59:43.000817] [INFO ] [MAIN ] CPNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:43.001735] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPNG took 0.4s. Estimated remaining: 8m 25s. Rate: 220.0 symbols/min [2025-09-29T01:59:43.212855] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T01:59:43.214259] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-29T01:59:43.478700] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T01:59:43.479920] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-29T01:59:43.684148] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T01:59:43.685312] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-29T01:59:43.888633] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T01:59:43.889882] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-29T01:59:44.008841] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.12 seconds). [2025-09-29T01:59:44.010154] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-29T01:59:44.211831] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T01:59:44.212952] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-29T01:59:44.414382] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T01:59:44.415458] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-29T01:59:44.691537] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T01:59:44.692801] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-29T01:59:44.892248] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T01:59:44.893381] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-29T01:59:45.178530] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-29T01:59:45.179513] [INFO ] [REMOTE ] CPAC: Full fetch complete (1887 records). [2025-09-29T01:59:45.179627] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-29T01:59:45.381752] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T01:59:45.381962] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:45.382034] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:45.382119] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-29T01:59:45.382226] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-29T01:59:45.382300] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-29T01:59:45.382381] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-29T01:59:45.382478] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPAC took 4.1s. Estimated remaining: 8m 32s. Rate: 216.8 symbols/min [2025-09-29T01:59:46.256521] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.306521] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.383584] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.430270] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.456801] [DEBUG] [LOCAL ] CQP: Loaded 20033 existing records from primary storage. [2025-09-29T01:59:46.457544] [INFO ] [MAIN ] CQP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:46.458247] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 1.1s. Estimated remaining: 8m 35s. Rate: 215.6 symbols/min [2025-09-29T01:59:46.562557] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-29T01:59:46.605408] [INFO ] [MAIN ] CPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:46.633351] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 1.2s. Estimated remaining: 8m 34s. Rate: 215.8 symbols/min [2025-09-29T01:59:46.874390] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.948901] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-29T01:59:46.974479] [DEBUG] [LOCAL ] CPT: Loaded 45034 existing records from primary storage. [2025-09-29T01:59:46.980018] [INFO ] [MAIN ] CPRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:46.980415] [INFO ] [MAIN ] CPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:47.001910] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPRI took 1.6s. Estimated remaining: 8m 34s. Rate: 215.6 symbols/min [2025-09-29T01:59:47.039615] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPT took 1.6s. Estimated remaining: 8m 33s. Rate: 216.0 symbols/min [2025-09-29T01:59:47.089825] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:47.296271] [DEBUG] [LOCAL ] CRBD: Loaded 9131 existing records from primary storage. [2025-09-29T01:59:47.334119] [DEBUG] [LOCAL ] CR: Loaded 25019 existing records from primary storage. [2025-09-29T01:59:47.360272] [INFO ] [MAIN ] CRBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:47.405114] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CRBD took 0.7s. Estimated remaining: 8m 33s. Rate: 215.9 symbols/min [2025-09-29T01:59:47.400591] [INFO ] [MAIN ] CR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:47.430819] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CR took 1.0s. Estimated remaining: 8m 32s. Rate: 216.2 symbols/min [2025-09-29T01:59:47.509164] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:47.695137] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:47.893937] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:47.907680] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-29T01:59:47.909874] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-29T01:59:47.910133] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-29T01:59:47.910214] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-29T01:59:47.910332] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-29T01:59:47.910411] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-29T01:59:47.954831] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:48.139572] [DEBUG] [LOCAL ] CRBG: Loaded 53110 existing records from primary storage. [2025-09-29T01:59:48.171291] [INFO ] [MAIN ] CRBG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:48.232978] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBG took 1.2s. Estimated remaining: 8m 33s. Rate: 215.5 symbols/min [2025-09-29T01:59:48.277274] [DEBUG] [LOCAL ] CRC: Loaded 44946 existing records from primary storage. [2025-09-29T01:59:48.454891] [INFO ] [MAIN ] CRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:48.468312] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 1.4s. Estimated remaining: 8m 33s. Rate: 215.5 symbols/min [2025-09-29T01:59:48.678445] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:48.680090] [DEBUG] [LOCAL ] CRGY: Loaded 53290 existing records from primary storage. [2025-09-29T01:59:48.726141] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:48.747817] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-29T01:59:48.759503] [INFO ] [MAIN ] CRGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:48.776722] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRGY took 1.3s. Estimated remaining: 8m 33s. Rate: 215.5 symbols/min [2025-09-29T01:59:48.924503] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:48.962904] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-29T01:59:48.963083] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:48.995031] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:48.995102] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-09-29T01:59:49.006773] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:49.029554] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-29T01:59:49.095381] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-29T01:59:49.094339] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:49.096042] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-29T01:59:49.111536] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-29T01:59:49.112177] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRCL took 1.7s. Estimated remaining: 8m 33s. Rate: 215.4 symbols/min [2025-09-29T01:59:49.150728] [DEBUG] [LOCAL ] CRH: Loaded 54243 existing records from primary storage. [2025-09-29T01:59:49.169858] [INFO ] [MAIN ] CRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:49.184746] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 0.9s. Estimated remaining: 8m 32s. Rate: 215.7 symbols/min [2025-09-29T01:59:49.491299] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:49.556893] [DEBUG] [LOCAL ] CRK: Loaded 52891 existing records from primary storage. [2025-09-29T01:59:49.589106] [DEBUG] [LOCAL ] CRI: Loaded 50713 existing records from primary storage. [2025-09-29T01:59:49.613148] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:49.613691] [INFO ] [MAIN ] CRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:49.615053] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRK took 0.8s. Estimated remaining: 8m 32s. Rate: 215.5 symbols/min [2025-09-29T01:59:49.613907] [INFO ] [MAIN ] CRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:49.629705] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRI took 1.1s. Estimated remaining: 8m 31s. Rate: 215.9 symbols/min [2025-09-29T01:59:49.998939] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.065088] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.068133] [DEBUG] [LOCAL ] CRL: Loaded 43853 existing records from primary storage. [2025-09-29T01:59:50.071907] [INFO ] [MAIN ] CRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.073850] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRL took 1.0s. Estimated remaining: 8m 31s. Rate: 215.6 symbols/min [2025-09-29T01:59:50.133818] [DEBUG] [LOCAL ] CRT: Loaded 5018 existing records from primary storage. [2025-09-29T01:59:50.162556] [INFO ] [MAIN ] CRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.179355] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRT took 0.5s. Estimated remaining: 8m 30s. Rate: 215.9 symbols/min [2025-09-29T01:59:50.201680] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-29T01:59:50.241745] [INFO ] [MAIN ] CRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.261977] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRM took 1.0s. Estimated remaining: 8m 29s. Rate: 216.2 symbols/min [2025-09-29T01:59:50.487363] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.596108] [DEBUG] [LOCAL ] CRS: Loaded 43928 existing records from primary storage. [2025-09-29T01:59:50.638236] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.648538] [INFO ] [MAIN ] CRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.670481] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRS took 1.1s. Estimated remaining: 8m 30s. Rate: 216.0 symbols/min [2025-09-29T01:59:50.783451] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.943256] [DEBUG] [LOCAL ] CSAN: Loaded 42951 existing records from primary storage. [2025-09-29T01:59:50.963687] [INFO ] [MAIN ] CSAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.968578] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.983981] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 0.9s. Estimated remaining: 8m 29s. Rate: 215.9 symbols/min [2025-09-29T01:59:50.984468] [DEBUG] [LOCAL ] CSR: Loaded 12808 existing records from primary storage. [2025-09-29T01:59:51.016419] [DEBUG] [LOCAL ] CSL: Loaded 32100 existing records from primary storage. [2025-09-29T01:59:51.033740] [INFO ] [MAIN ] CSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.052073] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSR took 0.8s. Estimated remaining: 8m 28s. Rate: 216.2 symbols/min [2025-09-29T01:59:51.044554] [INFO ] [MAIN ] CSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.057836] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSL took 0.9s. Estimated remaining: 8m 27s. Rate: 216.6 symbols/min [2025-09-29T01:59:51.449241] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:51.631176] [DEBUG] [LOCAL ] CSTM: Loaded 48360 existing records from primary storage. [2025-09-29T01:59:51.629411] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:51.637212] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:51.638347] [INFO ] [MAIN ] CSTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.639195] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSTM took 0.9s. Estimated remaining: 8m 28s. Rate: 216.2 symbols/min [2025-09-29T01:59:51.638683] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-29T01:59:51.639564] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-29T01:59:51.639717] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-29T01:59:51.639905] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-29T01:59:51.640053] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-29T01:59:51.640127] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-29T01:59:51.710509] [DEBUG] [LOCAL ] CSV: Loaded 13198 existing records from primary storage. [2025-09-29T01:59:51.813024] [INFO ] [MAIN ] CSV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.858752] [DEBUG] [LOCAL ] CTBB: Loaded 7168 existing records from primary storage. [2025-09-29T01:59:51.858299] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSV took 0.9s. Estimated remaining: 8m 27s. Rate: 216.3 symbols/min [2025-09-29T01:59:51.874796] [INFO ] [MAIN ] CTBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.915928] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTBB took 0.8s. Estimated remaining: 8m 26s. Rate: 216.6 symbols/min [2025-09-29T01:59:52.339735] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:52.579171] [DEBUG] [LOCAL ] CTDD: Loaded 5947 existing records from primary storage. [2025-09-29T01:59:52.636138] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:52.636370] [INFO ] [MAIN ] CTDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:52.594424] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:52.653024] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTDD took 1.0s. Estimated remaining: 8m 28s. Rate: 215.9 symbols/min [2025-09-29T01:59:52.652852] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-29T01:59:52.680120] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-29T01:59:52.669578] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-29T01:59:52.713906] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-29T01:59:52.704837] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-29T01:59:52.735796] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:52.746430] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-29T01:59:52.800862] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-29T01:59:52.759538] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-29T01:59:52.800997] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-29T01:59:52.746631] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-29T01:59:52.835055] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-29T01:59:52.953708] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-29T01:59:52.982282] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:52.958092] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:52.998186] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-29T01:59:52.992771] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-29T01:59:53.013865] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:53.048720] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-09-29T01:59:53.120130] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:53.147161] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-29T01:59:53.173236] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-29T01:59:53.206164] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-29T01:59:53.275537] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-29T01:59:53.284900] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CSW took 2.2s. Estimated remaining: 8m 29s. Rate: 215.4 symbols/min [2025-09-29T01:59:53.506960] [DEBUG] [LOCAL ] CTO: Loaded 28661 existing records from primary storage. [2025-09-29T01:59:53.581471] [INFO ] [MAIN ] CTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:53.648582] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTO took 1.0s. Estimated remaining: 8m 29s. Rate: 215.3 symbols/min [2025-09-29T01:59:53.829932] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:54.035748] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:54.154585] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:54.154996] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-29T01:59:54.094948] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-29T01:59:54.238375] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:54.265811] [DEBUG] [LOCAL ] CTOS: Loaded 37246 existing records from primary storage. [2025-09-29T01:59:54.266247] [INFO ] [MAIN ] CTOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:54.266352] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTOS took 1.0s. Estimated remaining: 8m 29s. Rate: 214.8 symbols/min [2025-09-29T01:59:54.300256] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:54.339846] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-29T01:59:54.329040] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:54.356240] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:54.373537] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-09-29T01:59:54.378976] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-29T01:59:54.390195] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:54.390718] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:54.390825] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-29T01:59:54.401827] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-29T01:59:54.412271] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-09-29T01:59:54.434631] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:54.417831] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-29T01:59:54.519183] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:54.519338] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-29T01:59:54.520126] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-29T01:59:54.519676] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-29T01:59:54.520257] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-29T01:59:54.520424] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-29T01:59:54.520534] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTEV took 2.6s. Estimated remaining: 8m 29s. Rate: 214.8 symbols/min [2025-09-29T01:59:54.527209] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTEST took 2.6s. Estimated remaining: 8m 28s. Rate: 215.2 symbols/min [2025-09-29T01:59:54.712842] [DEBUG] [LOCAL ] CTRA: Loaded 54428 existing records from primary storage. [2025-09-29T01:59:54.759112] [INFO ] [MAIN ] CTRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:54.896684] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:54.864622] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 1.1s. Estimated remaining: 8m 28s. Rate: 215.1 symbols/min [2025-09-29T01:59:55.094278] [DEBUG] [LOCAL ] CTRE: Loaded 49964 existing records from primary storage. [2025-09-29T01:59:55.087425] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.130506] [INFO ] [MAIN ] CTRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:55.152802] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRE took 0.9s. Estimated remaining: 8m 28s. Rate: 215.1 symbols/min [2025-09-29T01:59:55.297455] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.358878] [DEBUG] [LOCAL ] CTRI: Loaded 38571 existing records from primary storage. [2025-09-29T01:59:55.378933] [INFO ] [MAIN ] CTRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:55.390442] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRI took 0.9s. Estimated remaining: 8m 27s. Rate: 215.2 symbols/min [2025-09-29T01:59:55.414784] [DEBUG] [LOCAL ] CTS: Loaded 19637 existing records from primary storage. [2025-09-29T01:59:55.459485] [INFO ] [MAIN ] CTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:55.508132] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTS took 0.9s. Estimated remaining: 8m 26s. Rate: 215.4 symbols/min [2025-09-29T01:59:55.496339] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.535561] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-29T01:59:55.596560] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-29T01:59:55.668079] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-29T01:59:55.727010] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-29T01:59:55.749390] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-29T01:59:55.777249] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-29T01:59:55.849967] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.918361] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.960884] [DEBUG] [LOCAL ] CTVA: Loaded 54002 existing records from primary storage. [2025-09-29T01:59:56.006870] [INFO ] [MAIN ] CTVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:56.021358] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTVA took 1.1s. Estimated remaining: 8m 27s. Rate: 215.1 symbols/min [2025-09-29T01:59:56.354282] [DEBUG] [LOCAL ] CUBI: Loaded 27667 existing records from primary storage. [2025-09-29T01:59:56.432923] [INFO ] [MAIN ] CUBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:56.478140] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:56.497452] [DEBUG] [LOCAL ] CUBE: Loaded 51391 existing records from primary storage. [2025-09-29T01:59:56.478432] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CUBI took 0.9s. Estimated remaining: 8m 27s. Rate: 214.8 symbols/min [2025-09-29T01:59:56.503895] [INFO ] [MAIN ] CUBE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:56.565399] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBE took 1.1s. Estimated remaining: 8m 26s. Rate: 215.1 symbols/min [2025-09-29T01:59:56.683015] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:56.728556] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-29T01:59:57.024218] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:57.052907] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:57.053122] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-29T01:59:57.028926] [DEBUG] [LOCAL ] CUK: Loaded 51762 existing records from primary storage. [2025-09-29T01:59:57.055439] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-29T01:59:57.057318] [INFO ] [MAIN ] CUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:57.058760] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUK took 1.0s. Estimated remaining: 8m 27s. Rate: 214.8 symbols/min [2025-09-29T01:59:57.064075] [DEBUG] [LOCAL ] CULP: Loaded 3111 existing records from primary storage. [2025-09-29T01:59:57.064412] [INFO ] [MAIN ] CULP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:57.064771] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CULP took 0.5s. Estimated remaining: 8m 26s. Rate: 215.2 symbols/min [2025-09-29T01:59:57.099069] [DEBUG] [LOCAL ] CURB: Loaded 33350 existing records from primary storage. [2025-09-29T01:59:57.099469] [INFO ] [MAIN ] CURB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:57.099965] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CURB took 0.5s. Estimated remaining: 8m 24s. Rate: 215.5 symbols/min [2025-09-29T01:59:57.251449] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-09-29T01:59:57.252436] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-29T01:59:57.451322] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T01:59:57.452411] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-29T01:59:57.648864] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T01:59:57.649916] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-29T01:59:57.851945] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-29T01:59:57.853167] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-29T01:59:58.054789] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T01:59:58.055802] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-29T01:59:58.180972] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.13 seconds). [2025-09-29T01:59:58.181934] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-29T01:59:58.376092] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.19 seconds). [2025-09-29T01:59:58.377176] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-29T01:59:58.572404] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T01:59:58.573508] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-29T01:59:58.766082] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-29T01:59:58.766976] [INFO ] [REMOTE ] CUBB: Full fetch complete (928 records). [2025-09-29T01:59:58.767077] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-29T01:59:58.965139] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T01:59:58.965355] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:58.965428] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:58.965504] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-29T01:59:58.965600] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-29T01:59:58.965694] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-29T01:59:58.965806] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-29T01:59:58.965909] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUBB took 3.8s. Estimated remaining: 8m 29s. Rate: 213.4 symbols/min [2025-09-29T01:59:59.700473] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:59.705310] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:59.718534] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:59.775304] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:59.803736] [DEBUG] [LOCAL ] CVEO: Loaded 15402 existing records from primary storage. [2025-09-29T01:59:59.813280] [INFO ] [MAIN ] CVEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:59.813444] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 0.8s. Estimated remaining: 8m 31s. Rate: 212.6 symbols/min [2025-09-29T01:59:59.819584] [DEBUG] [LOCAL ] CURV: Loaded 26933 existing records from primary storage. [2025-09-29T01:59:59.841834] [INFO ] [MAIN ] CURV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:59.868801] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 0.9s. Estimated remaining: 8m 30s. Rate: 212.9 symbols/min [2025-09-29T02:00:00.236370] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-09-29T02:00:00.213747] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:00.244408] [INFO ] [MAIN ] CVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:00.255792] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CVE took 1.3s. Estimated remaining: 8m 30s. Rate: 212.8 symbols/min [2025-09-29T02:00:00.287452] [DEBUG] [LOCAL ] CUZ: Loaded 50140 existing records from primary storage. [2025-09-29T02:00:00.311438] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:00.329104] [INFO ] [MAIN ] CUZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:00.329502] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CUZ took 1.4s. Estimated remaining: 8m 29s. Rate: 213.0 symbols/min [2025-09-29T02:00:00.534590] [DEBUG] [LOCAL ] CVLG: Loaded 15730 existing records from primary storage. [2025-09-29T02:00:00.558951] [INFO ] [MAIN ] CVLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:00.566867] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 0.7s. Estimated remaining: 8m 29s. Rate: 213.1 symbols/min [2025-09-29T02:00:00.845519] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:00.858593] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:00.860368] [DEBUG] [LOCAL ] CVI: Loaded 47160 existing records from primary storage. [2025-09-29T02:00:00.917893] [INFO ] [MAIN ] CVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:00.948519] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 1.1s. Estimated remaining: 8m 29s. Rate: 213.0 symbols/min [2025-09-29T02:00:00.979089] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:01.234445] [DEBUG] [LOCAL ] CVS: Loaded 54476 existing records from primary storage. [2025-09-29T02:00:01.259459] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:01.259783] [INFO ] [MAIN ] CVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:01.281136] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVS took 0.9s. Estimated remaining: 8m 28s. Rate: 212.9 symbols/min [2025-09-29T02:00:01.310835] [DEBUG] [LOCAL ] CVNA: Loaded 53766 existing records from primary storage. [2025-09-29T02:00:01.333938] [INFO ] [MAIN ] CVNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:01.359993] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVNA took 1.1s. Estimated remaining: 8m 27s. Rate: 213.2 symbols/min [2025-09-29T02:00:01.491337] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-29T02:00:01.576149] [INFO ] [MAIN ] CVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:01.582307] [DEBUG] [LOCAL ] CW: Loaded 22705 existing records from primary storage. [2025-09-29T02:00:01.603523] [INFO ] [MAIN ] CW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:01.603292] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVX took 1.0s. Estimated remaining: 8m 27s. Rate: 213.2 symbols/min [2025-09-29T02:00:01.637153] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CW took 0.7s. Estimated remaining: 8m 26s. Rate: 213.5 symbols/min [2025-09-29T02:00:01.739799] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.008975] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.171011] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.244928] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.304860] [DEBUG] [LOCAL ] CWAN: Loaded 53154 existing records from primary storage. [2025-09-29T02:00:02.317853] [INFO ] [MAIN ] CWAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:02.318377] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWAN took 1.0s. Estimated remaining: 8m 27s. Rate: 213.0 symbols/min [2025-09-29T02:00:02.481087] [DEBUG] [LOCAL ] CWEN: Loaded 45717 existing records from primary storage. [2025-09-29T02:00:02.496095] [INFO ] [MAIN ] CWEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:02.535261] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWEN took 1.1s. Estimated remaining: 8m 27s. Rate: 213.1 symbols/min [2025-09-29T02:00:02.646272] [DEBUG] [LOCAL ] CWK: Loaded 50158 existing records from primary storage. [2025-09-29T02:00:02.669482] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.675127] [INFO ] [MAIN ] CWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:02.720611] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWK took 1.0s. Estimated remaining: 8m 26s. Rate: 213.2 symbols/min [2025-09-29T02:00:02.747540] [DEBUG] [LOCAL ] CWH: Loaded 52151 existing records from primary storage. [2025-09-29T02:00:02.829716] [INFO ] [MAIN ] CWH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:02.854806] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWH took 1.3s. Estimated remaining: 8m 25s. Rate: 213.4 symbols/min [2025-09-29T02:00:03.051596] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:03.141256] [DEBUG] [LOCAL ] CWT: Loaded 28294 existing records from primary storage. [2025-09-29T02:00:03.217522] [INFO ] [MAIN ] CWT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:03.232529] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:03.249187] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWT took 0.9s. Estimated remaining: 8m 25s. Rate: 213.3 symbols/min [2025-09-29T02:00:03.324295] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:03.408830] [DEBUG] [LOCAL ] CXE: Loaded 7247 existing records from primary storage. [2025-09-29T02:00:03.438361] [DEBUG] [LOCAL ] CXH: Loaded 4436 existing records from primary storage. [2025-09-29T02:00:03.445397] [INFO ] [MAIN ] CXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:03.473214] [INFO ] [MAIN ] CXH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:03.473821] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CXE took 0.7s. Estimated remaining: 8m 25s. Rate: 213.3 symbols/min [2025-09-29T02:00:03.485785] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXH took 0.6s. Estimated remaining: 8m 24s. Rate: 213.7 symbols/min [2025-09-29T02:00:03.697748] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:03.746724] [DEBUG] [LOCAL ] CX: Loaded 53603 existing records from primary storage. [2025-09-29T02:00:03.844793] [INFO ] [MAIN ] CX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:03.861177] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CX took 1.3s. Estimated remaining: 8m 24s. Rate: 213.6 symbols/min [2025-09-29T02:00:04.077757] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:04.147694] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:04.319702] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:04.322164] [DEBUG] [LOCAL ] CXM: Loaded 48607 existing records from primary storage. [2025-09-29T02:00:04.323419] [INFO ] [MAIN ] CXM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:04.323896] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXM took 1.0s. Estimated remaining: 8m 24s. Rate: 213.3 symbols/min [2025-09-29T02:00:04.509389] [DEBUG] [LOCAL ] CXT: Loaded 31611 existing records from primary storage. [2025-09-29T02:00:04.535848] [DEBUG] [LOCAL ] CXW: Loaded 44899 existing records from primary storage. [2025-09-29T02:00:04.536037] [INFO ] [MAIN ] CXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:04.559289] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXT took 1.1s. Estimated remaining: 8m 24s. Rate: 213.4 symbols/min [2025-09-29T02:00:04.565306] [DEBUG] [LOCAL ] CYD: Loaded 27145 existing records from primary storage. [2025-09-29T02:00:04.559155] [INFO ] [MAIN ] CXW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:04.644587] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXW took 1.1s. Estimated remaining: 8m 23s. Rate: 213.7 symbols/min [2025-09-29T02:00:04.653008] [INFO ] [MAIN ] CYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:04.655385] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:04.689914] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYD took 0.8s. Estimated remaining: 8m 22s. Rate: 214.0 symbols/min [2025-09-29T02:00:05.131771] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.160954] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.308443] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.314523] [DEBUG] [LOCAL ] DAC: Loaded 12769 existing records from primary storage. [2025-09-29T02:00:05.315158] [INFO ] [MAIN ] DAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:05.315618] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. DAC took 0.6s. Estimated remaining: 8m 22s. Rate: 213.5 symbols/min [2025-09-29T02:00:05.317469] [DEBUG] [LOCAL ] CYH: Loaded 48352 existing records from primary storage. [2025-09-29T02:00:05.323580] [INFO ] [MAIN ] CYH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:05.337124] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. CYH took 1.0s. Estimated remaining: 8m 21s. Rate: 213.8 symbols/min [2025-09-29T02:00:05.668817] [DEBUG] [LOCAL ] D: Loaded 54426 existing records from primary storage. [2025-09-29T02:00:05.716683] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.752614] [INFO ] [MAIN ] D: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:05.795511] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 1.2s. Estimated remaining: 8m 22s. Rate: 213.6 symbols/min [2025-09-29T02:00:05.793907] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.834368] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-29T02:00:05.857617] [INFO ] [MAIN ] DAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:05.869621] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAL took 1.0s. Estimated remaining: 8m 21s. Rate: 213.9 symbols/min [2025-09-29T02:00:06.001851] [DEBUG] [LOCAL ] DAO: Loaded 21546 existing records from primary storage. [2025-09-29T02:00:06.049622] [INFO ] [MAIN ] DAO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:06.123079] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAO took 0.7s. Estimated remaining: 8m 20s. Rate: 213.9 symbols/min [2025-09-29T02:00:06.217568] [DEBUG] [LOCAL ] DAN: Loaded 49753 existing records from primary storage. [2025-09-29T02:00:06.215865] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:06.244989] [INFO ] [MAIN ] DAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:06.363931] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 1.0s. Estimated remaining: 8m 20s. Rate: 214.0 symbols/min [2025-09-29T02:00:06.397529] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:06.539511] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:06.754342] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:06.756628] [DEBUG] [LOCAL ] DAR: Loaded 52603 existing records from primary storage. [2025-09-29T02:00:06.771302] [INFO ] [MAIN ] DAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:06.772077] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 1.0s. Estimated remaining: 8m 20s. Rate: 213.8 symbols/min [2025-09-29T02:00:06.778736] [DEBUG] [LOCAL ] DAVA: Loaded 41308 existing records from primary storage. [2025-09-29T02:00:06.823172] [INFO ] [MAIN ] DAVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:06.851857] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 0.9s. Estimated remaining: 8m 19s. Rate: 214.1 symbols/min [2025-09-29T02:00:06.978207] [DEBUG] [LOCAL ] DAY: Loaded 50491 existing records from primary storage. [2025-09-29T02:00:07.051780] [INFO ] [MAIN ] DAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:07.094189] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 0.9s. Estimated remaining: 8m 19s. Rate: 214.1 symbols/min [2025-09-29T02:00:07.100600] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.380299] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.387242] [DEBUG] [LOCAL ] DB: Loaded 53377 existing records from primary storage. [2025-09-29T02:00:07.403278] [INFO ] [MAIN ] DB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:07.436198] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 1.0s. Estimated remaining: 8m 19s. Rate: 214.0 symbols/min [2025-09-29T02:00:07.438783] [DEBUG] [LOCAL ] DBD: Loaded 24109 existing records from primary storage. [2025-09-29T02:00:07.462782] [INFO ] [MAIN ] DBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:07.505183] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 0.7s. Estimated remaining: 8m 18s. Rate: 214.3 symbols/min [2025-09-29T02:00:07.669429] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.873054] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.890149] [DEBUG] [LOCAL ] DBL: Loaded 9259 existing records from primary storage. [2025-09-29T02:00:07.941479] [INFO ] [MAIN ] DBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:07.983268] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.983697] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 0.9s. Estimated remaining: 8m 18s. Rate: 214.1 symbols/min [2025-09-29T02:00:07.978422] [DEBUG] [LOCAL ] DBI: Loaded 45524 existing records from primary storage. [2025-09-29T02:00:07.990762] [INFO ] [MAIN ] DBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.020726] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 1.1s. Estimated remaining: 8m 17s. Rate: 214.4 symbols/min [2025-09-29T02:00:08.356243] [DEBUG] [LOCAL ] DBRG: Loaded 50526 existing records from primary storage. [2025-09-29T02:00:08.388330] [INFO ] [MAIN ] DBRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.415223] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 1.0s. Estimated remaining: 8m 17s. Rate: 214.2 symbols/min [2025-09-29T02:00:08.488499] [DEBUG] [LOCAL ] DCI: Loaded 38065 existing records from primary storage. [2025-09-29T02:00:08.547940] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:08.553715] [INFO ] [MAIN ] DCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.532547] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:08.565371] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DCI took 1.0s. Estimated remaining: 8m 16s. Rate: 214.4 symbols/min [2025-09-29T02:00:08.692782] [DEBUG] [LOCAL ] DCO: Loaded 14003 existing records from primary storage. [2025-09-29T02:00:08.715386] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:08.719912] [INFO ] [MAIN ] DCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.720187] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 0.7s. Estimated remaining: 8m 16s. Rate: 214.5 symbols/min [2025-09-29T02:00:08.795782] [DEBUG] [LOCAL ] DD: Loaded 53595 existing records from primary storage. [2025-09-29T02:00:08.796396] [INFO ] [MAIN ] DD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.797037] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 0.8s. Estimated remaining: 8m 15s. Rate: 214.8 symbols/min [2025-09-29T02:00:08.816732] [DEBUG] [LOCAL ] DDD: Loaded 51647 existing records from primary storage. [2025-09-29T02:00:08.817187] [INFO ] [MAIN ] DDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.817737] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 0.4s. Estimated remaining: 8m 14s. Rate: 215.1 symbols/min [2025-09-29T02:00:09.493921] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:09.582798] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:09.576172] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:09.641088] [DEBUG] [LOCAL ] DDT: Loaded 2117 existing records from primary storage. [2025-09-29T02:00:09.638426] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:09.643775] [INFO ] [MAIN ] DDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:09.644354] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 0.8s. Estimated remaining: 8m 15s. Rate: 214.4 symbols/min [2025-09-29T02:00:09.761681] [DEBUG] [LOCAL ] DDS: Loaded 13374 existing records from primary storage. [2025-09-29T02:00:09.798761] [INFO ] [MAIN ] DDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:09.833057] [DEBUG] [LOCAL ] DDL: Loaded 37016 existing records from primary storage. [2025-09-29T02:00:09.831664] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 1.0s. Estimated remaining: 8m 15s. Rate: 214.6 symbols/min [2025-09-29T02:00:09.878100] [INFO ] [MAIN ] DDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:09.969205] [DEBUG] [LOCAL ] DE: Loaded 48397 existing records from primary storage. [2025-09-29T02:00:09.980085] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:10.015806] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 1.2s. Estimated remaining: 8m 14s. Rate: 214.7 symbols/min [2025-09-29T02:00:10.052536] [INFO ] [MAIN ] DE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:10.082322] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 1.3s. Estimated remaining: 8m 13s. Rate: 214.9 symbols/min [2025-09-29T02:00:10.308068] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:10.572312] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:10.631362] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:10.633781] [DEBUG] [LOCAL ] DEA: Loaded 41860 existing records from primary storage. [2025-09-29T02:00:10.635062] [INFO ] [MAIN ] DEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:10.642447] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 1.0s. Estimated remaining: 8m 14s. Rate: 214.6 symbols/min [2025-09-29T02:00:10.683092] [DEBUG] [LOCAL ] DEC: Loaded 31121 existing records from primary storage. [2025-09-29T02:00:10.717992] [INFO ] [MAIN ] DEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:10.772108] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 0.9s. Estimated remaining: 8m 13s. Rate: 214.8 symbols/min [2025-09-29T02:00:10.963766] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:11.106752] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:11.139639] [DEBUG] [LOCAL ] DEI: Loaded 49204 existing records from primary storage. [2025-09-29T02:00:11.140473] [INFO ] [MAIN ] DEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:11.141344] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DEI took 1.0s. Estimated remaining: 8m 13s. Rate: 214.7 symbols/min [2025-09-29T02:00:11.142787] [DEBUG] [LOCAL ] DECK: Loaded 54078 existing records from primary storage. [2025-09-29T02:00:11.160979] [INFO ] [MAIN ] DECK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:11.193350] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DECK took 1.1s. Estimated remaining: 8m 12s. Rate: 215.0 symbols/min [2025-09-29T02:00:11.565054] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:11.584231] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-29T02:00:11.625137] [INFO ] [MAIN ] DELL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:11.621203] [DEBUG] [LOCAL ] DEO: Loaded 49777 existing records from primary storage. [2025-09-29T02:00:11.655716] [INFO ] [MAIN ] DEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:11.653225] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 1.0s. Estimated remaining: 8m 12s. Rate: 214.7 symbols/min [2025-09-29T02:00:11.655373] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:11.656572] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 0.9s. Estimated remaining: 8m 11s. Rate: 215.1 symbols/min [2025-09-29T02:00:11.976459] [DEBUG] [LOCAL ] DFIN: Loaded 23650 existing records from primary storage. [2025-09-29T02:00:12.043083] [DEBUG] [LOCAL ] DFH: Loaded 33106 existing records from primary storage. [2025-09-29T02:00:12.043262] [INFO ] [MAIN ] DFIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:12.079402] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFIN took 0.9s. Estimated remaining: 8m 11s. Rate: 214.9 symbols/min [2025-09-29T02:00:12.109885] [INFO ] [MAIN ] DFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:12.112084] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:12.176537] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:12.192613] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 1.1s. Estimated remaining: 8m 11s. Rate: 215.1 symbols/min [2025-09-29T02:00:12.447576] [DEBUG] [LOCAL ] DFP: Loaded 11771 existing records from primary storage. [2025-09-29T02:00:12.540143] [INFO ] [MAIN ] DFP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:12.573285] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFP took 0.9s. Estimated remaining: 8m 11s. Rate: 215.0 symbols/min [2025-09-29T02:00:12.630705] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:12.686639] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:12.717497] [DEBUG] [LOCAL ] DG: Loaded 54068 existing records from primary storage. [2025-09-29T02:00:12.755305] [INFO ] [MAIN ] DG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:12.766362] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 1.1s. Estimated remaining: 8m 10s. Rate: 215.1 symbols/min [2025-09-29T02:00:13.012197] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:13.117452] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:13.119980] [DEBUG] [LOCAL ] DHF: Loaded 20835 existing records from primary storage. [2025-09-29T02:00:13.133939] [INFO ] [MAIN ] DHF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.134562] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHF took 0.9s. Estimated remaining: 8m 10s. Rate: 215.0 symbols/min [2025-09-29T02:00:13.143037] [DEBUG] [LOCAL ] DGX: Loaded 45736 existing records from primary storage. [2025-09-29T02:00:13.183143] [INFO ] [MAIN ] DGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.199590] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DGX took 1.1s. Estimated remaining: 8m 9s. Rate: 215.2 symbols/min [2025-09-29T02:00:13.517807] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:13.610602] [DEBUG] [LOCAL ] DHI: Loaded 54147 existing records from primary storage. [2025-09-29T02:00:13.612427] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:13.614153] [DEBUG] [LOCAL ] DHR: Loaded 54139 existing records from primary storage. [2025-09-29T02:00:13.612823] [INFO ] [MAIN ] DHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.615331] [INFO ] [MAIN ] DHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.616373] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHI took 1.0s. Estimated remaining: 8m 9s. Rate: 215.1 symbols/min [2025-09-29T02:00:13.623100] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHR took 0.8s. Estimated remaining: 8m 8s. Rate: 215.4 symbols/min [2025-09-29T02:00:13.795757] [DEBUG] [LOCAL ] DHX: Loaded 13404 existing records from primary storage. [2025-09-29T02:00:13.807259] [INFO ] [MAIN ] DHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.854292] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHX took 0.7s. Estimated remaining: 8m 8s. Rate: 215.5 symbols/min [2025-09-29T02:00:14.045387] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.180421] [DEBUG] [LOCAL ] DHT: Loaded 48583 existing records from primary storage. [2025-09-29T02:00:14.197275] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.197866] [INFO ] [MAIN ] DHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:14.214955] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHT took 1.1s. Estimated remaining: 8m 8s. Rate: 215.4 symbols/min [2025-09-29T02:00:14.323880] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.387488] [DEBUG] [LOCAL ] DIAX: Loaded 12780 existing records from primary storage. [2025-09-29T02:00:14.403925] [INFO ] [MAIN ] DIAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:14.425964] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 0.8s. Estimated remaining: 8m 7s. Rate: 215.4 symbols/min [2025-09-29T02:00:14.561428] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.583592] [DEBUG] [LOCAL ] DIN: Loaded 37823 existing records from primary storage. [2025-09-29T02:00:14.619192] [INFO ] [MAIN ] DIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:14.647987] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 1.0s. Estimated remaining: 8m 7s. Rate: 215.5 symbols/min [2025-09-29T02:00:14.847027] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.873903] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-29T02:00:14.891772] [DEBUG] [LOCAL ] DINO: Loaded 53729 existing records from primary storage. [2025-09-29T02:00:14.906564] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-29T02:00:14.913028] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-29T02:00:14.923986] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-29T02:00:14.924297] [INFO ] [MAIN ] DINO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:14.929896] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-29T02:00:14.986450] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DINO took 1.1s. Estimated remaining: 8m 7s. Rate: 215.4 symbols/min [2025-09-29T02:00:14.993137] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-29T02:00:14.993014] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:15.094990] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-29T02:00:15.155520] [INFO ] [MAIN ] DIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:15.189963] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIS took 0.9s. Estimated remaining: 8m 6s. Rate: 215.5 symbols/min [2025-09-29T02:00:15.592052] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:15.783127] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:15.816928] [DEBUG] [LOCAL ] DK: Loaded 50093 existing records from primary storage. [2025-09-29T02:00:15.882744] [DEBUG] [LOCAL ] DKL: Loaded 19229 existing records from primary storage. [2025-09-29T02:00:15.887109] [INFO ] [MAIN ] DKL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:15.870498] [INFO ] [MAIN ] DK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:15.886532] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:15.887855] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-29T02:00:15.889639] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DKL took 0.9s. Estimated remaining: 8m 7s. Rate: 215.0 symbols/min [2025-09-29T02:00:15.902334] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DK took 1.2s. Estimated remaining: 8m 6s. Rate: 215.3 symbols/min [2025-09-29T02:00:16.258194] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:16.284099] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:00:16.291487] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-29T02:00:16.293319] [DEBUG] [LOCAL ] DKS: Loaded 50579 existing records from primary storage. [2025-09-29T02:00:16.305213] [INFO ] [MAIN ] DKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:16.336212] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKS took 1.1s. Estimated remaining: 8m 6s. Rate: 215.2 symbols/min [2025-09-29T02:00:16.368011] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:16.506200] [DEBUG] [LOCAL ] DLNG: Loaded 6276 existing records from primary storage. [2025-09-29T02:00:16.516325] [INFO ] [MAIN ] DLNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:16.516638] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLNG took 0.6s. Estimated remaining: 8m 6s. Rate: 215.3 symbols/min [2025-09-29T02:00:16.530592] [DEBUG] [LOCAL ] DLB: Loaded 32601 existing records from primary storage. [2025-09-29T02:00:16.601038] [INFO ] [MAIN ] DLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:16.619454] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLB took 0.7s. Estimated remaining: 8m 5s. Rate: 215.5 symbols/min [2025-09-29T02:00:16.702389] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T02:00:16.774184] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:16.794567] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-29T02:00:16.922303] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.103870] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.108826] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T02:00:17.111731] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-29T02:00:17.126302] [DEBUG] [LOCAL ] DLX: Loaded 29284 existing records from primary storage. [2025-09-29T02:00:17.127112] [INFO ] [MAIN ] DLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:17.127600] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLX took 0.6s. Estimated remaining: 8m 5s. Rate: 215.2 symbols/min [2025-09-29T02:00:17.268781] [DEBUG] [LOCAL ] DLR: Loaded 51825 existing records from primary storage. [2025-09-29T02:00:17.289534] [INFO ] [MAIN ] DLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:17.332126] [DEBUG] [LOCAL ] DLY: Loaded 19800 existing records from primary storage. [2025-09-29T02:00:17.333110] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLR took 1.0s. Estimated remaining: 8m 5s. Rate: 215.3 symbols/min [2025-09-29T02:00:17.339848] [INFO ] [MAIN ] DLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:17.381828] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.407213] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLY took 0.7s. Estimated remaining: 8m 4s. Rate: 215.5 symbols/min [2025-09-29T02:00:17.432261] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T02:00:17.486143] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-29T02:00:17.593986] [DEBUG] [LOCAL ] DMA: Loaded 4604 existing records from primary storage. [2025-09-29T02:00:17.641275] [INFO ] [MAIN ] DMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:17.672796] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DMA took 0.5s. Estimated remaining: 8m 4s. Rate: 215.6 symbols/min [2025-09-29T02:00:17.762520] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.814352] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.898872] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T02:00:17.932935] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-29T02:00:17.994897] [DEBUG] [LOCAL ] DMB: Loaded 10254 existing records from primary storage. [2025-09-29T02:00:17.994353] [DEBUG] [LOCAL ] DMO: Loaded 9981 existing records from primary storage. [2025-09-29T02:00:18.003963] [INFO ] [MAIN ] DMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.020043] [INFO ] [MAIN ] DMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.024745] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DMB took 0.7s. Estimated remaining: 8m 4s. Rate: 215.5 symbols/min [2025-09-29T02:00:18.024178] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:18.030181] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMO took 0.6s. Estimated remaining: 8m 3s. Rate: 215.8 symbols/min [2025-09-29T02:00:18.395710] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T02:00:18.462111] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:18.459043] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-29T02:00:18.466314] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:18.484563] [DEBUG] [LOCAL ] DNA: Loaded 48990 existing records from primary storage. [2025-09-29T02:00:18.485817] [INFO ] [MAIN ] DNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.486492] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DNA took 0.7s. Estimated remaining: 8m 3s. Rate: 215.6 symbols/min [2025-09-29T02:00:18.736170] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:18.712435] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-29T02:00:18.739002] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-29T02:00:18.739317] [DEBUG] [LOCAL ] DNP: Loaded 33786 existing records from primary storage. [2025-09-29T02:00:18.743422] [INFO ] [MAIN ] DNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.744680] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNP took 0.7s. Estimated remaining: 8m 3s. Rate: 215.6 symbols/min [2025-09-29T02:00:18.759559] [DEBUG] [LOCAL ] DNOW: Loaded 44205 existing records from primary storage. [2025-09-29T02:00:18.760263] [INFO ] [MAIN ] DNOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.761024] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNOW took 0.7s. Estimated remaining: 8m 2s. Rate: 215.9 symbols/min [2025-09-29T02:00:18.820342] [DEBUG] [LOCAL ] DOC: Loaded 54317 existing records from primary storage. [2025-09-29T02:00:18.820824] [INFO ] [MAIN ] DOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.821308] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DOC took 0.3s. Estimated remaining: 8m 1s. Rate: 216.2 symbols/min [2025-09-29T02:00:18.964070] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-29T02:00:18.965246] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-29T02:00:19.087909] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.12 seconds). [2025-09-29T02:00:19.089054] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-29T02:00:19.286621] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:00:19.287607] [INFO ] [REMOTE ] DIVY: Full fetch complete (1720 records). [2025-09-29T02:00:19.287728] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-29T02:00:19.503813] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:00:19.504037] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:19.504116] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:19.504201] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-29T02:00:19.504306] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-29T02:00:19.504382] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-29T02:00:19.504488] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-29T02:00:19.504598] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DIVY took 5.1s. Estimated remaining: 8m 1s. Rate: 215.7 symbols/min [2025-09-29T02:00:20.256988] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.335772] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.286485] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.340258] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.386217] [DEBUG] [LOCAL ] DOUG: Loaded 35254 existing records from primary storage. [2025-09-29T02:00:20.386914] [INFO ] [MAIN ] DOUG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:20.387173] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOUG took 0.9s. Estimated remaining: 8m 3s. Rate: 215.0 symbols/min [2025-09-29T02:00:20.591819] [DEBUG] [LOCAL ] DOLE: Loaded 38568 existing records from primary storage. [2025-09-29T02:00:20.597301] [INFO ] [MAIN ] DOLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:20.598475] [DEBUG] [LOCAL ] DOCN: Loaded 51245 existing records from primary storage. [2025-09-29T02:00:20.610492] [DEBUG] [LOCAL ] DOCS: Loaded 51956 existing records from primary storage. [2025-09-29T02:00:20.626444] [INFO ] [MAIN ] DOCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:20.616518] [INFO ] [MAIN ] DOCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:20.616302] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOLE took 1.1s. Estimated remaining: 8m 2s. Rate: 215.0 symbols/min [2025-09-29T02:00:20.696405] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.678556] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCS took 1.1s. Estimated remaining: 8m 2s. Rate: 215.3 symbols/min [2025-09-29T02:00:20.702227] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 1.1s. Estimated remaining: 8m 1s. Rate: 215.6 symbols/min [2025-09-29T02:00:21.356893] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.374923] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.379612] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.388506] [DEBUG] [LOCAL ] DOV: Loaded 46376 existing records from primary storage. [2025-09-29T02:00:21.390484] [INFO ] [MAIN ] DOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:21.391412] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOV took 1.0s. Estimated remaining: 8m 1s. Rate: 215.1 symbols/min [2025-09-29T02:00:21.535850] [DEBUG] [LOCAL ] DPG: Loaded 13683 existing records from primary storage. [2025-09-29T02:00:21.559623] [INFO ] [MAIN ] DPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:21.560014] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DPG took 0.9s. Estimated remaining: 8m 1s. Rate: 215.2 symbols/min [2025-09-29T02:00:21.754292] [DEBUG] [LOCAL ] DQ: Loaded 43880 existing records from primary storage. [2025-09-29T02:00:21.725740] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.785775] [INFO ] [MAIN ] DQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:21.801163] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DQ took 1.0s. Estimated remaining: 8m 0s. Rate: 215.3 symbols/min [2025-09-29T02:00:21.902469] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-29T02:00:21.955105] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.975257] [INFO ] [MAIN ] DOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:21.988726] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOW took 1.3s. Estimated remaining: 7m 60s. Rate: 215.4 symbols/min [2025-09-29T02:00:22.255501] [DEBUG] [LOCAL ] DRD: Loaded 37397 existing records from primary storage. [2025-09-29T02:00:22.320171] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:22.342629] [INFO ] [MAIN ] DRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:22.369235] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 1.0s. Estimated remaining: 7m 60s. Rate: 215.3 symbols/min [2025-09-29T02:00:22.407192] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:22.454504] [DEBUG] [LOCAL ] DRH: Loaded 51205 existing records from primary storage. [2025-09-29T02:00:22.478614] [INFO ] [MAIN ] DRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:22.503769] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 0.9s. Estimated remaining: 7m 59s. Rate: 215.4 symbols/min [2025-09-29T02:00:22.602117] [DEBUG] [LOCAL ] DRLL: Loaded 9737 existing records from primary storage. [2025-09-29T02:00:22.664185] [INFO ] [MAIN ] DRLL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:22.761111] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRLL took 0.8s. Estimated remaining: 7m 59s. Rate: 215.5 symbols/min [2025-09-29T02:00:22.786338] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:22.844850] [DEBUG] [LOCAL ] DRI: Loaded 48554 existing records from primary storage. [2025-09-29T02:00:22.891505] [INFO ] [MAIN ] DRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:22.981988] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:22.982831] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 1.1s. Estimated remaining: 7m 59s. Rate: 215.5 symbols/min [2025-09-29T02:00:23.219769] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:23.225912] [DEBUG] [LOCAL ] DSM: Loaded 15895 existing records from primary storage. [2025-09-29T02:00:23.235272] [INFO ] [MAIN ] DSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:23.260127] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSM took 0.7s. Estimated remaining: 7m 58s. Rate: 215.5 symbols/min [2025-09-29T02:00:23.261551] [DEBUG] [LOCAL ] DSL: Loaded 28651 existing records from primary storage. [2025-09-29T02:00:23.303151] [INFO ] [MAIN ] DSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:23.424073] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSL took 1.0s. Estimated remaining: 7m 58s. Rate: 215.7 symbols/min [2025-09-29T02:00:23.302706] [DEBUG] [LOCAL ] DSMC: Loaded 1974 existing records from primary storage. [2025-09-29T02:00:23.400290] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:23.440070] [INFO ] [MAIN ] DSMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:23.462560] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSMC took 0.6s. Estimated remaining: 7m 57s. Rate: 216.0 symbols/min [2025-09-29T02:00:23.744978] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:23.866059] [DEBUG] [LOCAL ] DSU: Loaded 22684 existing records from primary storage. [2025-09-29T02:00:23.963573] [INFO ] [MAIN ] DSU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:24.027166] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSU took 1.0s. Estimated remaining: 7m 57s. Rate: 215.6 symbols/min [2025-09-29T02:00:23.999087] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:24.044124] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:24.090371] [DEBUG] [LOCAL ] DSX: Loaded 24642 existing records from primary storage. [2025-09-29T02:00:24.124383] [INFO ] [MAIN ] DSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:24.138799] [DEBUG] [LOCAL ] DTB: Loaded 4817 existing records from primary storage. [2025-09-29T02:00:24.177056] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSX took 0.9s. Estimated remaining: 7m 57s. Rate: 215.8 symbols/min [2025-09-29T02:00:24.183085] [INFO ] [MAIN ] DTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:24.269486] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 0.8s. Estimated remaining: 7m 56s. Rate: 216.0 symbols/min [2025-09-29T02:00:24.329447] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:24.626439] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:24.645377] [DEBUG] [LOCAL ] DT: Loaded 53708 existing records from primary storage. [2025-09-29T02:00:24.650812] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-29T02:00:24.651091] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-29T02:00:24.656697] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-29T02:00:24.678508] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-29T02:00:24.687811] [INFO ] [MAIN ] DT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:24.687941] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-29T02:00:24.689706] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-29T02:00:24.690427] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 1.2s. Estimated remaining: 7m 56s. Rate: 215.8 symbols/min [2025-09-29T02:00:24.751732] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:25.064990] [DEBUG] [LOCAL ] DTG: Loaded 5952 existing records from primary storage. [2025-09-29T02:00:25.066598] [DEBUG] [LOCAL ] DTE: Loaded 48557 existing records from primary storage. [2025-09-29T02:00:25.092760] [INFO ] [MAIN ] DTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:25.087082] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:25.113362] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTG took 0.8s. Estimated remaining: 7m 56s. Rate: 215.7 symbols/min [2025-09-29T02:00:25.113954] [INFO ] [MAIN ] DTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:25.129707] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-29T02:00:25.130103] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTE took 1.1s. Estimated remaining: 7m 55s. Rate: 216.0 symbols/min [2025-09-29T02:00:25.141486] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-29T02:00:25.295738] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-29T02:00:25.310164] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-29T02:00:25.401377] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-29T02:00:25.428002] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-29T02:00:25.733500] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:25.827058] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:25.955871] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:25.956288] [DEBUG] [LOCAL ] DTW: Loaded 4923 existing records from primary storage. [2025-09-29T02:00:25.999940] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-29T02:00:26.000219] [INFO ] [MAIN ] DTW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:26.032711] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTW took 0.9s. Estimated remaining: 7m 56s. Rate: 215.2 symbols/min [2025-09-29T02:00:26.385086] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:26.387040] [DEBUG] [LOCAL ] DTM: Loaded 45043 existing records from primary storage. [2025-09-29T02:00:26.437010] [INFO ] [MAIN ] DTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:26.429973] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-29T02:00:26.441253] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTM took 1.3s. Estimated remaining: 7m 56s. Rate: 215.1 symbols/min [2025-09-29T02:00:26.506699] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:26.507724] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-29T02:00:26.537962] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-29T02:00:26.660002] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:00:26.671196] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-29T02:00:26.703994] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:26.704473] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:00:26.704718] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-09-29T02:00:26.705218] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:00:26.705300] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-29T02:00:26.705409] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-29T02:00:26.705485] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-29T02:00:26.705588] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-29T02:00:26.705802] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTK took 2.0s. Estimated remaining: 7m 56s. Rate: 215.1 symbols/min [2025-09-29T02:00:26.889306] [DEBUG] [LOCAL ] DUKB: Loaded 6414 existing records from primary storage. [2025-09-29T02:00:26.938006] [INFO ] [MAIN ] DUKB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:26.917831] [DEBUG] [LOCAL ] DUK: Loaded 54238 existing records from primary storage. [2025-09-29T02:00:26.939087] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T02:00:26.958966] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:26.960497] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-29T02:00:26.957953] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DUKB took 0.5s. Estimated remaining: 7m 56s. Rate: 215.1 symbols/min [2025-09-29T02:00:26.960720] [INFO ] [MAIN ] DUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:26.979668] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUK took 0.9s. Estimated remaining: 7m 55s. Rate: 215.4 symbols/min [2025-09-29T02:00:27.179601] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-29T02:00:27.192487] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-29T02:00:27.394484] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:27.395486] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:27.416493] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-09-29T02:00:27.417070] [INFO ] [MAIN ] DV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:27.417770] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DV took 0.7s. Estimated remaining: 7m 55s. Rate: 215.2 symbols/min [2025-09-29T02:00:27.534149] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T02:00:27.535783] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-29T02:00:27.639518] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:27.685203] [DEBUG] [LOCAL ] DVA: Loaded 41877 existing records from primary storage. [2025-09-29T02:00:27.706148] [INFO ] [MAIN ] DVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:27.706338] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DVA took 0.7s. Estimated remaining: 7m 55s. Rate: 215.2 symbols/min [2025-09-29T02:00:27.752323] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-29T02:00:27.787917] [INFO ] [MAIN ] DVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:27.809192] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVN took 0.8s. Estimated remaining: 7m 54s. Rate: 215.4 symbols/min [2025-09-29T02:00:27.900557] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T02:00:27.956280] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-29T02:00:28.101384] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:28.120773] [DEBUG] [LOCAL ] DX: Loaded 53228 existing records from primary storage. [2025-09-29T02:00:28.153857] [INFO ] [MAIN ] DX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:28.189786] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:28.190559] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DX took 0.8s. Estimated remaining: 7m 54s. Rate: 215.3 symbols/min [2025-09-29T02:00:28.433837] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T02:00:28.453790] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:28.455431] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-29T02:00:28.469405] [DEBUG] [LOCAL ] DXC: Loaded 50456 existing records from primary storage. [2025-09-29T02:00:28.467789] [DEBUG] [LOCAL ] DXYZ: Loaded 37246 existing records from primary storage. [2025-09-29T02:00:28.470417] [INFO ] [MAIN ] DXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:28.471091] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DXC took 0.8s. Estimated remaining: 7m 54s. Rate: 215.3 symbols/min [2025-09-29T02:00:28.470506] [INFO ] [MAIN ] DXYZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:28.483886] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXYZ took 0.6s. Estimated remaining: 7m 53s. Rate: 215.6 symbols/min [2025-09-29T02:00:28.747877] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-29T02:00:28.780890] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-29T02:00:28.850318] [DEBUG] [LOCAL ] DY: Loaded 30160 existing records from primary storage. [2025-09-29T02:00:28.937510] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:28.939229] [INFO ] [MAIN ] DY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:28.962312] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DY took 0.8s. Estimated remaining: 7m 53s. Rate: 215.4 symbols/min [2025-09-29T02:00:28.962154] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.142595] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T02:00:29.181818] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-29T02:00:29.217086] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.220187] [DEBUG] [LOCAL ] E: Loaded 33848 existing records from primary storage. [2025-09-29T02:00:29.234702] [INFO ] [MAIN ] E: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.234870] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. E took 0.8s. Estimated remaining: 7m 53s. Rate: 215.4 symbols/min [2025-09-29T02:00:29.241503] [DEBUG] [LOCAL ] EAF: Loaded 44158 existing records from primary storage. [2025-09-29T02:00:29.261545] [INFO ] [MAIN ] EAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.277913] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EAF took 0.7s. Estimated remaining: 7m 52s. Rate: 215.7 symbols/min [2025-09-29T02:00:29.312194] [DEBUG] [LOCAL ] EAI: Loaded 4008 existing records from primary storage. [2025-09-29T02:00:29.345730] [INFO ] [MAIN ] EAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.391578] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAI took 0.4s. Estimated remaining: 7m 51s. Rate: 215.8 symbols/min [2025-09-29T02:00:29.512165] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T02:00:29.643391] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.638610] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-29T02:00:29.795056] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.905604] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.907722] [DEBUG] [LOCAL ] EARN: Loaded 30576 existing records from primary storage. [2025-09-29T02:00:29.908505] [INFO ] [MAIN ] EARN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.908619] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EARN took 0.7s. Estimated remaining: 7m 51s. Rate: 215.6 symbols/min [2025-09-29T02:00:29.971290] [DEBUG] [LOCAL ] EB: Loaded 38017 existing records from primary storage. [2025-09-29T02:00:29.972413] [INFO ] [MAIN ] EB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.988385] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EB took 0.5s. Estimated remaining: 7m 51s. Rate: 215.8 symbols/min [2025-09-29T02:00:29.989705] [DEBUG] [LOCAL ] EAT: Loaded 50542 existing records from primary storage. [2025-09-29T02:00:29.990046] [INFO ] [MAIN ] EAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.990499] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EAT took 0.7s. Estimated remaining: 7m 50s. Rate: 216.1 symbols/min [2025-09-29T02:00:30.042937] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-29T02:00:30.043935] [INFO ] [REMOTE ] DTF: Full fetch complete (2111 records). [2025-09-29T02:00:30.044055] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-29T02:00:30.248717] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:00:30.248987] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:30.249066] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:30.249154] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-29T02:00:30.249256] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-29T02:00:30.249330] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-29T02:00:30.249438] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-29T02:00:30.249579] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. DTF took 6.1s. Estimated remaining: 7m 49s. Rate: 216.1 symbols/min [2025-09-29T02:00:30.934590] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:30.988796] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:31.014862] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:31.074604] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:31.101401] [DEBUG] [LOCAL ] EBF: Loaded 19635 existing records from primary storage. [2025-09-29T02:00:31.102291] [INFO ] [MAIN ] EBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:31.102410] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 0.9s. Estimated remaining: 7m 51s. Rate: 215.5 symbols/min [2025-09-29T02:00:31.331630] [DEBUG] [LOCAL ] EC: Loaded 50056 existing records from primary storage. [2025-09-29T02:00:31.325407] [DEBUG] [LOCAL ] EBS: Loaded 47455 existing records from primary storage. [2025-09-29T02:00:31.348515] [DEBUG] [LOCAL ] EBR: Loaded 43731 existing records from primary storage. [2025-09-29T02:00:31.353954] [INFO ] [MAIN ] EC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:31.374195] [INFO ] [MAIN ] EBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:31.367454] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EC took 1.1s. Estimated remaining: 7m 50s. Rate: 215.5 symbols/min [2025-09-29T02:00:31.382111] [INFO ] [MAIN ] EBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:31.390177] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBS took 1.1s. Estimated remaining: 7m 49s. Rate: 215.8 symbols/min [2025-09-29T02:00:31.460612] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:31.435141] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBR took 1.2s. Estimated remaining: 7m 48s. Rate: 216.1 symbols/min [2025-09-29T02:00:31.907773] [DEBUG] [LOCAL ] ECAT: Loaded 30092 existing records from primary storage. [2025-09-29T02:00:32.061081] [INFO ] [MAIN ] ECAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:32.065441] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 1.0s. Estimated remaining: 7m 49s. Rate: 215.7 symbols/min [2025-09-29T02:00:32.067204] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:32.120055] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:32.128317] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:32.134317] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-29T02:00:32.134416] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-29T02:00:32.134506] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-29T02:00:32.150674] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-29T02:00:32.150409] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-29T02:00:32.161408] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-29T02:00:32.179796] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-29T02:00:32.166897] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-29T02:00:32.189437] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-29T02:00:32.189785] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-29T02:00:32.200670] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-29T02:00:32.200772] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-29T02:00:32.548017] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:32.577473] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-29T02:00:32.592815] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-29T02:00:32.610398] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-29T02:00:32.660868] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-29T02:00:32.679633] [DEBUG] [LOCAL ] ECC: Loaded 44025 existing records from primary storage. [2025-09-29T02:00:32.711480] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-29T02:00:32.739278] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-29T02:00:32.805607] [INFO ] [MAIN ] ECC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:32.824618] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECC took 1.4s. Estimated remaining: 7m 50s. Rate: 215.1 symbols/min [2025-09-29T02:00:33.664322] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:33.779907] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:33.759673] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-29T02:00:33.827493] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-29T02:00:33.856891] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:33.863581] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-29T02:00:33.891873] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-29T02:00:33.863963] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-29T02:00:33.893557] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-29T02:00:33.910502] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-29T02:00:33.943704] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-29T02:00:33.990447] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:34.050863] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-29T02:00:34.142456] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-29T02:00:34.165900] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-29T02:00:34.248801] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T02:00:34.299219] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-29T02:00:34.315070] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T02:00:34.324103] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-29T02:00:34.436518] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:34.440455] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T02:00:34.440829] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-29T02:00:34.442226] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-29T02:00:34.474554] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.15 seconds). [2025-09-29T02:00:34.475804] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-29T02:00:34.562913] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.12 seconds). [2025-09-29T02:00:34.569842] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-29T02:00:34.570250] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.13 seconds). [2025-09-29T02:00:34.573206] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-29T02:00:34.677756] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T02:00:34.679076] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-29T02:00:34.699025] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.13 seconds). [2025-09-29T02:00:34.700214] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-29T02:00:34.736764] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T02:00:34.738827] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-29T02:00:34.771548] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:00:34.773154] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-29T02:00:34.825599] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.13 seconds). [2025-09-29T02:00:34.826906] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-29T02:00:34.844262] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.17 seconds). [2025-09-29T02:00:34.845511] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-29T02:00:34.895013] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.12 seconds). [2025-09-29T02:00:34.896745] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-29T02:00:34.955729] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-29T02:00:34.957407] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-29T02:00:34.973147] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.13 seconds). [2025-09-29T02:00:34.974396] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-29T02:00:35.095770] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T02:00:35.097117] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-29T02:00:35.112113] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-29T02:00:35.113592] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-29T02:00:35.262126] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-29T02:00:35.263707] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-29T02:00:35.270890] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T02:00:35.273658] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-29T02:00:35.289385] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-09-29T02:00:35.290490] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-29T02:00:35.307889] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.19 seconds). [2025-09-29T02:00:35.309074] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-29T02:00:35.399286] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.14 seconds). [2025-09-29T02:00:35.400566] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-29T02:00:35.417399] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.13 seconds). [2025-09-29T02:00:35.418525] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-29T02:00:35.435717] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.13 seconds). [2025-09-29T02:00:35.436860] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-29T02:00:35.474027] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-29T02:00:35.475576] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-29T02:00:35.523265] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.12 seconds). [2025-09-29T02:00:35.524450] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-29T02:00:35.623479] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:00:35.624698] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-29T02:00:35.629451] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-09-29T02:00:35.630448] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-29T02:00:35.654535] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.13 seconds). [2025-09-29T02:00:35.655717] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-29T02:00:35.677468] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T02:00:35.678923] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-29T02:00:35.761330] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.13 seconds). [2025-09-29T02:00:35.762553] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-29T02:00:35.819310] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-29T02:00:35.820218] [INFO ] [REMOTE ] ECCC: Full fetch complete (1284 records). [2025-09-29T02:00:35.820375] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-29T02:00:35.902668] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-29T02:00:35.906475] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-29T02:00:35.920567] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.16 seconds). [2025-09-29T02:00:35.951061] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-29T02:00:35.931209] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-29T02:00:35.954711] [INFO ] [REMOTE ] ECCW: Full fetch complete (1420 records). [2025-09-29T02:00:35.981705] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-29T02:00:36.151511] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T02:00:36.164465] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:36.164616] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:36.164751] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-29T02:00:36.170668] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-29T02:00:36.195460] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-29T02:00:36.181088] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-29T02:00:36.202431] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-29T02:00:36.214582] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-29T02:00:36.263842] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCC took 4.8s. Estimated remaining: 7m 57s. Rate: 211.6 symbols/min [2025-09-29T02:00:36.277258] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-29T02:00:36.272841] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T02:00:36.282751] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:36.292996] [INFO ] [REMOTE ] ECCX: Full fetch complete (1503 records). [2025-09-29T02:00:36.307774] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:36.313104] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-29T02:00:36.313409] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-29T02:00:36.313293] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-29T02:00:36.349767] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-29T02:00:36.390163] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-29T02:00:36.413555] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCW took 4.3s. Estimated remaining: 7m 57s. Rate: 211.8 symbols/min [2025-09-29T02:00:36.548130] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T02:00:36.602521] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-29T02:00:36.699037] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:36.849100] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T02:00:36.923345] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:36.918580] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:36.924009] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:36.924119] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-29T02:00:36.924210] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-29T02:00:36.924361] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-29T02:00:36.924466] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-29T02:00:36.924632] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCX took 4.0s. Estimated remaining: 7m 57s. Rate: 211.5 symbols/min [2025-09-29T02:00:36.993007] [DEBUG] [LOCAL ] ECG: Loaded 34619 existing records from primary storage. [2025-09-29T02:00:37.034810] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T02:00:37.026430] [INFO ] [MAIN ] ECG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:37.065200] [INFO ] [REMOTE ] ECCU: Full fetch complete (4460 records). [2025-09-29T02:00:37.065485] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECG took 0.8s. Estimated remaining: 7m 56s. Rate: 211.7 symbols/min [2025-09-29T02:00:37.065742] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-29T02:00:37.257991] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:37.435135] [DEBUG] [LOCAL ] ECL: Loaded 47489 existing records from primary storage. [2025-09-29T02:00:37.527953] [INFO ] [MAIN ] ECL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:37.557082] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:37.582840] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECL took 1.1s. Estimated remaining: 7m 57s. Rate: 211.4 symbols/min [2025-09-29T02:00:37.610452] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:00:37.643358] [DEBUG] [LOCAL ] ECO: Loaded 18768 existing records from primary storage. [2025-09-29T02:00:37.666622] [INFO ] [MAIN ] ECO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:37.655632] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:37.672127] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:37.677523] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECO took 0.8s. Estimated remaining: 7m 56s. Rate: 211.6 symbols/min [2025-09-29T02:00:37.677799] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-29T02:00:37.694837] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-29T02:00:37.695156] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-29T02:00:37.712181] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-29T02:00:37.757490] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECCU took 6.3s. Estimated remaining: 7m 55s. Rate: 211.8 symbols/min [2025-09-29T02:00:38.124082] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:38.168062] [DEBUG] [LOCAL ] ECVT: Loaded 43587 existing records from primary storage. [2025-09-29T02:00:38.201795] [INFO ] [MAIN ] ECVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:38.189692] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:38.218804] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 1.2s. Estimated remaining: 7m 55s. Rate: 211.7 symbols/min [2025-09-29T02:00:38.501413] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:38.585260] [DEBUG] [LOCAL ] EDD: Loaded 27470 existing records from primary storage. [2025-09-29T02:00:38.594140] [INFO ] [MAIN ] EDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:38.594404] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDD took 0.9s. Estimated remaining: 7m 55s. Rate: 211.6 symbols/min [2025-09-29T02:00:38.825839] [DEBUG] [LOCAL ] ED: Loaded 53539 existing records from primary storage. [2025-09-29T02:00:38.875252] [INFO ] [MAIN ] ED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:38.925604] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:38.818470] [DEBUG] [LOCAL ] EDF: Loaded 13627 existing records from primary storage. [2025-09-29T02:00:38.931939] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. ED took 1.3s. Estimated remaining: 7m 55s. Rate: 211.5 symbols/min [2025-09-29T02:00:38.949101] [INFO ] [MAIN ] EDF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:38.976607] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDF took 1.2s. Estimated remaining: 7m 54s. Rate: 211.8 symbols/min [2025-09-29T02:00:39.342515] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:39.364029] [DEBUG] [LOCAL ] EDN: Loaded 18501 existing records from primary storage. [2025-09-29T02:00:39.481140] [INFO ] [MAIN ] EDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:39.506918] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:39.563361] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:39.563861] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-29T02:00:39.536315] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 1.3s. Estimated remaining: 7m 55s. Rate: 211.5 symbols/min [2025-09-29T02:00:39.594510] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-29T02:00:39.595003] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-29T02:00:39.607694] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-29T02:00:39.632935] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-29T02:00:39.655269] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-29T02:00:39.870734] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:40.015553] [DEBUG] [LOCAL ] EDU: Loaded 45666 existing records from primary storage. [2025-09-29T02:00:40.036745] [DEBUG] [LOCAL ] EE: Loaded 32973 existing records from primary storage. [2025-09-29T02:00:40.057138] [INFO ] [MAIN ] EDU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.096685] [DEBUG] [LOCAL ] EEX: Loaded 12042 existing records from primary storage. [2025-09-29T02:00:40.083954] [INFO ] [MAIN ] EE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.085411] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EDU took 1.5s. Estimated remaining: 7m 55s. Rate: 211.2 symbols/min [2025-09-29T02:00:40.115202] [INFO ] [MAIN ] EEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.120469] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EE took 1.2s. Estimated remaining: 7m 54s. Rate: 211.4 symbols/min [2025-09-29T02:00:40.198686] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEX took 0.6s. Estimated remaining: 7m 53s. Rate: 211.7 symbols/min [2025-09-29T02:00:40.599592] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:40.649607] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-29T02:00:40.730373] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:40.776727] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:40.847954] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:40.866041] [DEBUG] [LOCAL ] EFR: Loaded 14474 existing records from primary storage. [2025-09-29T02:00:40.869586] [INFO ] [MAIN ] EFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.869760] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFR took 0.7s. Estimated remaining: 7m 54s. Rate: 211.2 symbols/min [2025-09-29T02:00:40.927140] [DEBUG] [LOCAL ] EFT: Loaded 12857 existing records from primary storage. [2025-09-29T02:00:40.959823] [INFO ] [MAIN ] EFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.973104] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFT took 0.8s. Estimated remaining: 7m 53s. Rate: 211.4 symbols/min [2025-09-29T02:00:41.166803] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T02:00:41.218446] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-29T02:00:41.212426] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:41.248095] [DEBUG] [LOCAL ] EFC: Loaded 46944 existing records from primary storage. [2025-09-29T02:00:41.259290] [INFO ] [MAIN ] EFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:41.284857] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFC took 1.2s. Estimated remaining: 7m 53s. Rate: 211.4 symbols/min [2025-09-29T02:00:41.345267] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:41.525745] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:41.552627] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T02:00:41.558245] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-29T02:00:41.584919] [DEBUG] [LOCAL ] EFXT: Loaded 29755 existing records from primary storage. [2025-09-29T02:00:41.586123] [DEBUG] [LOCAL ] EFX: Loaded 45419 existing records from primary storage. [2025-09-29T02:00:41.586688] [INFO ] [MAIN ] EFXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:41.586792] [INFO ] [MAIN ] EFX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:41.587250] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFXT took 0.6s. Estimated remaining: 7m 53s. Rate: 211.4 symbols/min [2025-09-29T02:00:41.593811] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFX took 0.7s. Estimated remaining: 7m 52s. Rate: 211.7 symbols/min [2025-09-29T02:00:41.827739] [DEBUG] [LOCAL ] EG: Loaded 29024 existing records from primary storage. [2025-09-29T02:00:41.864923] [INFO ] [MAIN ] EG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:41.926429] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EG took 0.6s. Estimated remaining: 7m 52s. Rate: 211.6 symbols/min [2025-09-29T02:00:41.954362] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T02:00:41.955490] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:41.957340] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-29T02:00:42.162284] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:42.262160] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:42.299992] [DEBUG] [LOCAL ] EGO: Loaded 52295 existing records from primary storage. [2025-09-29T02:00:42.311899] [INFO ] [MAIN ] EGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:42.314696] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGO took 0.7s. Estimated remaining: 7m 52s. Rate: 211.5 symbols/min [2025-09-29T02:00:42.315533] [DEBUG] [LOCAL ] EGP: Loaded 31536 existing records from primary storage. [2025-09-29T02:00:42.350092] [INFO ] [MAIN ] EGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:42.369484] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGP took 0.8s. Estimated remaining: 7m 51s. Rate: 211.8 symbols/min [2025-09-29T02:00:42.537633] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T02:00:42.569573] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-29T02:00:42.557138] [DEBUG] [LOCAL ] EGY: Loaded 42824 existing records from primary storage. [2025-09-29T02:00:42.679254] [INFO ] [MAIN ] EGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:42.684832] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:42.697317] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGY took 0.7s. Estimated remaining: 7m 51s. Rate: 211.7 symbols/min [2025-09-29T02:00:42.828132] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:42.999728] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:43.001071] [DEBUG] [LOCAL ] EHAB: Loaded 30257 existing records from primary storage. [2025-09-29T02:00:43.001853] [INFO ] [MAIN ] EHAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:43.002246] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EHAB took 0.7s. Estimated remaining: 7m 50s. Rate: 211.7 symbols/min [2025-09-29T02:00:43.057846] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T02:00:43.097043] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-29T02:00:43.146117] [DEBUG] [LOCAL ] EHI: Loaded 10472 existing records from primary storage. [2025-09-29T02:00:43.159526] [INFO ] [MAIN ] EHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:43.160007] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHI took 0.4s. Estimated remaining: 7m 50s. Rate: 211.8 symbols/min [2025-09-29T02:00:43.242921] [DEBUG] [LOCAL ] EHC: Loaded 41849 existing records from primary storage. [2025-09-29T02:00:43.291695] [INFO ] [MAIN ] EHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:43.292487] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHC took 0.9s. Estimated remaining: 7m 49s. Rate: 212.0 symbols/min [2025-09-29T02:00:43.311961] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:43.490818] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T02:00:43.541682] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-29T02:00:43.580055] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:43.607898] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-29T02:00:43.637284] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-29T02:00:43.658577] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-29T02:00:43.660450] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:43.668895] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-29T02:00:43.670283] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-29T02:00:43.671012] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-29T02:00:43.671887] [DEBUG] [LOCAL ] EIC: Loaded 24238 existing records from primary storage. [2025-09-29T02:00:43.671084] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-29T02:00:43.672349] [INFO ] [MAIN ] EIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:43.672186] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-29T02:00:43.672636] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-29T02:00:43.672736] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EIC took 0.7s. Estimated remaining: 7m 49s. Rate: 211.9 symbols/min [2025-09-29T02:00:43.690486] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-29T02:00:43.737287] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-29T02:00:43.870057] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-29T02:00:43.964270] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-29T02:00:44.072801] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-29T02:00:44.301897] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:44.599277] [DEBUG] [LOCAL ] EICC: Loaded 6245 existing records from primary storage. [2025-09-29T02:00:44.650468] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:44.667515] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T02:00:44.663712] [INFO ] [MAIN ] EICC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:44.670442] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EICC took 1.0s. Estimated remaining: 7m 51s. Rate: 211.1 symbols/min [2025-09-29T02:00:44.668022] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-29T02:00:44.669887] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-29T02:00:44.873354] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:44.876767] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-29T02:00:44.956687] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:44.981448] [DEBUG] [LOCAL ] EIG: Loaded 20519 existing records from primary storage. [2025-09-29T02:00:44.983907] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-29T02:00:44.985029] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-29T02:00:44.985286] [INFO ] [MAIN ] EIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:44.986263] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EIG took 0.3s. Estimated remaining: 7m 50s. Rate: 211.1 symbols/min [2025-09-29T02:00:45.106788] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T02:00:45.129611] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-29T02:00:45.192437] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:45.205729] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T02:00:45.207054] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-29T02:00:45.262406] [DEBUG] [LOCAL ] EIX: Loaded 54113 existing records from primary storage. [2025-09-29T02:00:45.262844] [INFO ] [MAIN ] EIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:45.263617] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EIX took 0.3s. Estimated remaining: 7m 50s. Rate: 211.1 symbols/min [2025-09-29T02:00:45.304733] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-09-29T02:00:45.305791] [INFO ] [REMOTE ] EEA: Full fetch complete (3967 records). [2025-09-29T02:00:45.305889] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-29T02:00:45.371705] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-29T02:00:45.402471] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-29T02:00:45.485115] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T02:00:45.521889] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-29T02:00:45.565423] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:00:45.565846] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:45.565923] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:45.566003] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-29T02:00:45.566106] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-29T02:00:45.566178] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-29T02:00:45.566260] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-29T02:00:45.566385] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EEA took 6.5s. Estimated remaining: 7m 50s. Rate: 211.1 symbols/min [2025-09-29T02:00:45.618688] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-29T02:00:45.619864] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-29T02:00:45.756309] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-29T02:00:45.757819] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-29T02:00:45.820467] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:00:45.821510] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-29T02:00:46.027435] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:00:46.028698] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-29T02:00:46.147471] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.12 seconds). [2025-09-29T02:00:46.148758] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-29T02:00:46.200951] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T02:00:46.202210] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-29T02:00:46.270324] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.12 seconds). [2025-09-29T02:00:46.271441] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-29T02:00:46.415687] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:00:46.417247] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-29T02:00:46.472086] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:00:46.473313] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-29T02:00:46.666319] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-09-29T02:00:46.667480] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-29T02:00:46.692748] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T02:00:46.694432] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-29T02:00:46.864366] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:00:46.865267] [INFO ] [REMOTE ] EICA: Full fetch complete (1269 records). [2025-09-29T02:00:46.865376] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-29T02:00:46.985892] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-29T02:00:46.993205] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-29T02:00:47.081876] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:00:47.082116] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:47.082190] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:47.082267] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-29T02:00:47.082366] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-29T02:00:47.082439] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-29T02:00:47.082541] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-29T02:00:47.082660] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EICA took 3.9s. Estimated remaining: 7m 52s. Rate: 209.8 symbols/min [2025-09-29T02:00:47.330194] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-29T02:00:47.331605] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-29T02:00:47.607223] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-29T02:00:47.608637] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-29T02:00:47.745224] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.14 seconds). [2025-09-29T02:00:47.746361] [INFO ] [REMOTE ] EICB: Full fetch complete (2692 records). [2025-09-29T02:00:47.746460] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-29T02:00:47.947624] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:00:47.947860] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:47.947935] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:47.948014] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-29T02:00:47.948118] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-29T02:00:47.948228] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-29T02:00:47.948317] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-29T02:00:47.948416] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EICB took 4.6s. Estimated remaining: 7m 53s. Rate: 209.2 symbols/min [2025-09-29T02:00:48.543232] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:48.691771] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:48.692862] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:48.723405] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:48.736930] [DEBUG] [LOCAL ] ELC: Loaded 3512 existing records from primary storage. [2025-09-29T02:00:48.737491] [INFO ] [MAIN ] ELC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:48.737670] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 0.8s. Estimated remaining: 7m 54s. Rate: 208.7 symbols/min [2025-09-29T02:00:48.996567] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:49.043180] [DEBUG] [LOCAL ] EL: Loaded 54177 existing records from primary storage. [2025-09-29T02:00:49.060176] [DEBUG] [LOCAL ] ELF: Loaded 53037 existing records from primary storage. [2025-09-29T02:00:49.059157] [INFO ] [MAIN ] EL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.061178] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. EL took 1.1s. Estimated remaining: 7m 54s. Rate: 208.7 symbols/min [2025-09-29T02:00:49.061329] [INFO ] [MAIN ] ELF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.063358] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELF took 1.1s. Estimated remaining: 7m 53s. Rate: 209.0 symbols/min [2025-09-29T02:00:49.062746] [DEBUG] [LOCAL ] ELAN: Loaded 53985 existing records from primary storage. [2025-09-29T02:00:49.122721] [INFO ] [MAIN ] ELAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.155149] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELAN took 1.2s. Estimated remaining: 7m 52s. Rate: 209.2 symbols/min [2025-09-29T02:00:49.460269] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:49.512263] [DEBUG] [LOCAL ] ELME: Loaded 39817 existing records from primary storage. [2025-09-29T02:00:49.525061] [INFO ] [MAIN ] ELME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.564322] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELME took 0.8s. Estimated remaining: 7m 52s. Rate: 209.1 symbols/min [2025-09-29T02:00:49.712459] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:49.705056] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:49.767150] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-29T02:00:49.759333] [DEBUG] [LOCAL ] ELP: Loaded 26107 existing records from primary storage. [2025-09-29T02:00:49.810830] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-29T02:00:49.825081] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-29T02:00:49.825220] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-29T02:00:49.810591] [INFO ] [MAIN ] ELP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.825875] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELP took 0.8s. Estimated remaining: 7m 52s. Rate: 209.1 symbols/min [2025-09-29T02:00:49.846622] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-29T02:00:49.852036] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-29T02:00:49.991797] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:50.301621] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:50.350434] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-29T02:00:50.379880] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-29T02:00:50.380227] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-29T02:00:50.380330] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-29T02:00:50.388478] [DEBUG] [LOCAL ] ELS: Loaded 50110 existing records from primary storage. [2025-09-29T02:00:50.399314] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-29T02:00:50.401124] [INFO ] [MAIN ] ELS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:50.401763] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELS took 1.2s. Estimated remaining: 7m 52s. Rate: 208.8 symbols/min [2025-09-29T02:00:50.401338] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-29T02:00:50.618103] [DEBUG] [LOCAL ] ELV: Loaded 51334 existing records from primary storage. [2025-09-29T02:00:50.756668] [INFO ] [MAIN ] ELV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:50.821861] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELV took 1.2s. Estimated remaining: 7m 52s. Rate: 208.7 symbols/min [2025-09-29T02:00:50.893973] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:50.962842] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-29T02:00:51.022575] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:51.338426] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T02:00:51.345551] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:51.348582] [DEBUG] [LOCAL ] EMD: Loaded 21338 existing records from primary storage. [2025-09-29T02:00:51.347205] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-29T02:00:51.361050] [INFO ] [MAIN ] EMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:51.368744] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. EMD took 0.9s. Estimated remaining: 7m 53s. Rate: 208.4 symbols/min [2025-09-29T02:00:51.556992] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:51.597243] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-29T02:00:51.690815] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:51.692078] [DEBUG] [LOCAL ] EME: Loaded 32035 existing records from primary storage. [2025-09-29T02:00:51.697009] [INFO ] [MAIN ] EME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:51.697219] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-29T02:00:51.697483] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. EME took 0.8s. Estimated remaining: 7m 53s. Rate: 208.4 symbols/min [2025-09-29T02:00:51.700408] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-29T02:00:51.746245] [DEBUG] [LOCAL ] EMF: Loaded 3575 existing records from primary storage. [2025-09-29T02:00:51.760894] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:00:51.768170] [INFO ] [MAIN ] EMF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:51.799049] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-29T02:00:51.793554] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMF took 0.4s. Estimated remaining: 7m 52s. Rate: 208.5 symbols/min [2025-09-29T02:00:51.814016] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:00:51.856689] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-09-29T02:00:51.897942] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:00:51.924678] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-29T02:00:51.898176] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T02:00:51.962316] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-29T02:00:51.972902] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-29T02:00:51.996022] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-29T02:00:52.000432] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:52.000768] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-29T02:00:52.035857] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMA took 2.2s. Estimated remaining: 7m 51s. Rate: 208.6 symbols/min [2025-09-29T02:00:52.232098] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:52.250929] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-29T02:00:52.253157] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-29T02:00:52.349323] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:52.365141] [DEBUG] [LOCAL ] EMO: Loaded 12656 existing records from primary storage. [2025-09-29T02:00:52.365674] [INFO ] [MAIN ] EMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:52.365986] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMO took 0.5s. Estimated remaining: 7m 51s. Rate: 208.6 symbols/min [2025-09-29T02:00:52.431201] [DEBUG] [LOCAL ] EMP: Loaded 3062 existing records from primary storage. [2025-09-29T02:00:52.489369] [INFO ] [MAIN ] EMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:52.504179] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMP took 0.5s. Estimated remaining: 7m 51s. Rate: 208.7 symbols/min [2025-09-29T02:00:52.511795] [DEBUG] [LOCAL ] EMN: Loaded 51117 existing records from primary storage. [2025-09-29T02:00:52.551081] [INFO ] [MAIN ] EMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:52.596533] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 0.9s. Estimated remaining: 7m 50s. Rate: 208.9 symbols/min [2025-09-29T02:00:52.616934] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T02:00:52.645766] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-29T02:00:52.678570] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:52.939537] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.002124] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.028991] [DEBUG] [LOCAL ] ENFY: Loaded 3106 existing records from primary storage. [2025-09-29T02:00:53.031828] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T02:00:53.033228] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-29T02:00:53.034847] [INFO ] [MAIN ] ENFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.035008] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. ENFY took 0.4s. Estimated remaining: 7m 50s. Rate: 208.7 symbols/min [2025-09-29T02:00:53.162231] [DEBUG] [LOCAL ] EMR: Loaded 54027 existing records from primary storage. [2025-09-29T02:00:53.186915] [INFO ] [MAIN ] EMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.204867] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMR took 0.8s. Estimated remaining: 7m 49s. Rate: 208.9 symbols/min [2025-09-29T02:00:53.294050] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-29T02:00:53.285771] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.325564] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-29T02:00:53.455602] [DEBUG] [LOCAL ] ENB: Loaded 54295 existing records from primary storage. [2025-09-29T02:00:53.495022] [INFO ] [MAIN ] ENB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.520127] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENB took 1.0s. Estimated remaining: 7m 49s. Rate: 208.8 symbols/min [2025-09-29T02:00:53.544831] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.611395] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-29T02:00:53.675390] [DEBUG] [LOCAL ] ENIC: Loaded 36910 existing records from primary storage. [2025-09-29T02:00:53.682301] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-29T02:00:53.689957] [INFO ] [MAIN ] ENIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.696012] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 0.7s. Estimated remaining: 7m 49s. Rate: 208.9 symbols/min [2025-09-29T02:00:53.729380] [DEBUG] [LOCAL ] ENO: Loaded 1952 existing records from primary storage. [2025-09-29T02:00:53.833463] [INFO ] [MAIN ] ENO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.876471] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENO took 0.6s. Estimated remaining: 7m 48s. Rate: 209.0 symbols/min [2025-09-29T02:00:53.897665] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.966003] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-29T02:00:53.973474] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-29T02:00:54.197525] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-29T02:00:54.194627] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:54.206371] [INFO ] [REMOTE ] ELPC: Full fetch complete (1481 records). [2025-09-29T02:00:54.220917] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-29T02:00:54.387716] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:54.414392] [DEBUG] [LOCAL ] ENOV: Loaded 45799 existing records from primary storage. [2025-09-29T02:00:54.459018] [INFO ] [MAIN ] ENOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:54.503813] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENOV took 1.0s. Estimated remaining: 7m 49s. Rate: 208.7 symbols/min [2025-09-29T02:00:54.552837] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:00:54.565616] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:54.583175] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:54.618248] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-29T02:00:54.612990] [DEBUG] [LOCAL ] ENR: Loaded 43336 existing records from primary storage. [2025-09-29T02:00:54.647944] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-29T02:00:54.664487] [INFO ] [MAIN ] ENR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:54.685741] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-29T02:00:54.686171] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENR took 1.0s. Estimated remaining: 7m 48s. Rate: 208.8 symbols/min [2025-09-29T02:00:54.706079] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-29T02:00:54.722484] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ELPC took 5.6s. Estimated remaining: 7m 47s. Rate: 209.1 symbols/min [2025-09-29T02:00:54.786623] [DEBUG] [LOCAL ] ENS: Loaded 29869 existing records from primary storage. [2025-09-29T02:00:54.818059] [INFO ] [MAIN ] ENS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:54.850030] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENS took 0.9s. Estimated remaining: 7m 47s. Rate: 209.2 symbols/min [2025-09-29T02:00:55.012600] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:55.235631] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:55.325160] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:55.436721] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:55.438084] [DEBUG] [LOCAL ] ENVA: Loaded 25914 existing records from primary storage. [2025-09-29T02:00:55.439103] [INFO ] [MAIN ] ENVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:55.445771] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENVA took 0.9s. Estimated remaining: 7m 47s. Rate: 208.9 symbols/min [2025-09-29T02:00:55.448793] [DEBUG] [LOCAL ] EOD: Loaded 14232 existing records from primary storage. [2025-09-29T02:00:55.472750] [INFO ] [MAIN ] EOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:55.473007] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOD took 0.8s. Estimated remaining: 7m 46s. Rate: 209.2 symbols/min [2025-09-29T02:00:55.652926] [DEBUG] [LOCAL ] EOI: Loaded 10783 existing records from primary storage. [2025-09-29T02:00:55.679752] [INFO ] [MAIN ] EOI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:55.702776] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOI took 0.8s. Estimated remaining: 7m 46s. Rate: 209.2 symbols/min [2025-09-29T02:00:55.947949] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-29T02:00:56.033095] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.109369] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.125490] [INFO ] [MAIN ] EOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:56.175869] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOG took 1.4s. Estimated remaining: 7m 46s. Rate: 209.0 symbols/min [2025-09-29T02:00:56.181198] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.307922] [DEBUG] [LOCAL ] EOS: Loaded 15589 existing records from primary storage. [2025-09-29T02:00:56.300945] [DEBUG] [LOCAL ] EOT: Loaded 6916 existing records from primary storage. [2025-09-29T02:00:56.321092] [INFO ] [MAIN ] EOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:56.330270] [INFO ] [MAIN ] EOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:56.346768] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOT took 0.9s. Estimated remaining: 7m 45s. Rate: 209.2 symbols/min [2025-09-29T02:00:56.390524] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOS took 0.9s. Estimated remaining: 7m 44s. Rate: 209.4 symbols/min [2025-09-29T02:00:56.469246] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.524798] [DEBUG] [LOCAL ] EPAC: Loaded 27416 existing records from primary storage. [2025-09-29T02:00:56.539639] [INFO ] [MAIN ] EPAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:56.640458] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 0.9s. Estimated remaining: 7m 44s. Rate: 209.4 symbols/min [2025-09-29T02:00:56.860857] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.907154] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:57.065624] [DEBUG] [LOCAL ] EPAM: Loaded 40450 existing records from primary storage. [2025-09-29T02:00:57.067963] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:57.069265] [INFO ] [MAIN ] EPAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:57.069726] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPAM took 0.9s. Estimated remaining: 7m 44s. Rate: 209.3 symbols/min [2025-09-29T02:00:57.258349] [DEBUG] [LOCAL ] EPC: Loaded 40383 existing records from primary storage. [2025-09-29T02:00:57.326760] [INFO ] [MAIN ] EPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:57.357400] [DEBUG] [LOCAL ] EPD: Loaded 54389 existing records from primary storage. [2025-09-29T02:00:57.383880] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:57.384482] [INFO ] [MAIN ] EPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:57.384819] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPC took 1.0s. Estimated remaining: 7m 44s. Rate: 209.3 symbols/min [2025-09-29T02:00:57.398702] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 1.0s. Estimated remaining: 7m 43s. Rate: 209.5 symbols/min [2025-09-29T02:00:57.561063] [DEBUG] [LOCAL ] EPR: Loaded 44722 existing records from primary storage. [2025-09-29T02:00:57.603627] [INFO ] [MAIN ] EPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:57.649167] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 1.0s. Estimated remaining: 7m 43s. Rate: 209.6 symbols/min [2025-09-29T02:00:57.859497] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:57.965597] [DEBUG] [LOCAL ] EPRT: Loaded 49306 existing records from primary storage. [2025-09-29T02:00:58.006313] [INFO ] [MAIN ] EPRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.090037] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPRT took 1.0s. Estimated remaining: 7m 43s. Rate: 209.4 symbols/min [2025-09-29T02:00:58.099157] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:58.171181] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:58.183772] [DEBUG] [LOCAL ] EQBK: Loaded 11050 existing records from primary storage. [2025-09-29T02:00:58.198057] [INFO ] [MAIN ] EQBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.239150] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EQBK took 0.9s. Estimated remaining: 7m 42s. Rate: 209.5 symbols/min [2025-09-29T02:00:58.367558] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:58.448834] [DEBUG] [LOCAL ] EQH: Loaded 53435 existing records from primary storage. [2025-09-29T02:00:58.449417] [INFO ] [MAIN ] EQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.449926] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 1.0s. Estimated remaining: 7m 42s. Rate: 209.6 symbols/min [2025-09-29T02:00:58.451821] [DEBUG] [LOCAL ] EQNR: Loaded 53809 existing records from primary storage. [2025-09-29T02:00:58.452603] [INFO ] [MAIN ] EQNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.453251] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 0.8s. Estimated remaining: 7m 41s. Rate: 209.9 symbols/min [2025-09-29T02:00:58.496090] [DEBUG] [LOCAL ] EQR: Loaded 52190 existing records from primary storage. [2025-09-29T02:00:58.496497] [INFO ] [MAIN ] EQR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.496794] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 0.4s. Estimated remaining: 7m 40s. Rate: 210.1 symbols/min [2025-09-29T02:00:59.168084] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:59.242907] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-29T02:00:59.272959] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-29T02:00:59.200553] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:59.297393] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-29T02:00:59.297145] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:59.297787] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-29T02:00:59.293380] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:59.298664] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-29T02:00:59.298796] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-29T02:00:59.376361] [DEBUG] [LOCAL ] EQV: Loaded 2840 existing records from primary storage. [2025-09-29T02:00:59.398437] [INFO ] [MAIN ] EQV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:59.420528] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 0.9s. Estimated remaining: 7m 41s. Rate: 209.5 symbols/min [2025-09-29T02:00:59.848113] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-09-29T02:00:59.875702] [DEBUG] [LOCAL ] ERJ: Loaded 51477 existing records from primary storage. [2025-09-29T02:00:59.882762] [INFO ] [MAIN ] ERJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:59.892709] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. ERJ took 1.4s. Estimated remaining: 7m 41s. Rate: 209.3 symbols/min [2025-09-29T02:00:59.886760] [INFO ] [MAIN ] EQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:59.931958] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQT took 1.4s. Estimated remaining: 7m 40s. Rate: 209.6 symbols/min [2025-09-29T02:00:59.931349] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.087797] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:00.159432] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-29T02:01:00.377086] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.413139] [DEBUG] [LOCAL ] ERO: Loaded 41901 existing records from primary storage. [2025-09-29T02:01:00.444329] [INFO ] [MAIN ] ERO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:00.443999] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.444524] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ERO took 1.0s. Estimated remaining: 7m 41s. Rate: 209.4 symbols/min [2025-09-29T02:01:00.583189] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T02:01:00.600811] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-29T02:01:00.672633] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.674312] [DEBUG] [LOCAL ] ESAB: Loaded 26683 existing records from primary storage. [2025-09-29T02:01:00.690751] [INFO ] [MAIN ] ESAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:00.690892] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ESAB took 0.8s. Estimated remaining: 7m 40s. Rate: 209.4 symbols/min [2025-09-29T02:01:00.835333] [DEBUG] [LOCAL ] ES: Loaded 53309 existing records from primary storage. [2025-09-29T02:01:00.836424] [INFO ] [MAIN ] ES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:00.875474] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 1.0s. Estimated remaining: 7m 40s. Rate: 209.5 symbols/min [2025-09-29T02:01:00.937134] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.937399] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T02:01:00.938215] [DEBUG] [LOCAL ] ESE: Loaded 16878 existing records from primary storage. [2025-09-29T02:01:00.979632] [INFO ] [MAIN ] ESE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:00.996142] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESE took 0.6s. Estimated remaining: 7m 39s. Rate: 209.6 symbols/min [2025-09-29T02:01:00.963318] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-29T02:01:01.279386] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T02:01:01.287067] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:01.325164] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-29T02:01:01.395027] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:01.414480] [DEBUG] [LOCAL ] ESI: Loaded 51566 existing records from primary storage. [2025-09-29T02:01:01.414981] [INFO ] [MAIN ] ESI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:01.415604] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESI took 0.7s. Estimated remaining: 7m 39s. Rate: 209.5 symbols/min [2025-09-29T02:01:01.549423] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-29T02:01:01.562074] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-29T02:01:01.655359] [DEBUG] [LOCAL ] ESNT: Loaded 39065 existing records from primary storage. [2025-09-29T02:01:01.661550] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:01.662540] [INFO ] [MAIN ] ESNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:01.663394] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESNT took 0.7s. Estimated remaining: 7m 39s. Rate: 209.6 symbols/min [2025-09-29T02:01:01.788225] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-09-29T02:01:01.817825] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-29T02:01:01.818030] [INFO ] [MAIN ] ESRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:01.840063] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESRT took 0.8s. Estimated remaining: 7m 38s. Rate: 209.7 symbols/min [2025-09-29T02:01:01.841962] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-29T02:01:01.949367] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:02.006336] [DEBUG] [LOCAL ] ESS: Loaded 30441 existing records from primary storage. [2025-09-29T02:01:02.018192] [INFO ] [MAIN ] ESS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:02.037863] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESS took 0.6s. Estimated remaining: 7m 38s. Rate: 209.7 symbols/min [2025-09-29T02:01:02.183601] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:02.204143] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T02:01:02.232215] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-29T02:01:02.332780] [DEBUG] [LOCAL ] ESTC: Loaded 50744 existing records from primary storage. [2025-09-29T02:01:02.373044] [INFO ] [MAIN ] ESTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:02.404224] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:02.404613] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESTC took 0.7s. Estimated remaining: 7m 38s. Rate: 209.7 symbols/min [2025-09-29T02:01:02.532095] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-29T02:01:02.545692] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-29T02:01:02.592758] [DEBUG] [LOCAL ] ETB: Loaded 12181 existing records from primary storage. [2025-09-29T02:01:02.605604] [INFO ] [MAIN ] ETB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:02.667134] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:02.667274] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 0.6s. Estimated remaining: 7m 37s. Rate: 209.7 symbols/min [2025-09-29T02:01:02.683025] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-29T02:01:02.713110] [INFO ] [MAIN ] ET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:02.749307] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ET took 0.9s. Estimated remaining: 7m 37s. Rate: 209.9 symbols/min [2025-09-29T02:01:02.838522] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-29T02:01:02.871774] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-29T02:01:03.067183] [DEBUG] [LOCAL ] ETD: Loaded 27661 existing records from primary storage. [2025-09-29T02:01:03.079090] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.084385] [INFO ] [MAIN ] ETD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.106586] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETD took 0.7s. Estimated remaining: 7m 36s. Rate: 209.8 symbols/min [2025-09-29T02:01:03.240933] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.297175] [DEBUG] [LOCAL ] ETG: Loaded 16710 existing records from primary storage. [2025-09-29T02:01:03.313998] [INFO ] [MAIN ] ETG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.321207] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETG took 0.7s. Estimated remaining: 7m 36s. Rate: 209.9 symbols/min [2025-09-29T02:01:03.384170] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.410450] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T02:01:03.425934] [DEBUG] [LOCAL ] ETJ: Loaded 16938 existing records from primary storage. [2025-09-29T02:01:03.439610] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-29T02:01:03.479380] [INFO ] [MAIN ] ETJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.513419] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETJ took 0.7s. Estimated remaining: 7m 35s. Rate: 210.0 symbols/min [2025-09-29T02:01:03.687465] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.826151] [DEBUG] [LOCAL ] ETO: Loaded 6600 existing records from primary storage. [2025-09-29T02:01:03.831600] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.832216] [INFO ] [MAIN ] ETO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.832518] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETO took 0.4s. Estimated remaining: 7m 35s. Rate: 209.9 symbols/min [2025-09-29T02:01:03.946254] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T02:01:03.954726] [DEBUG] [LOCAL ] ETN: Loaded 53593 existing records from primary storage. [2025-09-29T02:01:03.955894] [INFO ] [REMOTE ] EQS: Full fetch complete (2522 records). [2025-09-29T02:01:03.986058] [INFO ] [MAIN ] ETN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.986250] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-29T02:01:03.993024] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETN took 0.9s. Estimated remaining: 7m 35s. Rate: 210.1 symbols/min [2025-09-29T02:01:04.289439] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:04.436802] [DEBUG] [LOCAL ] ETR: Loaded 54001 existing records from primary storage. [2025-09-29T02:01:04.479709] [INFO ] [MAIN ] ETR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:04.461559] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-29T02:01:04.523446] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETR took 1.0s. Estimated remaining: 7m 35s. Rate: 209.8 symbols/min [2025-09-29T02:01:04.501245] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:01:04.524464] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:04.543415] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:01:04.598979] [DEBUG] [LOCAL ] ETV: Loaded 21729 existing records from primary storage. [2025-09-29T02:01:04.583969] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-29T02:01:04.619867] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-29T02:01:04.637182] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-29T02:01:04.660441] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-29T02:01:04.649009] [INFO ] [MAIN ] ETV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:04.660622] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETV took 0.8s. Estimated remaining: 7m 34s. Rate: 210.0 symbols/min [2025-09-29T02:01:04.666464] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. EQS took 6.2s. Estimated remaining: 7m 34s. Rate: 210.2 symbols/min [2025-09-29T02:01:04.869100] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:04.921972] [DEBUG] [LOCAL ] ETW: Loaded 25463 existing records from primary storage. [2025-09-29T02:01:04.933145] [INFO ] [MAIN ] ETW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.003638] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETW took 1.0s. Estimated remaining: 7m 33s. Rate: 210.2 symbols/min [2025-09-29T02:01:05.083887] [DEBUG] [LOCAL ] ETX: Loaded 5028 existing records from primary storage. [2025-09-29T02:01:05.221491] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:05.266439] [INFO ] [MAIN ] ETX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.256532] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:05.283312] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETX took 0.8s. Estimated remaining: 7m 33s. Rate: 210.2 symbols/min [2025-09-29T02:01:05.497102] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:05.551980] [DEBUG] [LOCAL ] ETY: Loaded 23078 existing records from primary storage. [2025-09-29T02:01:05.553923] [DEBUG] [LOCAL ] EVC: Loaded 19415 existing records from primary storage. [2025-09-29T02:01:05.575788] [INFO ] [MAIN ] ETY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.582262] [INFO ] [MAIN ] EVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.606569] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETY took 0.9s. Estimated remaining: 7m 33s. Rate: 210.2 symbols/min [2025-09-29T02:01:05.650719] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:05.645455] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 0.9s. Estimated remaining: 7m 32s. Rate: 210.4 symbols/min [2025-09-29T02:01:05.877671] [DEBUG] [LOCAL ] EVEX: Loaded 30549 existing records from primary storage. [2025-09-29T02:01:05.948619] [INFO ] [MAIN ] EVEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.968582] [DEBUG] [LOCAL ] EVF: Loaded 9501 existing records from primary storage. [2025-09-29T02:01:05.990434] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVEX took 0.9s. Estimated remaining: 7m 32s. Rate: 210.3 symbols/min [2025-09-29T02:01:05.995580] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.001454] [INFO ] [MAIN ] EVF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:06.012561] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVF took 0.7s. Estimated remaining: 7m 31s. Rate: 210.6 symbols/min [2025-09-29T02:01:06.226999] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.282392] [DEBUG] [LOCAL ] EVG: Loaded 5862 existing records from primary storage. [2025-09-29T02:01:06.334947] [INFO ] [MAIN ] EVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:06.347376] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVG took 0.7s. Estimated remaining: 7m 31s. Rate: 210.5 symbols/min [2025-09-29T02:01:06.534806] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.573405] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.669402] [DEBUG] [LOCAL ] EVN: Loaded 11217 existing records from primary storage. [2025-09-29T02:01:06.670010] [INFO ] [MAIN ] EVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:06.670278] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVN took 0.7s. Estimated remaining: 7m 31s. Rate: 210.5 symbols/min [2025-09-29T02:01:06.836162] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.898626] [DEBUG] [LOCAL ] EVH: Loaded 50111 existing records from primary storage. [2025-09-29T02:01:06.914497] [INFO ] [MAIN ] EVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:06.915209] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 1.2s. Estimated remaining: 7m 30s. Rate: 210.5 symbols/min [2025-09-29T02:01:07.007382] [DEBUG] [LOCAL ] EVR: Loaded 35882 existing records from primary storage. [2025-09-29T02:01:07.035734] [INFO ] [MAIN ] EVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:07.099924] [DEBUG] [LOCAL ] EVT: Loaded 17270 existing records from primary storage. [2025-09-29T02:01:07.109727] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 1.1s. Estimated remaining: 7m 30s. Rate: 210.6 symbols/min [2025-09-29T02:01:07.109597] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.152881] [INFO ] [MAIN ] EVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:07.164132] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 0.8s. Estimated remaining: 7m 29s. Rate: 210.8 symbols/min [2025-09-29T02:01:07.475362] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.624974] [DEBUG] [LOCAL ] EVTC: Loaded 26745 existing records from primary storage. [2025-09-29T02:01:07.645741] [INFO ] [MAIN ] EVTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:07.657386] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.647062] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.659778] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 1.0s. Estimated remaining: 7m 29s. Rate: 210.6 symbols/min [2025-09-29T02:01:07.821060] [DEBUG] [LOCAL ] EVTL: Loaded 38140 existing records from primary storage. [2025-09-29T02:01:07.826980] [INFO ] [MAIN ] EVTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:07.862273] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTL took 0.9s. Estimated remaining: 7m 29s. Rate: 210.7 symbols/min [2025-09-29T02:01:07.905349] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.951347] [DEBUG] [LOCAL ] EVTR: Loaded 23675 existing records from primary storage. [2025-09-29T02:01:08.020327] [INFO ] [MAIN ] EVTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.039768] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTR took 0.9s. Estimated remaining: 7m 28s. Rate: 210.8 symbols/min [2025-09-29T02:01:08.127583] [DEBUG] [LOCAL ] EW: Loaded 54176 existing records from primary storage. [2025-09-29T02:01:08.221209] [INFO ] [MAIN ] EW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.211485] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:08.227685] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EW took 1.1s. Estimated remaining: 7m 28s. Rate: 210.9 symbols/min [2025-09-29T02:01:08.308338] [DEBUG] [LOCAL ] EXG: Loaded 34725 existing records from primary storage. [2025-09-29T02:01:08.361082] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:08.361488] [INFO ] [MAIN ] EXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.362114] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXG took 0.7s. Estimated remaining: 7m 27s. Rate: 211.0 symbols/min [2025-09-29T02:01:08.435285] [DEBUG] [LOCAL ] EXP: Loaded 30275 existing records from primary storage. [2025-09-29T02:01:08.437009] [DEBUG] [LOCAL ] EXK: Loaded 53904 existing records from primary storage. [2025-09-29T02:01:08.437586] [INFO ] [MAIN ] EXK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.437714] [INFO ] [MAIN ] EXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.438135] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXK took 0.5s. Estimated remaining: 7m 27s. Rate: 211.2 symbols/min [2025-09-29T02:01:08.438479] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXP took 0.4s. Estimated remaining: 7m 26s. Rate: 211.5 symbols/min [2025-09-29T02:01:09.141153] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.187891] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.204816] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.253418] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.309798] [DEBUG] [LOCAL ] FAF: Loaded 42474 existing records from primary storage. [2025-09-29T02:01:09.310274] [INFO ] [MAIN ] FAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:09.310699] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FAF took 0.8s. Estimated remaining: 7m 27s. Rate: 210.9 symbols/min [2025-09-29T02:01:09.504908] [DEBUG] [LOCAL ] EXR: Loaded 46080 existing records from primary storage. [2025-09-29T02:01:09.553099] [DEBUG] [LOCAL ] EXPD: Loaded 48786 existing records from primary storage. [2025-09-29T02:01:09.585928] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-29T02:01:09.580559] [INFO ] [MAIN ] EXPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:09.587797] [INFO ] [MAIN ] EXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:09.606595] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXPD took 1.2s. Estimated remaining: 7m 26s. Rate: 210.9 symbols/min [2025-09-29T02:01:09.611367] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.611490] [INFO ] [MAIN ] F: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:09.618043] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. F took 1.2s. Estimated remaining: 7m 25s. Rate: 211.2 symbols/min [2025-09-29T02:01:09.629563] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. EXR took 1.1s. Estimated remaining: 7m 25s. Rate: 211.4 symbols/min [2025-09-29T02:01:10.180124] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.184960] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.281522] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.308742] [DEBUG] [LOCAL ] FBIN: Loaded 51061 existing records from primary storage. [2025-09-29T02:01:10.309918] [INFO ] [MAIN ] FBIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.311207] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBIN took 1.0s. Estimated remaining: 7m 25s. Rate: 211.1 symbols/min [2025-09-29T02:01:10.452551] [DEBUG] [LOCAL ] FBK: Loaded 26066 existing records from primary storage. [2025-09-29T02:01:10.454115] [INFO ] [MAIN ] FBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.487699] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBK took 0.9s. Estimated remaining: 7m 25s. Rate: 211.2 symbols/min [2025-09-29T02:01:10.556584] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.571030] [DEBUG] [LOCAL ] FBP: Loaded 46874 existing records from primary storage. [2025-09-29T02:01:10.613953] [INFO ] [MAIN ] FBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.628082] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 1.0s. Estimated remaining: 7m 24s. Rate: 211.3 symbols/min [2025-09-29T02:01:10.687206] [DEBUG] [LOCAL ] FBRT: Loaded 34985 existing records from primary storage. [2025-09-29T02:01:10.726284] [INFO ] [MAIN ] FBRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.762732] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 1.1s. Estimated remaining: 7m 24s. Rate: 211.4 symbols/min [2025-09-29T02:01:10.814399] [DEBUG] [LOCAL ] FC: Loaded 15634 existing records from primary storage. [2025-09-29T02:01:10.885278] [INFO ] [MAIN ] FC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.935216] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.958189] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 0.6s. Estimated remaining: 7m 23s. Rate: 211.5 symbols/min [2025-09-29T02:01:11.174984] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:11.329368] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:11.423601] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:11.424245] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-29T02:01:11.424320] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-29T02:01:11.424410] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-29T02:01:11.424453] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-29T02:01:11.424497] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-29T02:01:11.424675] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-29T02:01:11.536526] [DEBUG] [LOCAL ] FCN: Loaded 26559 existing records from primary storage. [2025-09-29T02:01:11.560353] [INFO ] [MAIN ] FCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:11.565854] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCN took 0.9s. Estimated remaining: 7m 23s. Rate: 211.2 symbols/min [2025-09-29T02:01:11.567056] [DEBUG] [LOCAL ] FCF: Loaded 40237 existing records from primary storage. [2025-09-29T02:01:11.612470] [INFO ] [MAIN ] FCF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:11.634702] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCF took 1.1s. Estimated remaining: 7m 23s. Rate: 211.4 symbols/min [2025-09-29T02:01:11.987255] [DEBUG] [LOCAL ] FCPT: Loaded 37955 existing records from primary storage. [2025-09-29T02:01:12.075318] [INFO ] [MAIN ] FCPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:12.162567] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCPT took 1.3s. Estimated remaining: 7m 23s. Rate: 211.2 symbols/min [2025-09-29T02:01:12.232816] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:12.305364] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:12.367972] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:12.407526] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-29T02:01:12.491720] [DEBUG] [LOCAL ] FCT: Loaded 14613 existing records from primary storage. [2025-09-29T02:01:12.493073] [INFO ] [MAIN ] FCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:12.558025] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCT took 1.0s. Estimated remaining: 7m 23s. Rate: 211.1 symbols/min [2025-09-29T02:01:12.588581] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:12.726313] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-29T02:01:12.733693] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-29T02:01:12.735905] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-29T02:01:12.737690] [INFO ] [MAIN ] FCX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:12.743899] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCX took 1.0s. Estimated remaining: 7m 22s. Rate: 211.2 symbols/min [2025-09-29T02:01:12.948045] [DEBUG] [LOCAL ] FDP: Loaded 30760 existing records from primary storage. [2025-09-29T02:01:12.983824] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:12.980838] [INFO ] [MAIN ] FDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:12.986108] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDP took 0.7s. Estimated remaining: 7m 22s. Rate: 211.2 symbols/min [2025-09-29T02:01:13.129269] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T02:01:13.172837] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-29T02:01:13.171192] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:13.284995] [DEBUG] [LOCAL ] FDS: Loaded 26759 existing records from primary storage. [2025-09-29T02:01:13.308152] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:13.309049] [INFO ] [MAIN ] FDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:13.309834] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FDS took 0.7s. Estimated remaining: 7m 22s. Rate: 211.2 symbols/min [2025-09-29T02:01:13.550788] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-29T02:01:13.558009] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-29T02:01:13.575493] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:13.578916] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-29T02:01:13.579001] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-29T02:01:13.579106] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-29T02:01:13.579185] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-29T02:01:13.579288] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-29T02:01:13.577461] [DEBUG] [LOCAL ] FDX: Loaded 52362 existing records from primary storage. [2025-09-29T02:01:13.579374] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-29T02:01:13.605395] [INFO ] [MAIN ] FDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:13.670230] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDX took 0.9s. Estimated remaining: 7m 22s. Rate: 211.1 symbols/min [2025-09-29T02:01:13.743465] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-09-29T02:01:13.772907] [INFO ] [MAIN ] FE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:13.798774] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FE took 0.8s. Estimated remaining: 7m 21s. Rate: 211.3 symbols/min [2025-09-29T02:01:13.860025] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-29T02:01:13.977904] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-29T02:01:14.328172] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:14.420144] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:14.467394] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T02:01:14.476405] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:14.479078] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-29T02:01:14.480900] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-29T02:01:14.497339] [DEBUG] [LOCAL ] FET: Loaded 12984 existing records from primary storage. [2025-09-29T02:01:14.497711] [INFO ] [MAIN ] FET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:14.497826] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FET took 0.6s. Estimated remaining: 7m 22s. Rate: 210.9 symbols/min [2025-09-29T02:01:14.645418] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.16 seconds). [2025-09-29T02:01:14.693385] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:01:14.694689] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-29T02:01:14.735542] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:14.740268] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-29T02:01:14.745980] [DEBUG] [LOCAL ] FERG: Loaded 49691 existing records from primary storage. [2025-09-29T02:01:14.746766] [INFO ] [MAIN ] FERG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:14.747287] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FERG took 1.0s. Estimated remaining: 7m 21s. Rate: 210.9 symbols/min [2025-09-29T02:01:14.979156] [DEBUG] [LOCAL ] FF: Loaded 25768 existing records from primary storage. [2025-09-29T02:01:14.977917] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:14.979605] [INFO ] [MAIN ] FF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:14.979952] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FF took 0.5s. Estimated remaining: 7m 21s. Rate: 211.0 symbols/min [2025-09-29T02:01:15.073429] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T02:01:15.091359] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T02:01:15.111686] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-29T02:01:15.110157] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-29T02:01:15.134814] [DEBUG] [LOCAL ] FFA: Loaded 5800 existing records from primary storage. [2025-09-29T02:01:15.201976] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:15.202200] [INFO ] [MAIN ] FFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:15.202578] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FFA took 0.5s. Estimated remaining: 7m 20s. Rate: 211.0 symbols/min [2025-09-29T02:01:15.376154] [DEBUG] [LOCAL ] FFC: Loaded 16899 existing records from primary storage. [2025-09-29T02:01:15.392721] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T02:01:15.416496] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-29T02:01:15.415119] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:15.416727] [INFO ] [MAIN ] FFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:15.417904] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFC took 0.4s. Estimated remaining: 7m 20s. Rate: 211.1 symbols/min [2025-09-29T02:01:15.439366] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T02:01:15.478008] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-29T02:01:15.597637] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-09-29T02:01:15.631494] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-29T02:01:15.635837] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:15.650937] [DEBUG] [LOCAL ] FFWM: Loaded 36532 existing records from primary storage. [2025-09-29T02:01:15.651423] [INFO ] [MAIN ] FFWM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:15.651533] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FFWM took 0.4s. Estimated remaining: 7m 20s. Rate: 211.1 symbols/min [2025-09-29T02:01:15.816235] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-09-29T02:01:15.837171] [INFO ] [MAIN ] FG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:15.857447] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FG took 0.4s. Estimated remaining: 7m 19s. Rate: 211.2 symbols/min [2025-09-29T02:01:15.922244] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:15.928526] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T02:01:15.957071] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-29T02:01:15.949216] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T02:01:15.975535] [INFO ] [REMOTE ] FCRX: Full fetch complete (1674 records). [2025-09-29T02:01:16.012343] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-29T02:01:16.038311] [DEBUG] [LOCAL ] FGN: Loaded 3915 existing records from primary storage. [2025-09-29T02:01:16.044299] [INFO ] [MAIN ] FGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:16.051105] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGN took 0.4s. Estimated remaining: 7m 19s. Rate: 211.3 symbols/min [2025-09-29T02:01:16.275574] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-29T02:01:16.250513] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:16.330699] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-29T02:01:16.334818] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-29T02:01:16.315062] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-29T02:01:16.380995] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-29T02:01:16.452748] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-29T02:01:16.503220] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-29T02:01:16.515114] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-29T02:01:16.513462] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T02:01:16.537159] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:16.572096] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:01:16.599924] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:01:16.629038] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-29T02:01:16.629251] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-29T02:01:16.636178] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-29T02:01:16.636333] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-29T02:01:16.642886] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FCRX took 5.6s. Estimated remaining: 7m 19s. Rate: 211.0 symbols/min [2025-09-29T02:01:16.791757] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T02:01:16.903689] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-29T02:01:17.016513] [DEBUG] [LOCAL ] FHI: Loaded 41203 existing records from primary storage. [2025-09-29T02:01:17.171819] [INFO ] [MAIN ] FHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:17.153782] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:17.216361] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FHI took 1.1s. Estimated remaining: 7m 19s. Rate: 210.7 symbols/min [2025-09-29T02:01:17.225003] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:17.226565] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-29T02:01:17.294142] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T02:01:17.335831] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-29T02:01:17.409266] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:01:17.446242] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-29T02:01:17.467243] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:17.467934] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:01:17.468185] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-09-29T02:01:17.468744] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:01:17.468853] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-29T02:01:17.468969] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-29T02:01:17.469047] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-29T02:01:17.469157] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-29T02:01:17.469259] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FGSN took 1.6s. Estimated remaining: 7m 19s. Rate: 210.8 symbols/min [2025-09-29T02:01:17.610096] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-29T02:01:17.634408] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T02:01:17.692535] [INFO ] [MAIN ] FHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:17.698508] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-29T02:01:17.699840] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:17.701360] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHN took 1.0s. Estimated remaining: 7m 19s. Rate: 210.8 symbols/min [2025-09-29T02:01:17.955990] [DEBUG] [LOCAL ] FI: Loaded 54281 existing records from primary storage. [2025-09-29T02:01:17.957770] [DEBUG] [LOCAL ] FICO: Loaded 20674 existing records from primary storage. [2025-09-29T02:01:17.957028] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:17.960860] [INFO ] [MAIN ] FI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:17.962100] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FI took 0.7s. Estimated remaining: 7m 18s. Rate: 210.8 symbols/min [2025-09-29T02:01:17.961446] [INFO ] [MAIN ] FICO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:17.961254] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-29T02:01:17.967730] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FICO took 0.5s. Estimated remaining: 7m 17s. Rate: 211.1 symbols/min [2025-09-29T02:01:17.961152] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-29T02:01:17.975100] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-29T02:01:17.975210] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-29T02:01:18.029416] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-29T02:01:18.047478] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-29T02:01:18.095384] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-29T02:01:18.107168] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-29T02:01:18.407899] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:18.524669] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T02:01:18.524498] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:18.613519] [INFO ] [REMOTE ] FENG: Full fetch complete (2245 records). [2025-09-29T02:01:18.630888] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-29T02:01:19.002611] [DEBUG] [LOCAL ] FIGS: Loaded 49651 existing records from primary storage. [2025-09-29T02:01:19.001052] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:19.019842] [INFO ] [MAIN ] FIGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:19.025969] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FIGS took 1.1s. Estimated remaining: 7m 19s. Rate: 210.4 symbols/min [2025-09-29T02:01:19.042812] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-29T02:01:19.032148] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-29T02:01:19.076633] [INFO ] [MAIN ] FIHL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:19.099280] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIHL took 1.1s. Estimated remaining: 7m 18s. Rate: 210.6 symbols/min [2025-09-29T02:01:19.198861] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:01:19.279193] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:01:19.284529] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:01:19.303192] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-29T02:01:19.330210] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-29T02:01:19.363624] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-29T02:01:19.405489] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T02:01:19.405610] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-29T02:01:19.417780] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-29T02:01:19.416743] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FENG took 6.1s. Estimated remaining: 7m 18s. Rate: 210.6 symbols/min [2025-09-29T02:01:19.453032] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:19.595544] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:19.633149] [DEBUG] [LOCAL ] FINS: Loaded 8309 existing records from primary storage. [2025-09-29T02:01:19.644960] [INFO ] [MAIN ] FINS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:19.633255] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-09-29T02:01:19.659952] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 0.6s. Estimated remaining: 7m 17s. Rate: 210.6 symbols/min [2025-09-29T02:01:19.661033] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-29T02:01:19.880389] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:20.000037] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:20.018487] [DEBUG] [LOCAL ] FINV: Loaded 45772 existing records from primary storage. [2025-09-29T02:01:20.019057] [INFO ] [MAIN ] FINV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:20.019356] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FINV took 0.8s. Estimated remaining: 7m 17s. Rate: 210.5 symbols/min [2025-09-29T02:01:20.083384] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T02:01:20.085174] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-29T02:01:20.086838] [DEBUG] [LOCAL ] FIS: Loaded 54144 existing records from primary storage. [2025-09-29T02:01:20.096700] [INFO ] [MAIN ] FIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:20.097269] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIS took 0.6s. Estimated remaining: 7m 17s. Rate: 210.7 symbols/min [2025-09-29T02:01:20.098562] [DEBUG] [LOCAL ] FIX: Loaded 30763 existing records from primary storage. [2025-09-29T02:01:20.098952] [INFO ] [MAIN ] FIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:20.099088] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 0.4s. Estimated remaining: 7m 16s. Rate: 211.0 symbols/min [2025-09-29T02:01:20.220386] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.14 seconds). [2025-09-29T02:01:20.221561] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-29T02:01:20.419713] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-29T02:01:20.420794] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-29T02:01:20.637313] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-29T02:01:20.638477] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-29T02:01:20.807838] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:01:20.808229] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-29T02:01:20.808323] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:01:20.808434] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-09-29T02:01:20.808509] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:01:20.808584] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-29T02:01:20.808717] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-29T02:01:20.808803] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-29T02:01:20.808913] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-29T02:01:20.809005] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIG took 3.1s. Estimated remaining: 7m 16s. Rate: 210.6 symbols/min [2025-09-29T02:01:21.492709] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:21.569768] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:21.638424] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:21.649164] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-29T02:01:21.649868] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-29T02:01:21.648719] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:21.650491] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-29T02:01:21.651141] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-29T02:01:21.651303] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-29T02:01:21.651577] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-29T02:01:21.747371] [DEBUG] [LOCAL ] FLC: Loaded 5559 existing records from primary storage. [2025-09-29T02:01:21.787205] [INFO ] [MAIN ] FLC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:21.802487] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FLC took 1.0s. Estimated remaining: 7m 17s. Rate: 210.0 symbols/min [2025-09-29T02:01:22.037715] [DEBUG] [LOCAL ] FLNG: Loaded 34431 existing records from primary storage. [2025-09-29T02:01:22.101469] [INFO ] [MAIN ] FLNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:22.137225] [DEBUG] [LOCAL ] FLG: Loaded 54105 existing records from primary storage. [2025-09-29T02:01:22.165801] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLNG took 1.3s. Estimated remaining: 7m 17s. Rate: 209.9 symbols/min [2025-09-29T02:01:22.203981] [INFO ] [MAIN ] FLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:22.264101] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLG took 1.4s. Estimated remaining: 7m 16s. Rate: 210.1 symbols/min [2025-09-29T02:01:22.387678] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:22.734224] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:22.734870] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-29T02:01:22.707395] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:22.797772] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-29T02:01:22.839436] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:22.840201] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-29T02:01:22.840921] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-29T02:01:22.841113] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-29T02:01:22.841204] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-29T02:01:22.841280] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-29T02:01:22.904743] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:01:22.926715] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-29T02:01:22.964484] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:01:22.978228] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-09-29T02:01:22.982857] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:01:22.983172] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-29T02:01:22.990973] [DEBUG] [LOCAL ] FLO: Loaded 52656 existing records from primary storage. [2025-09-29T02:01:22.983348] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-29T02:01:23.001904] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-29T02:01:23.012769] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-29T02:01:23.013004] [INFO ] [MAIN ] FLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:23.013783] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLO took 1.2s. Estimated remaining: 7m 17s. Rate: 209.7 symbols/min [2025-09-29T02:01:23.037294] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FIXT took 2.2s. Estimated remaining: 7m 16s. Rate: 209.9 symbols/min [2025-09-29T02:01:23.425121] [DEBUG] [LOCAL ] FLR: Loaded 53892 existing records from primary storage. [2025-09-29T02:01:23.526099] [INFO ] [MAIN ] FLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:23.647487] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLR took 1.3s. Estimated remaining: 7m 17s. Rate: 209.6 symbols/min [2025-09-29T02:01:23.653609] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:23.735334] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:23.808631] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:23.787938] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-29T02:01:23.967283] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:23.987368] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:01:23.988124] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-29T02:01:23.988222] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:01:23.988348] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-09-29T02:01:23.988562] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:01:23.988732] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-29T02:01:23.988889] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-29T02:01:23.988954] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-29T02:01:23.989085] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-29T02:01:23.989228] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLOC took 1.8s. Estimated remaining: 7m 16s. Rate: 209.6 symbols/min [2025-09-29T02:01:24.110688] [DEBUG] [LOCAL ] FLS: Loaded 50934 existing records from primary storage. [2025-09-29T02:01:24.174270] [INFO ] [MAIN ] FLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:24.174754] [DEBUG] [LOCAL ] FLXR: Loaded 20315 existing records from primary storage. [2025-09-29T02:01:24.234464] [INFO ] [MAIN ] FLXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:24.175737] [DEBUG] [LOCAL ] FLUT: Loaded 51580 existing records from primary storage. [2025-09-29T02:01:24.256404] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:24.217759] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLS took 1.2s. Estimated remaining: 7m 16s. Rate: 209.6 symbols/min [2025-09-29T02:01:24.262057] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLXR took 0.6s. Estimated remaining: 7m 15s. Rate: 209.8 symbols/min [2025-09-29T02:01:24.273492] [INFO ] [MAIN ] FLUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:24.280191] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 1.2s. Estimated remaining: 7m 14s. Rate: 210.1 symbols/min [2025-09-29T02:01:24.854023] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:24.892109] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:24.890550] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:24.917597] [DEBUG] [LOCAL ] FMC: Loaded 52560 existing records from primary storage. [2025-09-29T02:01:24.918576] [INFO ] [MAIN ] FMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:24.920538] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMC took 0.9s. Estimated remaining: 7m 15s. Rate: 209.7 symbols/min [2025-09-29T02:01:24.968844] [DEBUG] [LOCAL ] FMN: Loaded 6097 existing records from primary storage. [2025-09-29T02:01:25.012891] [INFO ] [MAIN ] FMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:25.032976] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMN took 0.8s. Estimated remaining: 7m 14s. Rate: 209.9 symbols/min [2025-09-29T02:01:25.239468] [DEBUG] [LOCAL ] FMS: Loaded 30771 existing records from primary storage. [2025-09-29T02:01:25.299792] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:25.265501] [DEBUG] [LOCAL ] FMX: Loaded 41276 existing records from primary storage. [2025-09-29T02:01:25.311785] [INFO ] [MAIN ] FMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:25.317544] [INFO ] [MAIN ] FMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:25.344949] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMS took 1.1s. Estimated remaining: 7m 14s. Rate: 209.9 symbols/min [2025-09-29T02:01:25.360910] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMX took 1.0s. Estimated remaining: 7m 13s. Rate: 210.1 symbols/min [2025-09-29T02:01:25.402305] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:25.412920] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-29T02:01:25.526620] [INFO ] [MAIN ] FMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:25.570235] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 0.6s. Estimated remaining: 7m 13s. Rate: 210.2 symbols/min [2025-09-29T02:01:25.939445] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:25.893322] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:25.991797] [DEBUG] [LOCAL ] FN: Loaded 39795 existing records from primary storage. [2025-09-29T02:01:26.022120] [INFO ] [MAIN ] FN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:26.046628] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 1.0s. Estimated remaining: 7m 13s. Rate: 210.0 symbols/min [2025-09-29T02:01:26.046345] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:26.344876] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:26.379709] [DEBUG] [LOCAL ] FND: Loaded 52871 existing records from primary storage. [2025-09-29T02:01:26.380850] [DEBUG] [LOCAL ] FNF: Loaded 49871 existing records from primary storage. [2025-09-29T02:01:26.381851] [INFO ] [MAIN ] FND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:26.382965] [DEBUG] [LOCAL ] FNB: Loaded 53226 existing records from primary storage. [2025-09-29T02:01:26.383226] [INFO ] [MAIN ] FNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:26.383902] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FND took 1.0s. Estimated remaining: 7m 13s. Rate: 210.0 symbols/min [2025-09-29T02:01:26.384603] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNF took 0.8s. Estimated remaining: 7m 12s. Rate: 210.2 symbols/min [2025-09-29T02:01:26.396777] [INFO ] [MAIN ] FNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:26.454710] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNB took 1.1s. Estimated remaining: 7m 11s. Rate: 210.4 symbols/min [2025-09-29T02:01:26.959742] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:26.969813] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.042502] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.046969] [DEBUG] [LOCAL ] FNV: Loaded 47028 existing records from primary storage. [2025-09-29T02:01:27.048123] [INFO ] [MAIN ] FNV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:27.048968] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 1.0s. Estimated remaining: 7m 11s. Rate: 210.1 symbols/min [2025-09-29T02:01:27.132886] [DEBUG] [LOCAL ] FOF: Loaded 8510 existing records from primary storage. [2025-09-29T02:01:27.153713] [INFO ] [MAIN ] FOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:27.154588] [DEBUG] [LOCAL ] FOA: Loaded 13484 existing records from primary storage. [2025-09-29T02:01:27.171186] [INFO ] [MAIN ] FOA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:27.154787] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOF took 0.8s. Estimated remaining: 7m 11s. Rate: 210.3 symbols/min [2025-09-29T02:01:27.208513] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOA took 0.8s. Estimated remaining: 7m 10s. Rate: 210.5 symbols/min [2025-09-29T02:01:27.222022] [DEBUG] [LOCAL ] FOR: Loaded 20362 existing records from primary storage. [2025-09-29T02:01:27.254018] [INFO ] [MAIN ] FOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:27.274828] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOR took 0.7s. Estimated remaining: 7m 9s. Rate: 210.7 symbols/min [2025-09-29T02:01:27.511806] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.900497] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.927920] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.956274] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.999554] [DEBUG] [LOCAL ] FPH: Loaded 19890 existing records from primary storage. [2025-09-29T02:01:28.007472] [INFO ] [MAIN ] FPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.033552] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPH took 0.8s. Estimated remaining: 7m 10s. Rate: 210.3 symbols/min [2025-09-29T02:01:28.033413] [DEBUG] [LOCAL ] FPF: Loaded 17998 existing records from primary storage. [2025-09-29T02:01:28.065544] [INFO ] [MAIN ] FPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.084372] [DEBUG] [LOCAL ] FOUR: Loaded 50306 existing records from primary storage. [2025-09-29T02:01:28.113355] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPF took 0.9s. Estimated remaining: 7m 9s. Rate: 210.4 symbols/min [2025-09-29T02:01:28.132153] [INFO ] [MAIN ] FOUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.143344] [DEBUG] [LOCAL ] FPI: Loaded 31525 existing records from primary storage. [2025-09-29T02:01:28.176301] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FOUR took 1.1s. Estimated remaining: 7m 9s. Rate: 210.6 symbols/min [2025-09-29T02:01:28.197481] [INFO ] [MAIN ] FPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.208616] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPI took 0.9s. Estimated remaining: 7m 8s. Rate: 210.8 symbols/min [2025-09-29T02:01:28.452905] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:28.726196] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:28.753191] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:28.827010] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:28.863737] [DEBUG] [LOCAL ] FRGE: Loaded 18571 existing records from primary storage. [2025-09-29T02:01:28.877563] [INFO ] [MAIN ] FRGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.879895] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRGE took 0.7s. Estimated remaining: 7m 8s. Rate: 210.5 symbols/min [2025-09-29T02:01:28.881991] [DEBUG] [LOCAL ] FR: Loaded 47174 existing records from primary storage. [2025-09-29T02:01:28.942307] [DEBUG] [LOCAL ] FRA: Loaded 14717 existing records from primary storage. [2025-09-29T02:01:28.931267] [INFO ] [MAIN ] FR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.963621] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FR took 0.9s. Estimated remaining: 7m 8s. Rate: 210.7 symbols/min [2025-09-29T02:01:28.969094] [INFO ] [MAIN ] FRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.986267] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRA took 0.8s. Estimated remaining: 7m 7s. Rate: 210.9 symbols/min [2025-09-29T02:01:29.376168] [DEBUG] [LOCAL ] FRO: Loaded 52603 existing records from primary storage. [2025-09-29T02:01:29.365424] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:29.479991] [INFO ] [MAIN ] FRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:29.519173] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 1.2s. Estimated remaining: 7m 7s. Rate: 210.7 symbols/min [2025-09-29T02:01:29.502702] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:29.524717] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:29.771061] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:29.808611] [DEBUG] [LOCAL ] FRT: Loaded 42808 existing records from primary storage. [2025-09-29T02:01:29.812550] [INFO ] [MAIN ] FRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:29.813507] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 0.9s. Estimated remaining: 7m 7s. Rate: 210.7 symbols/min [2025-09-29T02:01:29.851600] [DEBUG] [LOCAL ] FSCO: Loaded 37725 existing records from primary storage. [2025-09-29T02:01:29.876633] [INFO ] [MAIN ] FSCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:29.913756] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSCO took 0.9s. Estimated remaining: 7m 6s. Rate: 210.8 symbols/min [2025-09-29T02:01:29.953174] [DEBUG] [LOCAL ] FSK: Loaded 50173 existing records from primary storage. [2025-09-29T02:01:30.036427] [INFO ] [MAIN ] FSK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:30.082046] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 1.1s. Estimated remaining: 7m 6s. Rate: 210.9 symbols/min [2025-09-29T02:01:30.248797] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:30.390371] [DEBUG] [LOCAL ] FSLY: Loaded 51989 existing records from primary storage. [2025-09-29T02:01:30.447730] [INFO ] [MAIN ] FSLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:30.470064] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 0.9s. Estimated remaining: 7m 6s. Rate: 210.9 symbols/min [2025-09-29T02:01:30.521668] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:30.762806] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:30.908705] [DEBUG] [LOCAL ] FT: Loaded 6432 existing records from primary storage. [2025-09-29T02:01:30.921443] [INFO ] [MAIN ] FT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:30.925397] [DEBUG] [LOCAL ] FSS: Loaded 34888 existing records from primary storage. [2025-09-29T02:01:30.925810] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FT took 0.8s. Estimated remaining: 7m 6s. Rate: 210.7 symbols/min [2025-09-29T02:01:30.932135] [INFO ] [MAIN ] FSS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:30.981213] [DEBUG] [LOCAL ] FSM: Loaded 54065 existing records from primary storage. [2025-09-29T02:01:30.981415] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSS took 1.0s. Estimated remaining: 7m 5s. Rate: 210.9 symbols/min [2025-09-29T02:01:31.015320] [INFO ] [MAIN ] FSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:31.049296] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSM took 1.2s. Estimated remaining: 7m 4s. Rate: 211.1 symbols/min [2025-09-29T02:01:31.107174] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:31.300559] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:31.301439] [DEBUG] [LOCAL ] FTHY: Loaded 11947 existing records from primary storage. [2025-09-29T02:01:31.302166] [INFO ] [MAIN ] FTHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:31.302609] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 0.8s. Estimated remaining: 7m 4s. Rate: 211.1 symbols/min [2025-09-29T02:01:31.366415] [DEBUG] [LOCAL ] FTI: Loaded 54078 existing records from primary storage. [2025-09-29T02:01:31.366973] [INFO ] [MAIN ] FTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:31.367623] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 0.4s. Estimated remaining: 7m 3s. Rate: 211.3 symbols/min [2025-09-29T02:01:32.052161] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.144833] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.156374] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.216238] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.220829] [DEBUG] [LOCAL ] FTWO: Loaded 1837 existing records from primary storage. [2025-09-29T02:01:32.221438] [INFO ] [MAIN ] FTWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:32.221546] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 0.8s. Estimated remaining: 7m 4s. Rate: 210.8 symbols/min [2025-09-29T02:01:32.392471] [DEBUG] [LOCAL ] FTK: Loaded 32755 existing records from primary storage. [2025-09-29T02:01:32.398426] [INFO ] [MAIN ] FTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:32.426608] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 1.1s. Estimated remaining: 7m 4s. Rate: 210.9 symbols/min [2025-09-29T02:01:32.470973] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.647085] [DEBUG] [LOCAL ] FTV: Loaded 53686 existing records from primary storage. [2025-09-29T02:01:32.629804] [DEBUG] [LOCAL ] FTS: Loaded 42695 existing records from primary storage. [2025-09-29T02:01:32.662948] [INFO ] [MAIN ] FTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:32.663496] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 1.3s. Estimated remaining: 7m 3s. Rate: 210.9 symbols/min [2025-09-29T02:01:32.663752] [INFO ] [MAIN ] FTV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:32.670026] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 1.3s. Estimated remaining: 7m 3s. Rate: 211.2 symbols/min [2025-09-29T02:01:32.995064] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.059230] [DEBUG] [LOCAL ] FUBO: Loaded 54476 existing records from primary storage. [2025-09-29T02:01:33.120892] [INFO ] [MAIN ] FUBO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:33.178315] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 1.0s. Estimated remaining: 7m 3s. Rate: 211.0 symbols/min [2025-09-29T02:01:33.220088] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.218875] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.403752] [DEBUG] [LOCAL ] FUL: Loaded 33570 existing records from primary storage. [2025-09-29T02:01:33.432415] [INFO ] [MAIN ] FUL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:33.433524] [DEBUG] [LOCAL ] FVR: Loaded 22328 existing records from primary storage. [2025-09-29T02:01:33.455201] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.453083] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUL took 1.0s. Estimated remaining: 7m 2s. Rate: 211.0 symbols/min [2025-09-29T02:01:33.456795] [INFO ] [MAIN ] FVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:33.468624] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FVR took 0.8s. Estimated remaining: 7m 2s. Rate: 211.2 symbols/min [2025-09-29T02:01:33.792718] [DEBUG] [LOCAL ] FUN: Loaded 52349 existing records from primary storage. [2025-09-29T02:01:33.813832] [INFO ] [MAIN ] FUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:33.836435] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.837201] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUN took 1.2s. Estimated remaining: 7m 1s. Rate: 211.1 symbols/min [2025-09-29T02:01:33.970544] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-09-29T02:01:33.957143] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.976743] [DEBUG] [LOCAL ] FVRR: Loaded 40749 existing records from primary storage. [2025-09-29T02:01:34.008126] [INFO ] [MAIN ] FVRR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.019715] [INFO ] [MAIN ] FXED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.030388] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 0.6s. Estimated remaining: 7m 1s. Rate: 211.2 symbols/min [2025-09-29T02:01:34.054668] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FVRR took 0.9s. Estimated remaining: 7m 0s. Rate: 211.4 symbols/min [2025-09-29T02:01:34.327675] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:34.498775] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:34.600419] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:34.603105] [DEBUG] [LOCAL ] G: Loaded 50547 existing records from primary storage. [2025-09-29T02:01:34.604323] [INFO ] [MAIN ] G: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.607855] [DEBUG] [LOCAL ] GAM: Loaded 4174 existing records from primary storage. [2025-09-29T02:01:34.609849] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. G took 1.1s. Estimated remaining: 7m 0s. Rate: 211.2 symbols/min [2025-09-29T02:01:34.622261] [INFO ] [MAIN ] GAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.662961] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAM took 0.6s. Estimated remaining: 6m 60s. Rate: 211.4 symbols/min [2025-09-29T02:01:34.727085] [DEBUG] [LOCAL ] GAB: Loaded 28493 existing records from primary storage. [2025-09-29T02:01:34.783701] [INFO ] [MAIN ] GAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.831242] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAB took 1.0s. Estimated remaining: 6m 59s. Rate: 211.5 symbols/min [2025-09-29T02:01:35.008547] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.175478] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.177315] [DEBUG] [LOCAL ] GAP: Loaded 54435 existing records from primary storage. [2025-09-29T02:01:35.194935] [INFO ] [MAIN ] GAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:35.256242] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAP took 1.2s. Estimated remaining: 6m 59s. Rate: 211.4 symbols/min [2025-09-29T02:01:35.265186] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.315600] [DEBUG] [LOCAL ] GBAB: Loaded 13142 existing records from primary storage. [2025-09-29T02:01:35.303982] [DEBUG] [LOCAL ] GATX: Loaded 18437 existing records from primary storage. [2025-09-29T02:01:35.353828] [INFO ] [MAIN ] GBAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:35.387063] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GBAB took 0.7s. Estimated remaining: 6m 59s. Rate: 211.5 symbols/min [2025-09-29T02:01:35.353979] [INFO ] [MAIN ] GATX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:35.413158] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GATX took 0.8s. Estimated remaining: 6m 58s. Rate: 211.7 symbols/min [2025-09-29T02:01:35.725887] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.746457] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-29T02:01:35.819364] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-29T02:01:35.932510] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.913574] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-29T02:01:35.958778] [DEBUG] [LOCAL ] GBCI: Loaded 40720 existing records from primary storage. [2025-09-29T02:01:35.962718] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.962965] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-29T02:01:35.964023] [INFO ] [MAIN ] GBCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:35.964259] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBCI took 1.1s. Estimated remaining: 6m 58s. Rate: 211.5 symbols/min [2025-09-29T02:01:35.964158] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-29T02:01:35.979773] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-29T02:01:36.310509] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:36.418452] [DEBUG] [LOCAL ] GBX: Loaded 29497 existing records from primary storage. [2025-09-29T02:01:36.458058] [DEBUG] [LOCAL ] GBTG: Loaded 40807 existing records from primary storage. [2025-09-29T02:01:36.508847] [INFO ] [MAIN ] GBTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:36.458240] [INFO ] [MAIN ] GBX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:36.525264] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBTG took 1.1s. Estimated remaining: 6m 58s. Rate: 211.3 symbols/min [2025-09-29T02:01:36.551491] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBX took 1.1s. Estimated remaining: 6m 58s. Rate: 211.5 symbols/min [2025-09-29T02:01:36.830790] [DEBUG] [LOCAL ] GCI: Loaded 44828 existing records from primary storage. [2025-09-29T02:01:36.810828] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:36.867884] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-29T02:01:36.873332] [INFO ] [MAIN ] GCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:36.895299] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCI took 0.9s. Estimated remaining: 6m 57s. Rate: 211.4 symbols/min [2025-09-29T02:01:37.079030] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.194029] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.227326] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T02:01:37.240329] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-29T02:01:37.314676] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.349200] [DEBUG] [LOCAL ] GCO: Loaded 25686 existing records from primary storage. [2025-09-29T02:01:37.349743] [DEBUG] [LOCAL ] GCTS: Loaded 20060 existing records from primary storage. [2025-09-29T02:01:37.350227] [INFO ] [MAIN ] GCTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:37.352540] [INFO ] [MAIN ] GCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:37.352683] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCTS took 0.8s. Estimated remaining: 6m 57s. Rate: 211.3 symbols/min [2025-09-29T02:01:37.353142] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCO took 0.8s. Estimated remaining: 6m 57s. Rate: 211.5 symbols/min [2025-09-29T02:01:37.469781] [DEBUG] [LOCAL ] GCV: Loaded 7333 existing records from primary storage. [2025-09-29T02:01:37.533997] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-29T02:01:37.570155] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-29T02:01:37.486965] [INFO ] [MAIN ] GCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:37.613472] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 0.7s. Estimated remaining: 6m 56s. Rate: 211.5 symbols/min [2025-09-29T02:01:37.753659] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.818026] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.825506] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-29T02:01:37.847597] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-29T02:01:37.974692] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.983306] [DEBUG] [LOCAL ] GDIV: Loaded 3724 existing records from primary storage. [2025-09-29T02:01:37.983724] [INFO ] [MAIN ] GDIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:37.983829] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GDIV took 0.3s. Estimated remaining: 6m 56s. Rate: 211.5 symbols/min [2025-09-29T02:01:38.119750] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-29T02:01:38.149817] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-29T02:01:38.215055] [DEBUG] [LOCAL ] GDDY: Loaded 50449 existing records from primary storage. [2025-09-29T02:01:38.217011] [DEBUG] [LOCAL ] GD: Loaded 47940 existing records from primary storage. [2025-09-29T02:01:38.244702] [INFO ] [MAIN ] GDDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:38.250921] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDDY took 0.9s. Estimated remaining: 6m 56s. Rate: 211.5 symbols/min [2025-09-29T02:01:38.250215] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:38.275029] [INFO ] [MAIN ] GD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:38.295858] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GD took 0.9s. Estimated remaining: 6m 55s. Rate: 211.7 symbols/min [2025-09-29T02:01:38.415084] [DEBUG] [LOCAL ] GDL: Loaded 2572 existing records from primary storage. [2025-09-29T02:01:38.474228] [INFO ] [MAIN ] GDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:38.494410] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 0.5s. Estimated remaining: 6m 55s. Rate: 211.7 symbols/min [2025-09-29T02:01:38.547185] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T02:01:38.606890] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:38.635381] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-29T02:01:38.763233] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:38.821027] [DEBUG] [LOCAL ] GDO: Loaded 6076 existing records from primary storage. [2025-09-29T02:01:38.844494] [INFO ] [MAIN ] GDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:38.874803] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDO took 0.6s. Estimated remaining: 6m 55s. Rate: 211.7 symbols/min [2025-09-29T02:01:38.874430] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.029740] [DEBUG] [LOCAL ] GDV: Loaded 19971 existing records from primary storage. [2025-09-29T02:01:39.050992] [INFO ] [MAIN ] GDV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.081894] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T02:01:39.121557] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDV took 0.6s. Estimated remaining: 6m 54s. Rate: 211.7 symbols/min [2025-09-29T02:01:39.121290] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.122906] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-29T02:01:39.126288] [DEBUG] [LOCAL ] GDOT: Loaded 39279 existing records from primary storage. [2025-09-29T02:01:39.133014] [INFO ] [MAIN ] GDOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.150155] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDOT took 0.8s. Estimated remaining: 6m 54s. Rate: 211.9 symbols/min [2025-09-29T02:01:39.284981] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.16 seconds). [2025-09-29T02:01:39.304057] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-29T02:01:39.562054] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-29T02:01:39.570860] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-29T02:01:39.568091] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.536237] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.595505] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-09-29T02:01:39.596604] [INFO ] [MAIN ] GE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.597287] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GE took 0.7s. Estimated remaining: 6m 54s. Rate: 211.8 symbols/min [2025-09-29T02:01:39.786245] [DEBUG] [LOCAL ] GEF: Loaded 20965 existing records from primary storage. [2025-09-29T02:01:39.827818] [INFO ] [MAIN ] GEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.855510] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.855927] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEF took 0.7s. Estimated remaining: 6m 53s. Rate: 211.8 symbols/min [2025-09-29T02:01:39.857614] [DEBUG] [LOCAL ] GEL: Loaded 34252 existing records from primary storage. [2025-09-29T02:01:39.917762] [INFO ] [MAIN ] GEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.931787] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T02:01:39.953626] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GEL took 0.8s. Estimated remaining: 6m 53s. Rate: 211.9 symbols/min [2025-09-29T02:01:39.980314] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-29T02:01:40.222181] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:40.307598] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-29T02:01:40.308551] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:40.309990] [INFO ] [REMOTE ] GBLI: Full fetch complete (1330 records). [2025-09-29T02:01:40.311743] [DEBUG] [LOCAL ] GENI: Loaded 53679 existing records from primary storage. [2025-09-29T02:01:40.312318] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-29T02:01:40.318117] [INFO ] [MAIN ] GENI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:40.338421] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GENI took 0.7s. Estimated remaining: 6m 53s. Rate: 211.9 symbols/min [2025-09-29T02:01:40.661814] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-29T02:01:40.691713] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:01:40.705276] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:01:40.716034] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-29T02:01:40.743133] [DEBUG] [LOCAL ] GES: Loaded 40424 existing records from primary storage. [2025-09-29T02:01:40.770959] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-29T02:01:40.791480] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:40.791898] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-29T02:01:40.792101] [INFO ] [MAIN ] GES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:40.793385] [DEBUG] [LOCAL ] GEO: Loaded 52812 existing records from primary storage. [2025-09-29T02:01:40.793621] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GES took 0.8s. Estimated remaining: 6m 53s. Rate: 211.7 symbols/min [2025-09-29T02:01:40.794104] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-29T02:01:40.799964] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GBLI took 5.5s. Estimated remaining: 6m 52s. Rate: 211.9 symbols/min [2025-09-29T02:01:40.811183] [INFO ] [MAIN ] GEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:40.936354] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GEO took 1.1s. Estimated remaining: 6m 51s. Rate: 212.1 symbols/min [2025-09-29T02:01:41.204710] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:41.209158] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:41.210745] [DEBUG] [LOCAL ] GETY: Loaded 36378 existing records from primary storage. [2025-09-29T02:01:41.211554] [INFO ] [MAIN ] GETY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:41.211777] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GETY took 0.8s. Estimated remaining: 6m 51s. Rate: 212.1 symbols/min [2025-09-29T02:01:41.218002] [DEBUG] [LOCAL ] GF: Loaded 3220 existing records from primary storage. [2025-09-29T02:01:41.218353] [INFO ] [MAIN ] GF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:41.218458] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 0.4s. Estimated remaining: 6m 50s. Rate: 212.3 symbols/min [2025-09-29T02:01:41.278020] [DEBUG] [LOCAL ] GEV: Loaded 53878 existing records from primary storage. [2025-09-29T02:01:41.278411] [INFO ] [MAIN ] GEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:41.278910] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 0.5s. Estimated remaining: 6m 50s. Rate: 212.5 symbols/min [2025-09-29T02:01:41.890575] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:41.975137] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:42.091679] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:42.090535] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:42.129960] [DEBUG] [LOCAL ] GFR: Loaded 8572 existing records from primary storage. [2025-09-29T02:01:42.130850] [INFO ] [MAIN ] GFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:42.131006] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 0.8s. Estimated remaining: 6m 50s. Rate: 212.0 symbols/min [2025-09-29T02:01:42.221924] [DEBUG] [LOCAL ] GFF: Loaded 31088 existing records from primary storage. [2025-09-29T02:01:42.312908] [INFO ] [MAIN ] GFF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:42.339616] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 1.1s. Estimated remaining: 6m 50s. Rate: 212.1 symbols/min [2025-09-29T02:01:42.355101] [DEBUG] [LOCAL ] GFI: Loaded 53887 existing records from primary storage. [2025-09-29T02:01:42.410335] [INFO ] [MAIN ] GFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:42.441459] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:42.441933] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFI took 1.2s. Estimated remaining: 6m 49s. Rate: 212.2 symbols/min [2025-09-29T02:01:42.455474] [DEBUG] [LOCAL ] GFL: Loaded 48755 existing records from primary storage. [2025-09-29T02:01:42.496961] [INFO ] [MAIN ] GFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:42.509214] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFL took 1.2s. Estimated remaining: 6m 49s. Rate: 212.4 symbols/min [2025-09-29T02:01:42.997311] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.052807] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.085143] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.110908] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-09-29T02:01:43.113353] [INFO ] [MAIN ] GGZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.113501] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGZ took 0.6s. Estimated remaining: 6m 49s. Rate: 212.1 symbols/min [2025-09-29T02:01:43.112548] [DEBUG] [LOCAL ] GGB: Loaded 51813 existing records from primary storage. [2025-09-29T02:01:43.135321] [INFO ] [MAIN ] GGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.178044] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGB took 1.0s. Estimated remaining: 6m 48s. Rate: 212.3 symbols/min [2025-09-29T02:01:43.205784] [DEBUG] [LOCAL ] GGT: Loaded 14309 existing records from primary storage. [2025-09-29T02:01:43.266597] [INFO ] [MAIN ] GGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.331845] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGT took 0.8s. Estimated remaining: 6m 48s. Rate: 212.4 symbols/min [2025-09-29T02:01:43.487387] [DEBUG] [LOCAL ] GGG: Loaded 41580 existing records from primary storage. [2025-09-29T02:01:43.539244] [INFO ] [MAIN ] GGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.582495] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGG took 1.2s. Estimated remaining: 6m 48s. Rate: 212.4 symbols/min [2025-09-29T02:01:43.573588] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.744462] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.811198] [DEBUG] [LOCAL ] GHC: Loaded 2664 existing records from primary storage. [2025-09-29T02:01:43.893256] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.893775] [INFO ] [MAIN ] GHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.896405] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 0.8s. Estimated remaining: 6m 47s. Rate: 212.4 symbols/min [2025-09-29T02:01:43.913948] [DEBUG] [LOCAL ] GHG: Loaded 3226 existing records from primary storage. [2025-09-29T02:01:43.963692] [INFO ] [MAIN ] GHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.974425] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHG took 0.8s. Estimated remaining: 6m 47s. Rate: 212.6 symbols/min [2025-09-29T02:01:44.133851] [DEBUG] [LOCAL ] GHI: Loaded 6963 existing records from primary storage. [2025-09-29T02:01:44.207171] [INFO ] [MAIN ] GHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:44.277531] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHI took 0.9s. Estimated remaining: 6m 46s. Rate: 212.6 symbols/min [2025-09-29T02:01:44.324699] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:44.440032] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:44.582065] [DEBUG] [LOCAL ] GHLD: Loaded 4168 existing records from primary storage. [2025-09-29T02:01:44.598639] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:44.613962] [INFO ] [MAIN ] GHLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:44.647825] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 1.0s. Estimated remaining: 6m 46s. Rate: 212.5 symbols/min [2025-09-29T02:01:44.673005] [DEBUG] [LOCAL ] GHM: Loaded 14350 existing records from primary storage. [2025-09-29T02:01:44.733624] [INFO ] [MAIN ] GHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:44.806879] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHM took 0.9s. Estimated remaining: 6m 46s. Rate: 212.6 symbols/min [2025-09-29T02:01:44.928578] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:44.929516] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-09-29T02:01:45.003202] [INFO ] [MAIN ] GHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.029880] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHY took 1.0s. Estimated remaining: 6m 45s. Rate: 212.6 symbols/min [2025-09-29T02:01:45.116179] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.331118] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.363078] [DEBUG] [LOCAL ] GIB: Loaded 32653 existing records from primary storage. [2025-09-29T02:01:45.401423] [INFO ] [MAIN ] GIB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.419272] [DEBUG] [LOCAL ] GIC: Loaded 13796 existing records from primary storage. [2025-09-29T02:01:45.440446] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIB took 1.1s. Estimated remaining: 6m 45s. Rate: 212.5 symbols/min [2025-09-29T02:01:45.440085] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.440797] [INFO ] [MAIN ] GIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.463689] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIC took 0.8s. Estimated remaining: 6m 45s. Rate: 212.7 symbols/min [2025-09-29T02:01:45.887239] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.890692] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.908600] [DEBUG] [LOCAL ] GIL: Loaded 43906 existing records from primary storage. [2025-09-29T02:01:45.909856] [INFO ] [MAIN ] GIL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.910907] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIL took 1.1s. Estimated remaining: 6m 45s. Rate: 212.6 symbols/min [2025-09-29T02:01:45.912040] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-09-29T02:01:45.934463] [INFO ] [MAIN ] GIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.961745] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIS took 0.9s. Estimated remaining: 6m 44s. Rate: 212.8 symbols/min [2025-09-29T02:01:46.345977] [DEBUG] [LOCAL ] GKOS: Loaded 43585 existing records from primary storage. [2025-09-29T02:01:46.313763] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:46.395939] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:46.393767] [INFO ] [MAIN ] GKOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:46.397191] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GKOS took 1.0s. Estimated remaining: 6m 44s. Rate: 212.7 symbols/min [2025-09-29T02:01:46.399198] [DEBUG] [LOCAL ] GL: Loaded 38382 existing records from primary storage. [2025-09-29T02:01:46.412396] [INFO ] [MAIN ] GL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:46.468122] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GL took 1.0s. Estimated remaining: 6m 43s. Rate: 212.8 symbols/min [2025-09-29T02:01:46.601794] [DEBUG] [LOCAL ] GLP: Loaded 9585 existing records from primary storage. [2025-09-29T02:01:46.607775] [INFO ] [MAIN ] GLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:46.613115] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLP took 0.7s. Estimated remaining: 6m 43s. Rate: 213.0 symbols/min [2025-09-29T02:01:46.797794] [DEBUG] [LOCAL ] GLOB: Loaded 48111 existing records from primary storage. [2025-09-29T02:01:46.859337] [INFO ] [MAIN ] GLOB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:46.843224] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:46.876413] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLOB took 1.0s. Estimated remaining: 6m 43s. Rate: 213.0 symbols/min [2025-09-29T02:01:47.081888] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:47.238900] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:47.345692] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:47.370445] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-29T02:01:47.371702] [INFO ] [MAIN ] GLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:47.372453] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLW took 1.0s. Estimated remaining: 6m 43s. Rate: 212.8 symbols/min [2025-09-29T02:01:47.613112] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-29T02:01:47.658957] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:47.661847] [INFO ] [MAIN ] GM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:47.662813] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 1.2s. Estimated remaining: 6m 42s. Rate: 212.8 symbols/min [2025-09-29T02:01:47.761191] [DEBUG] [LOCAL ] GME: Loaded 54540 existing records from primary storage. [2025-09-29T02:01:47.804324] [INFO ] [MAIN ] GME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:47.818028] [DEBUG] [LOCAL ] GMED: Loaded 49096 existing records from primary storage. [2025-09-29T02:01:47.824212] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GME took 1.2s. Estimated remaining: 6m 42s. Rate: 212.9 symbols/min [2025-09-29T02:01:47.847952] [INFO ] [MAIN ] GMED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:47.850187] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GMED took 0.9s. Estimated remaining: 6m 41s. Rate: 213.1 symbols/min [2025-09-29T02:01:48.127806] [DEBUG] [LOCAL ] GMRE: Loaded 38133 existing records from primary storage. [2025-09-29T02:01:48.137856] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.171552] [INFO ] [MAIN ] GMRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:48.177212] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GMRE took 0.8s. Estimated remaining: 6m 41s. Rate: 213.1 symbols/min [2025-09-29T02:01:48.392769] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.470326] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.500044] [DEBUG] [LOCAL ] GNE: Loaded 17940 existing records from primary storage. [2025-09-29T02:01:48.532883] [INFO ] [MAIN ] GNE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:48.580753] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 0.9s. Estimated remaining: 6m 41s. Rate: 213.0 symbols/min [2025-09-29T02:01:48.585707] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.839955] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.842280] [DEBUG] [LOCAL ] GNK: Loaded 41039 existing records from primary storage. [2025-09-29T02:01:48.857069] [INFO ] [MAIN ] GNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:48.857761] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNK took 1.0s. Estimated remaining: 6m 41s. Rate: 213.0 symbols/min [2025-09-29T02:01:48.913102] [DEBUG] [LOCAL ] GNL: Loaded 47785 existing records from primary storage. [2025-09-29T02:01:48.966431] [INFO ] [MAIN ] GNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.003246] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNL took 1.1s. Estimated remaining: 6m 40s. Rate: 213.1 symbols/min [2025-09-29T02:01:49.002500] [DEBUG] [LOCAL ] GNRC: Loaded 45886 existing records from primary storage. [2025-09-29T02:01:49.003970] [DEBUG] [LOCAL ] GNT: Loaded 8177 existing records from primary storage. [2025-09-29T02:01:49.040329] [INFO ] [MAIN ] GNRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.083081] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 0.9s. Estimated remaining: 6m 40s. Rate: 213.2 symbols/min [2025-09-29T02:01:49.040554] [INFO ] [MAIN ] GNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.129174] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNT took 0.5s. Estimated remaining: 6m 39s. Rate: 213.4 symbols/min [2025-09-29T02:01:49.193262] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.536637] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.559556] [DEBUG] [LOCAL ] GNTY: Loaded 7353 existing records from primary storage. [2025-09-29T02:01:49.596494] [INFO ] [MAIN ] GNTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.625520] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNTY took 0.8s. Estimated remaining: 6m 39s. Rate: 213.2 symbols/min [2025-09-29T02:01:49.722393] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.742818] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.941210] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.956697] [DEBUG] [LOCAL ] GOLF: Loaded 32049 existing records from primary storage. [2025-09-29T02:01:49.972427] [INFO ] [MAIN ] GOLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.975336] [DEBUG] [LOCAL ] GNW: Loaded 52086 existing records from primary storage. [2025-09-29T02:01:49.986548] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOLF took 0.8s. Estimated remaining: 6m 39s. Rate: 213.2 symbols/min [2025-09-29T02:01:49.987131] [INFO ] [MAIN ] GNW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.993133] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GNW took 1.0s. Estimated remaining: 6m 38s. Rate: 213.4 symbols/min [2025-09-29T02:01:50.273503] [DEBUG] [LOCAL ] GOF: Loaded 43374 existing records from primary storage. [2025-09-29T02:01:50.358388] [INFO ] [MAIN ] GOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.357415] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:50.370204] [DEBUG] [LOCAL ] GOOS: Loaded 46008 existing records from primary storage. [2025-09-29T02:01:50.381218] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOF took 1.3s. Estimated remaining: 6m 38s. Rate: 213.3 symbols/min [2025-09-29T02:01:50.406176] [INFO ] [MAIN ] GOOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.431298] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOOS took 0.7s. Estimated remaining: 6m 37s. Rate: 213.5 symbols/min [2025-09-29T02:01:50.478195] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:50.665711] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:50.686798] [DEBUG] [LOCAL ] GOTU: Loaded 39533 existing records from primary storage. [2025-09-29T02:01:50.687607] [INFO ] [MAIN ] GOTU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.688397] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GOTU took 0.7s. Estimated remaining: 6m 37s. Rate: 213.5 symbols/min [2025-09-29T02:01:50.715981] [DEBUG] [LOCAL ] GPI: Loaded 15126 existing records from primary storage. [2025-09-29T02:01:50.716466] [INFO ] [MAIN ] GPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.716575] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPI took 0.3s. Estimated remaining: 6m 36s. Rate: 213.7 symbols/min [2025-09-29T02:01:50.741571] [DEBUG] [LOCAL ] GPC: Loaded 47289 existing records from primary storage. [2025-09-29T02:01:50.742139] [INFO ] [MAIN ] GPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.742735] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 0.7s. Estimated remaining: 6m 36s. Rate: 213.9 symbols/min [2025-09-29T02:01:51.365750] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.504308] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.553165] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.578804] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-09-29T02:01:51.575561] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.579378] [INFO ] [MAIN ] GPJA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:51.579849] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 0.8s. Estimated remaining: 6m 36s. Rate: 213.5 symbols/min [2025-09-29T02:01:51.802375] [DEBUG] [LOCAL ] GPMT: Loaded 26788 existing records from primary storage. [2025-09-29T02:01:51.851594] [INFO ] [MAIN ] GPMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:51.851118] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.867581] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 1.1s. Estimated remaining: 6m 36s. Rate: 213.5 symbols/min [2025-09-29T02:01:51.881374] [DEBUG] [LOCAL ] GPK: Loaded 53441 existing records from primary storage. [2025-09-29T02:01:51.897052] [INFO ] [MAIN ] GPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:51.941700] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 1.2s. Estimated remaining: 6m 35s. Rate: 213.6 symbols/min [2025-09-29T02:01:51.974093] [DEBUG] [LOCAL ] GPN: Loaded 52822 existing records from primary storage. [2025-09-29T02:01:52.044285] [INFO ] [MAIN ] GPN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.098829] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 1.3s. Estimated remaining: 6m 35s. Rate: 213.7 symbols/min [2025-09-29T02:01:52.113273] [DEBUG] [LOCAL ] GPOR: Loaded 23328 existing records from primary storage. [2025-09-29T02:01:52.160541] [INFO ] [MAIN ] GPOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.204789] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 0.6s. Estimated remaining: 6m 34s. Rate: 213.9 symbols/min [2025-09-29T02:01:52.235952] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:52.436344] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:52.623989] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:52.726727] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:52.742402] [DEBUG] [LOCAL ] GRBK: Loaded 27375 existing records from primary storage. [2025-09-29T02:01:52.758795] [INFO ] [MAIN ] GRBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.764773] [DEBUG] [LOCAL ] GRC: Loaded 9061 existing records from primary storage. [2025-09-29T02:01:52.766283] [DEBUG] [LOCAL ] GPRK: Loaded 39841 existing records from primary storage. [2025-09-29T02:01:52.764917] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GRBK took 0.8s. Estimated remaining: 6m 35s. Rate: 213.7 symbols/min [2025-09-29T02:01:52.766928] [INFO ] [MAIN ] GRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.772474] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRC took 0.6s. Estimated remaining: 6m 34s. Rate: 213.9 symbols/min [2025-09-29T02:01:52.767091] [INFO ] [MAIN ] GPRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.811754] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GPRK took 0.9s. Estimated remaining: 6m 33s. Rate: 214.1 symbols/min [2025-09-29T02:01:52.923779] [DEBUG] [LOCAL ] GRDN: Loaded 20178 existing records from primary storage. [2025-09-29T02:01:52.972805] [INFO ] [MAIN ] GRDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.012480] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 0.7s. Estimated remaining: 6m 33s. Rate: 214.1 symbols/min [2025-09-29T02:01:53.402315] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.408582] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.553320] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.607956] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.624396] [DEBUG] [LOCAL ] GROV: Loaded 9240 existing records from primary storage. [2025-09-29T02:01:53.624977] [INFO ] [MAIN ] GROV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.625236] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GROV took 0.5s. Estimated remaining: 6m 33s. Rate: 213.9 symbols/min [2025-09-29T02:01:53.789501] [DEBUG] [LOCAL ] GRND: Loaded 50744 existing records from primary storage. [2025-09-29T02:01:53.807708] [INFO ] [MAIN ] GRND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.831168] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRND took 1.0s. Estimated remaining: 6m 33s. Rate: 213.9 symbols/min [2025-09-29T02:01:53.874308] [DEBUG] [LOCAL ] GRMN: Loaded 41798 existing records from primary storage. [2025-09-29T02:01:53.924592] [DEBUG] [LOCAL ] GRNT: Loaded 34235 existing records from primary storage. [2025-09-29T02:01:53.960954] [INFO ] [MAIN ] GRMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.964549] [INFO ] [MAIN ] GRNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.965613] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.980982] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRMN took 1.2s. Estimated remaining: 6m 32s. Rate: 214.0 symbols/min [2025-09-29T02:01:54.004542] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRNT took 1.1s. Estimated remaining: 6m 32s. Rate: 214.2 symbols/min [2025-09-29T02:01:54.222178] [DEBUG] [LOCAL ] GRX: Loaded 4547 existing records from primary storage. [2025-09-29T02:01:54.306698] [INFO ] [MAIN ] GRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:54.349184] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRX took 0.7s. Estimated remaining: 6m 31s. Rate: 214.2 symbols/min [2025-09-29T02:01:54.438931] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:54.561002] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:54.537226] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:54.744749] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:54.812746] [DEBUG] [LOCAL ] GSBD: Loaded 39756 existing records from primary storage. [2025-09-29T02:01:54.813591] [INFO ] [MAIN ] GSBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:54.813758] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSBD took 0.8s. Estimated remaining: 6m 31s. Rate: 214.0 symbols/min [2025-09-29T02:01:54.994046] [DEBUG] [LOCAL ] GS: Loaded 52736 existing records from primary storage. [2025-09-29T02:01:54.996776] [INFO ] [MAIN ] GS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:54.997535] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GS took 1.1s. Estimated remaining: 6m 31s. Rate: 214.1 symbols/min [2025-09-29T02:01:55.004276] [DEBUG] [LOCAL ] GSL: Loaded 33824 existing records from primary storage. [2025-09-29T02:01:54.996294] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-09-29T02:01:55.030301] [INFO ] [MAIN ] GSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:55.101412] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.042166] [INFO ] [MAIN ] GSK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:55.069717] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSL took 0.5s. Estimated remaining: 6m 30s. Rate: 214.3 symbols/min [2025-09-29T02:01:55.124068] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GSK took 1.1s. Estimated remaining: 6m 30s. Rate: 214.4 symbols/min [2025-09-29T02:01:55.565768] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.681719] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.689001] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.711412] [DEBUG] [LOCAL ] GTES: Loaded 51399 existing records from primary storage. [2025-09-29T02:01:55.712452] [INFO ] [MAIN ] GTES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:55.713242] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 0.9s. Estimated remaining: 6m 30s. Rate: 214.2 symbols/min [2025-09-29T02:01:55.969627] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.992045] [DEBUG] [LOCAL ] GTN: Loaded 46301 existing records from primary storage. [2025-09-29T02:01:55.993250] [DEBUG] [LOCAL ] GTY: Loaded 30796 existing records from primary storage. [2025-09-29T02:01:55.993932] [INFO ] [MAIN ] GTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:55.994822] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTN took 0.9s. Estimated remaining: 6m 30s. Rate: 214.2 symbols/min [2025-09-29T02:01:55.995729] [DEBUG] [LOCAL ] GTLS: Loaded 43461 existing records from primary storage. [2025-09-29T02:01:55.994322] [INFO ] [MAIN ] GTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.019488] [INFO ] [MAIN ] GTLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.013557] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTY took 0.8s. Estimated remaining: 6m 29s. Rate: 214.4 symbols/min [2025-09-29T02:01:56.034915] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GTLS took 1.0s. Estimated remaining: 6m 28s. Rate: 214.6 symbols/min [2025-09-29T02:01:56.254171] [DEBUG] [LOCAL ] GUG: Loaded 12138 existing records from primary storage. [2025-09-29T02:01:56.340115] [INFO ] [MAIN ] GUG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.367111] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GUG took 0.7s. Estimated remaining: 6m 28s. Rate: 214.6 symbols/min [2025-09-29T02:01:56.566030] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:56.542067] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:56.663682] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:56.822278] [DEBUG] [LOCAL ] GWH: Loaded 15825 existing records from primary storage. [2025-09-29T02:01:56.824111] [DEBUG] [LOCAL ] GUT: Loaded 15560 existing records from primary storage. [2025-09-29T02:01:56.825749] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:56.825973] [INFO ] [MAIN ] GUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.824552] [INFO ] [MAIN ] GWH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.826388] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 0.8s. Estimated remaining: 6m 28s. Rate: 214.4 symbols/min [2025-09-29T02:01:56.827284] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GWH took 0.8s. Estimated remaining: 6m 27s. Rate: 214.6 symbols/min [2025-09-29T02:01:57.079443] [DEBUG] [LOCAL ] GVA: Loaded 34030 existing records from primary storage. [2025-09-29T02:01:57.084538] [INFO ] [MAIN ] GVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.085115] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GVA took 1.1s. Estimated remaining: 6m 27s. Rate: 214.7 symbols/min [2025-09-29T02:01:57.338270] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:57.344987] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:57.385499] [DEBUG] [LOCAL ] GWRE: Loaded 41564 existing records from primary storage. [2025-09-29T02:01:57.407905] [INFO ] [MAIN ] GWRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.469231] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:57.469470] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 27s. Rate: 214.6 symbols/min [2025-09-29T02:01:57.564912] [DEBUG] [LOCAL ] GYLD: Loaded 1569 existing records from primary storage. [2025-09-29T02:01:57.589126] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-29T02:01:57.588100] [INFO ] [MAIN ] GYLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.632764] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GYLD took 0.5s. Estimated remaining: 6m 27s. Rate: 214.7 symbols/min [2025-09-29T02:01:57.637230] [INFO ] [MAIN ] GWW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.693056] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GWW took 0.9s. Estimated remaining: 6m 26s. Rate: 214.8 symbols/min [2025-09-29T02:01:57.763006] [DEBUG] [LOCAL ] GXO: Loaded 48260 existing records from primary storage. [2025-09-29T02:01:57.799208] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:57.807759] [INFO ] [MAIN ] GXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.868437] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GXO took 1.0s. Estimated remaining: 6m 26s. Rate: 214.9 symbols/min [2025-09-29T02:01:58.242341] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:58.266426] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:58.363749] [DEBUG] [LOCAL ] H: Loaded 45492 existing records from primary storage. [2025-09-29T02:01:58.368220] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:58.368902] [INFO ] [MAIN ] H: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:58.374134] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. H took 0.9s. Estimated remaining: 6m 26s. Rate: 214.7 symbols/min [2025-09-29T02:01:58.550934] [DEBUG] [LOCAL ] HAE: Loaded 40176 existing records from primary storage. [2025-09-29T02:01:58.605841] [INFO ] [MAIN ] HAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:58.633207] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:58.649937] [DEBUG] [LOCAL ] HAFN: Loaded 44189 existing records from primary storage. [2025-09-29T02:01:58.650119] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 1.0s. Estimated remaining: 6m 25s. Rate: 214.7 symbols/min [2025-09-29T02:01:58.651514] [INFO ] [MAIN ] HAFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:58.689192] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 0.9s. Estimated remaining: 6m 25s. Rate: 214.9 symbols/min [2025-09-29T02:01:58.801791] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-29T02:01:58.872819] [INFO ] [MAIN ] HAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:58.905473] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 1.0s. Estimated remaining: 6m 24s. Rate: 215.0 symbols/min [2025-09-29T02:01:59.093184] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.219025] [DEBUG] [LOCAL ] HASI: Loaded 47868 existing records from primary storage. [2025-09-29T02:01:59.217371] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.225193] [INFO ] [MAIN ] HASI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.232139] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HASI took 0.9s. Estimated remaining: 6m 24s. Rate: 214.9 symbols/min [2025-09-29T02:01:59.327857] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.370352] [DEBUG] [LOCAL ] HBB: Loaded 6912 existing records from primary storage. [2025-09-29T02:01:59.397573] [INFO ] [MAIN ] HBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.435391] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HBB took 0.7s. Estimated remaining: 6m 24s. Rate: 215.0 symbols/min [2025-09-29T02:01:59.656393] [DEBUG] [LOCAL ] HAYW: Loaded 49444 existing records from primary storage. [2025-09-29T02:01:59.625599] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.680093] [INFO ] [MAIN ] HAYW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.687437] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HAYW took 1.0s. Estimated remaining: 6m 23s. Rate: 215.0 symbols/min [2025-09-29T02:01:59.774622] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.776243] [DEBUG] [LOCAL ] HBI: Loaded 53769 existing records from primary storage. [2025-09-29T02:01:59.776765] [INFO ] [MAIN ] HBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.777266] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 0.8s. Estimated remaining: 6m 23s. Rate: 215.2 symbols/min [2025-09-29T02:01:59.851261] [DEBUG] [LOCAL ] HBM: Loaded 53683 existing records from primary storage. [2025-09-29T02:01:59.853048] [INFO ] [MAIN ] HBM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.853811] [DEBUG] [LOCAL ] HCA: Loaded 47781 existing records from primary storage. [2025-09-29T02:01:59.854263] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HBM took 0.6s. Estimated remaining: 6m 22s. Rate: 215.3 symbols/min [2025-09-29T02:01:59.854794] [INFO ] [MAIN ] HCA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.855234] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 0.4s. Estimated remaining: 6m 22s. Rate: 215.5 symbols/min [2025-09-29T02:02:00.552483] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:00.545711] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:00.670749] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:00.639939] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:00.672565] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-29T02:02:00.673230] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-29T02:02:00.673501] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-29T02:02:00.673678] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-29T02:02:00.673858] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-29T02:02:00.673918] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-29T02:02:00.806595] [DEBUG] [LOCAL ] HCI: Loaded 14126 existing records from primary storage. [2025-09-29T02:02:00.841108] [INFO ] [MAIN ] HCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:00.898395] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCI took 1.0s. Estimated remaining: 6m 22s. Rate: 214.9 symbols/min [2025-09-29T02:02:01.166175] [DEBUG] [LOCAL ] HCC: Loaded 46057 existing records from primary storage. [2025-09-29T02:02:01.182470] [DEBUG] [LOCAL ] HD: Loaded 54283 existing records from primary storage. [2025-09-29T02:02:01.238859] [INFO ] [MAIN ] HCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:01.249421] [INFO ] [MAIN ] HD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:01.368920] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:01.293901] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCC took 1.4s. Estimated remaining: 6m 22s. Rate: 214.9 symbols/min [2025-09-29T02:02:01.371880] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-29T02:02:01.379055] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HD took 1.5s. Estimated remaining: 6m 22s. Rate: 215.0 symbols/min [2025-09-29T02:02:01.381242] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:01.776261] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:01.769345] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:02:01.777574] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:01.794275] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-29T02:02:01.822113] [DEBUG] [LOCAL ] HDB: Loaded 52695 existing records from primary storage. [2025-09-29T02:02:01.822829] [INFO ] [MAIN ] HDB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:01.823180] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HDB took 0.9s. Estimated remaining: 6m 22s. Rate: 214.9 symbols/min [2025-09-29T02:02:02.065437] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T02:02:02.061227] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:02.067247] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-29T02:02:02.070634] [DEBUG] [LOCAL ] HEI: Loaded 32846 existing records from primary storage. [2025-09-29T02:02:02.071370] [INFO ] [MAIN ] HEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:02.073158] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HEI took 0.7s. Estimated remaining: 6m 21s. Rate: 214.9 symbols/min [2025-09-29T02:02:02.130794] [DEBUG] [LOCAL ] HEQ: Loaded 6236 existing records from primary storage. [2025-09-29T02:02:02.184928] [DEBUG] [LOCAL ] HE: Loaded 49870 existing records from primary storage. [2025-09-29T02:02:02.195414] [INFO ] [MAIN ] HEQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:02.206700] [INFO ] [MAIN ] HE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:02.206964] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 0.4s. Estimated remaining: 6m 21s. Rate: 215.0 symbols/min [2025-09-29T02:02:02.219298] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.15 seconds). [2025-09-29T02:02:02.229918] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 0.8s. Estimated remaining: 6m 20s. Rate: 215.2 symbols/min [2025-09-29T02:02:02.229795] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-29T02:02:02.377686] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:02.661102] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T02:02:02.662187] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:02.702936] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-29T02:02:02.731126] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-29T02:02:02.736339] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:02.737896] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-29T02:02:02.737826] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-29T02:02:02.738039] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-29T02:02:02.738302] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-29T02:02:02.738869] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-29T02:02:02.750682] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-29T02:02:02.750775] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-29T02:02:02.751325] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-29T02:02:02.751185] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-29T02:02:02.751483] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-29T02:02:02.751615] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-29T02:02:03.006539] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-29T02:02:02.995466] [DEBUG] [LOCAL ] HESM: Loaded 48879 existing records from primary storage. [2025-09-29T02:02:03.021964] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-29T02:02:03.023290] [INFO ] [MAIN ] HESM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:03.054391] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HESM took 1.0s. Estimated remaining: 6m 21s. Rate: 214.8 symbols/min [2025-09-29T02:02:03.320749] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T02:02:03.453276] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-29T02:02:03.740148] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:03.807640] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:03.816175] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T02:02:03.829864] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-29T02:02:03.868093] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-29T02:02:03.865803] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:03.869762] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-29T02:02:03.892719] [DEBUG] [LOCAL ] HFRO: Loaded 17798 existing records from primary storage. [2025-09-29T02:02:03.893032] [INFO ] [MAIN ] HFRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:03.893148] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HFRO took 0.8s. Estimated remaining: 6m 21s. Rate: 214.4 symbols/min [2025-09-29T02:02:04.080269] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-29T02:02:04.081253] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-29T02:02:04.077982] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:04.083837] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-29T02:02:04.085346] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-29T02:02:04.107425] [DEBUG] [LOCAL ] HGER: Loaded 13428 existing records from primary storage. [2025-09-29T02:02:04.107851] [INFO ] [MAIN ] HGER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:04.107963] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HGER took 0.2s. Estimated remaining: 6m 21s. Rate: 214.4 symbols/min [2025-09-29T02:02:04.215332] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-29T02:02:04.222035] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.14 seconds). [2025-09-29T02:02:04.223281] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-29T02:02:04.307684] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-29T02:02:04.299963] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-29T02:02:04.309003] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-29T02:02:04.305220] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:04.324978] [DEBUG] [LOCAL ] HGLB: Loaded 9836 existing records from primary storage. [2025-09-29T02:02:04.325953] [INFO ] [MAIN ] HGLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:04.326058] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HGLB took 0.2s. Estimated remaining: 6m 20s. Rate: 214.5 symbols/min [2025-09-29T02:02:04.446794] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.15 seconds). [2025-09-29T02:02:04.469083] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-29T02:02:04.525556] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-29T02:02:04.527127] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-29T02:02:04.532406] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:04.550430] [DEBUG] [LOCAL ] HGTY: Loaded 13290 existing records from primary storage. [2025-09-29T02:02:04.550821] [INFO ] [MAIN ] HGTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:04.550926] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGTY took 0.2s. Estimated remaining: 6m 20s. Rate: 214.5 symbols/min [2025-09-29T02:02:04.627141] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T02:02:04.652819] [INFO ] [REMOTE ] HCXY: Full fetch complete (592 records). [2025-09-29T02:02:04.669450] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:02:04.685249] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-29T02:02:04.702126] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-29T02:02:04.729478] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:02:04.753042] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:04.748166] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:04.754573] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:04.754721] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-29T02:02:04.754848] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-29T02:02:04.754939] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-29T02:02:04.755045] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-29T02:02:04.755282] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HCXY took 4.9s. Estimated remaining: 6m 20s. Rate: 214.6 symbols/min [2025-09-29T02:02:04.842972] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T02:02:04.886944] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-29T02:02:04.908148] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:02:04.943543] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-29T02:02:04.972369] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:05.010718] [DEBUG] [LOCAL ] HGV: Loaded 47426 existing records from primary storage. [2025-09-29T02:02:05.011333] [INFO ] [MAIN ] HGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:05.011890] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGV took 0.5s. Estimated remaining: 6m 19s. Rate: 214.6 symbols/min [2025-09-29T02:02:05.152469] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:02:05.151961] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-29T02:02:05.167375] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-29T02:02:05.160130] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-29T02:02:05.234369] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:05.235854] [DEBUG] [LOCAL ] HHH: Loaded 33042 existing records from primary storage. [2025-09-29T02:02:05.237376] [INFO ] [MAIN ] HHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:05.237514] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HHH took 0.5s. Estimated remaining: 6m 19s. Rate: 214.6 symbols/min [2025-09-29T02:02:05.438203] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-29T02:02:05.439847] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-29T02:02:05.460618] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-29T02:02:05.483070] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-29T02:02:05.485709] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:05.489025] [DEBUG] [LOCAL ] HI: Loaded 35713 existing records from primary storage. [2025-09-29T02:02:05.489820] [INFO ] [MAIN ] HI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:05.490175] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HI took 0.5s. Estimated remaining: 6m 19s. Rate: 214.6 symbols/min [2025-09-29T02:02:05.636140] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:02:05.650329] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-29T02:02:05.749778] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:05.753285] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-29T02:02:05.754998] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-29T02:02:05.779380] [DEBUG] [LOCAL ] HIG: Loaded 51962 existing records from primary storage. [2025-09-29T02:02:05.779877] [INFO ] [MAIN ] HIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:05.780487] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HIG took 0.5s. Estimated remaining: 6m 19s. Rate: 214.6 symbols/min [2025-09-29T02:02:05.830911] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-09-29T02:02:05.863262] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-29T02:02:05.917775] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.16 seconds). [2025-09-29T02:02:05.967159] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-29T02:02:06.063707] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.064914] [DEBUG] [LOCAL ] HII: Loaded 35728 existing records from primary storage. [2025-09-29T02:02:06.065725] [INFO ] [MAIN ] HII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:06.066222] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HII took 0.6s. Estimated remaining: 6m 18s. Rate: 214.6 symbols/min [2025-09-29T02:02:06.093031] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-29T02:02:06.119609] [INFO ] [REMOTE ] HF: Full fetch complete (505 records). [2025-09-29T02:02:06.143225] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-29T02:02:06.157699] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:02:06.188847] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:06.189267] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:06.200844] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-29T02:02:06.235586] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T02:02:06.269529] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-29T02:02:06.275139] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-29T02:02:06.274994] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.293100] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-29T02:02:06.294908] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-29T02:02:06.295324] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HF took 4.1s. Estimated remaining: 6m 18s. Rate: 214.7 symbols/min [2025-09-29T02:02:06.453005] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-29T02:02:06.470089] [INFO ] [MAIN ] HIMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:06.489070] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIMS took 0.7s. Estimated remaining: 6m 17s. Rate: 214.7 symbols/min [2025-09-29T02:02:06.548391] [DEBUG] [LOCAL ] HIO: Loaded 24107 existing records from primary storage. [2025-09-29T02:02:06.603963] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.640867] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T02:02:06.619979] [INFO ] [MAIN ] HIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:06.656840] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIO took 0.6s. Estimated remaining: 6m 17s. Rate: 214.8 symbols/min [2025-09-29T02:02:06.695953] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-29T02:02:06.881474] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.951972] [DEBUG] [LOCAL ] HIPO: Loaded 22774 existing records from primary storage. [2025-09-29T02:02:06.976429] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.977748] [INFO ] [MAIN ] HIPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:06.977984] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIPO took 0.7s. Estimated remaining: 6m 17s. Rate: 214.8 symbols/min [2025-09-29T02:02:07.062264] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-29T02:02:07.126009] [INFO ] [REMOTE ] HFND: Full fetch complete (1798 records). [2025-09-29T02:02:07.128002] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-29T02:02:07.256368] [DEBUG] [LOCAL ] HIX: Loaded 20714 existing records from primary storage. [2025-09-29T02:02:07.286141] [INFO ] [MAIN ] HIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:07.287536] [DEBUG] [LOCAL ] HIW: Loaded 45329 existing records from primary storage. [2025-09-29T02:02:07.321480] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIX took 0.7s. Estimated remaining: 6m 17s. Rate: 214.7 symbols/min [2025-09-29T02:02:07.310736] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:07.337627] [INFO ] [MAIN ] HIW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:07.384754] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIW took 0.9s. Estimated remaining: 6m 16s. Rate: 214.9 symbols/min [2025-09-29T02:02:07.715635] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-29T02:02:07.727116] [DEBUG] [LOCAL ] HKD: Loaded 18654 existing records from primary storage. [2025-09-29T02:02:07.797758] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:07.767190] [INFO ] [MAIN ] HKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:07.802054] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:07.802174] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:07.802841] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-29T02:02:07.803033] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HKD took 0.8s. Estimated remaining: 6m 16s. Rate: 214.8 symbols/min [2025-09-29T02:02:07.813547] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-29T02:02:07.840314] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-29T02:02:07.904264] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-29T02:02:07.956555] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:07.952101] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HFND took 5.7s. Estimated remaining: 6m 16s. Rate: 214.9 symbols/min [2025-09-29T02:02:08.225808] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:08.316426] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:08.334827] [DEBUG] [LOCAL ] HLF: Loaded 49357 existing records from primary storage. [2025-09-29T02:02:08.351528] [INFO ] [MAIN ] HLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:08.352156] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 1.0s. Estimated remaining: 6m 15s. Rate: 214.8 symbols/min [2025-09-29T02:02:08.359362] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-09-29T02:02:08.371262] [INFO ] [MAIN ] HL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:08.412211] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HL took 1.1s. Estimated remaining: 6m 15s. Rate: 215.0 symbols/min [2025-09-29T02:02:08.631265] [DEBUG] [LOCAL ] HLIO: Loaded 28490 existing records from primary storage. [2025-09-29T02:02:08.670501] [DEBUG] [LOCAL ] HLI: Loaded 31573 existing records from primary storage. [2025-09-29T02:02:08.669110] [INFO ] [MAIN ] HLIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:08.706916] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:08.707107] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLIO took 0.7s. Estimated remaining: 6m 15s. Rate: 215.0 symbols/min [2025-09-29T02:02:08.705764] [INFO ] [MAIN ] HLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:08.735828] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLI took 0.9s. Estimated remaining: 6m 14s. Rate: 215.1 symbols/min [2025-09-29T02:02:08.894463] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.196279] [DEBUG] [LOCAL ] HLLY: Loaded 33911 existing records from primary storage. [2025-09-29T02:02:09.220916] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.199393] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.221666] [INFO ] [MAIN ] HLLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:09.222564] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLLY took 0.9s. Estimated remaining: 6m 14s. Rate: 215.0 symbols/min [2025-09-29T02:02:09.413587] [DEBUG] [LOCAL ] HLN: Loaded 53861 existing records from primary storage. [2025-09-29T02:02:09.445475] [INFO ] [MAIN ] HLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:09.457591] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLN took 1.0s. Estimated remaining: 6m 14s. Rate: 215.0 symbols/min [2025-09-29T02:02:09.523337] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.535272] [DEBUG] [LOCAL ] HLX: Loaded 48650 existing records from primary storage. [2025-09-29T02:02:09.564342] [INFO ] [MAIN ] HLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:09.581749] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLX took 0.8s. Estimated remaining: 6m 13s. Rate: 215.1 symbols/min [2025-09-29T02:02:09.833693] [DEBUG] [LOCAL ] HLT: Loaded 51450 existing records from primary storage. [2025-09-29T02:02:09.864637] [INFO ] [MAIN ] HLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:09.875439] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLT took 1.2s. Estimated remaining: 6m 13s. Rate: 215.1 symbols/min [2025-09-29T02:02:09.863925] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.996978] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:10.110782] [DEBUG] [LOCAL ] HMC: Loaded 47500 existing records from primary storage. [2025-09-29T02:02:10.149402] [INFO ] [MAIN ] HMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:10.198384] [DEBUG] [LOCAL ] HMN: Loaded 23671 existing records from primary storage. [2025-09-29T02:02:10.204685] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMC took 1.0s. Estimated remaining: 6m 13s. Rate: 215.1 symbols/min [2025-09-29T02:02:10.203541] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:10.204175] [INFO ] [MAIN ] HMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:10.210768] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMN took 0.7s. Estimated remaining: 6m 12s. Rate: 215.3 symbols/min [2025-09-29T02:02:10.205236] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-29T02:02:10.240628] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-29T02:02:10.268763] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-29T02:02:10.284191] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-29T02:02:10.318082] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-29T02:02:10.402116] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-29T02:02:10.595410] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:10.680580] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-09-29T02:02:10.742469] [INFO ] [MAIN ] HMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:10.742337] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:10.759933] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HMY took 1.2s. Estimated remaining: 6m 12s. Rate: 215.1 symbols/min [2025-09-29T02:02:10.971760] [DEBUG] [LOCAL ] HNI: Loaded 29386 existing records from primary storage. [2025-09-29T02:02:11.021254] [INFO ] [MAIN ] HNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:11.043056] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HNI took 0.8s. Estimated remaining: 6m 12s. Rate: 215.1 symbols/min [2025-09-29T02:02:11.139952] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:11.141792] [DEBUG] [LOCAL ] HOG: Loaded 51958 existing records from primary storage. [2025-09-29T02:02:11.142504] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-29T02:02:11.142686] [INFO ] [MAIN ] HOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:11.143312] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOG took 0.9s. Estimated remaining: 6m 11s. Rate: 215.2 symbols/min [2025-09-29T02:02:11.266488] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:11.266883] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-29T02:02:11.266976] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:11.267052] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-09-29T02:02:11.267148] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:11.267249] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-29T02:02:11.267345] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-29T02:02:11.267436] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-29T02:02:11.267532] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-29T02:02:11.267632] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HNGE took 1.4s. Estimated remaining: 6m 11s. Rate: 215.3 symbols/min [2025-09-29T02:02:11.921788] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.044344] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.113800] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.121177] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.143899] [DEBUG] [LOCAL ] HOV: Loaded 13975 existing records from primary storage. [2025-09-29T02:02:12.144295] [INFO ] [MAIN ] HOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:12.144390] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 0.9s. Estimated remaining: 6m 11s. Rate: 214.9 symbols/min [2025-09-29T02:02:12.353869] [DEBUG] [LOCAL ] HOMB: Loaded 44272 existing records from primary storage. [2025-09-29T02:02:12.379409] [DEBUG] [LOCAL ] HOUS: Loaded 44903 existing records from primary storage. [2025-09-29T02:02:12.410131] [INFO ] [MAIN ] HOMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:12.412890] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOMB took 1.1s. Estimated remaining: 6m 11s. Rate: 214.9 symbols/min [2025-09-29T02:02:12.412264] [INFO ] [MAIN ] HOUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:12.461058] [DEBUG] [LOCAL ] HP: Loaded 52313 existing records from primary storage. [2025-09-29T02:02:12.436614] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.448600] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOUS took 1.1s. Estimated remaining: 6m 10s. Rate: 215.1 symbols/min [2025-09-29T02:02:12.484867] [INFO ] [MAIN ] HP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:12.490953] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 1.2s. Estimated remaining: 6m 10s. Rate: 215.3 symbols/min [2025-09-29T02:02:12.973466] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:13.076264] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:13.124632] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:13.158399] [DEBUG] [LOCAL ] HPF: Loaded 7388 existing records from primary storage. [2025-09-29T02:02:13.162184] [INFO ] [MAIN ] HPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:13.162413] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 0.7s. Estimated remaining: 6m 10s. Rate: 215.0 symbols/min [2025-09-29T02:02:13.177231] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-29T02:02:13.188433] [INFO ] [MAIN ] HPE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:13.221444] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPE took 1.1s. Estimated remaining: 6m 10s. Rate: 215.1 symbols/min [2025-09-29T02:02:13.316873] [DEBUG] [LOCAL ] HPI: Loaded 10339 existing records from primary storage. [2025-09-29T02:02:13.421223] [INFO ] [MAIN ] HPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:13.497036] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPI took 1.0s. Estimated remaining: 6m 9s. Rate: 215.1 symbols/min [2025-09-29T02:02:13.485215] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-09-29T02:02:13.623794] [INFO ] [MAIN ] HPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:13.636962] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:13.642752] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 1.1s. Estimated remaining: 6m 9s. Rate: 215.2 symbols/min [2025-09-29T02:02:13.747583] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:14.034407] [DEBUG] [LOCAL ] HPS: Loaded 10277 existing records from primary storage. [2025-09-29T02:02:14.084920] [INFO ] [MAIN ] HPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:14.126329] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPS took 0.9s. Estimated remaining: 6m 9s. Rate: 215.1 symbols/min [2025-09-29T02:02:14.161278] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:14.162415] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:14.315563] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-29T02:02:14.351549] [INFO ] [MAIN ] HPQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:14.365258] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPQ took 1.2s. Estimated remaining: 6m 8s. Rate: 215.1 symbols/min [2025-09-29T02:02:14.364562] [DEBUG] [LOCAL ] HQL: Loaded 16206 existing records from primary storage. [2025-09-29T02:02:14.409414] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:14.437187] [DEBUG] [LOCAL ] HQH: Loaded 25387 existing records from primary storage. [2025-09-29T02:02:14.417831] [INFO ] [MAIN ] HQL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:14.437699] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQL took 0.7s. Estimated remaining: 6m 8s. Rate: 215.3 symbols/min [2025-09-29T02:02:14.437602] [INFO ] [MAIN ] HQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:14.504458] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQH took 1.0s. Estimated remaining: 6m 7s. Rate: 215.4 symbols/min [2025-09-29T02:02:14.901332] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.028950] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.048491] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.067620] [DEBUG] [LOCAL ] HR: Loaded 52716 existing records from primary storage. [2025-09-29T02:02:15.070442] [INFO ] [MAIN ] HR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.071571] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 0.9s. Estimated remaining: 6m 7s. Rate: 215.2 symbols/min [2025-09-29T02:02:15.302105] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.332165] [DEBUG] [LOCAL ] HRI: Loaded 33507 existing records from primary storage. [2025-09-29T02:02:15.332917] [INFO ] [MAIN ] HRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.333077] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRI took 0.9s. Estimated remaining: 6m 7s. Rate: 215.2 symbols/min [2025-09-29T02:02:15.348043] [DEBUG] [LOCAL ] HRB: Loaded 49275 existing records from primary storage. [2025-09-29T02:02:15.359936] [INFO ] [MAIN ] HRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.366173] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRB took 1.0s. Estimated remaining: 6m 7s. Rate: 215.4 symbols/min [2025-09-29T02:02:15.494951] [DEBUG] [LOCAL ] HRL: Loaded 53855 existing records from primary storage. [2025-09-29T02:02:15.551426] [INFO ] [MAIN ] HRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.612567] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRL took 1.1s. Estimated remaining: 6m 6s. Rate: 215.4 symbols/min [2025-09-29T02:02:15.819264] [DEBUG] [LOCAL ] HRTG: Loaded 33658 existing records from primary storage. [2025-09-29T02:02:15.854499] [INFO ] [MAIN ] HRTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.848924] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.864004] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRTG took 0.8s. Estimated remaining: 6m 6s. Rate: 215.4 symbols/min [2025-09-29T02:02:15.913999] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:16.140585] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:16.167511] [DEBUG] [LOCAL ] HSHP: Loaded 15773 existing records from primary storage. [2025-09-29T02:02:16.196470] [INFO ] [MAIN ] HSHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:16.256799] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:16.219276] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSHP took 0.8s. Estimated remaining: 6m 6s. Rate: 215.4 symbols/min [2025-09-29T02:02:16.257344] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-29T02:02:16.257441] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-29T02:02:16.281055] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-29T02:02:16.302825] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-29T02:02:16.343638] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-29T02:02:16.389578] [DEBUG] [LOCAL ] HSBC: Loaded 51868 existing records from primary storage. [2025-09-29T02:02:16.393399] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-29T02:02:16.394236] [INFO ] [MAIN ] HSBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:16.405210] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSBC took 1.1s. Estimated remaining: 6m 5s. Rate: 215.4 symbols/min [2025-09-29T02:02:16.582197] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:16.744727] [DEBUG] [LOCAL ] HSY: Loaded 51161 existing records from primary storage. [2025-09-29T02:02:16.774569] [INFO ] [MAIN ] HSY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:16.820982] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSY took 1.2s. Estimated remaining: 6m 5s. Rate: 215.3 symbols/min [2025-09-29T02:02:17.008753] [DEBUG] [LOCAL ] HTD: Loaded 13754 existing records from primary storage. [2025-09-29T02:02:17.091096] [INFO ] [MAIN ] HTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:17.122087] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTD took 0.9s. Estimated remaining: 6m 5s. Rate: 215.3 symbols/min [2025-09-29T02:02:17.183579] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:17.194346] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-29T02:02:17.194489] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-29T02:02:17.299619] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-29T02:02:17.390000] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-29T02:02:17.389855] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:17.433773] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-29T02:02:17.489959] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-29T02:02:17.616706] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:17.667978] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-29T02:02:17.710485] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:17.869887] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:17.872054] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-29T02:02:17.890446] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:17.919526] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-09-29T02:02:17.956905] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:17.965919] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-29T02:02:17.983363] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-29T02:02:17.965683] [DEBUG] [LOCAL ] HTGC: Loaded 48222 existing records from primary storage. [2025-09-29T02:02:17.983485] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-29T02:02:18.003984] [INFO ] [MAIN ] HTGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:18.039607] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTGC took 1.2s. Estimated remaining: 6m 6s. Rate: 214.9 symbols/min [2025-09-29T02:02:18.013090] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-29T02:02:18.098731] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTB took 2.2s. Estimated remaining: 6m 5s. Rate: 215.0 symbols/min [2025-09-29T02:02:18.051234] [DEBUG] [LOCAL ] HTH: Loaded 32696 existing records from primary storage. [2025-09-29T02:02:18.115443] [INFO ] [MAIN ] HTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:18.176048] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 1.0s. Estimated remaining: 6m 4s. Rate: 215.2 symbols/min [2025-09-29T02:02:18.352182] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:18.401768] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-29T02:02:18.591369] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:18.660714] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T02:02:18.697203] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:18.719312] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-29T02:02:18.756847] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:18.818222] [DEBUG] [LOCAL ] HUBB: Loaded 37650 existing records from primary storage. [2025-09-29T02:02:18.818882] [INFO ] [MAIN ] HUBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:18.818996] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 0.8s. Estimated remaining: 6m 5s. Rate: 214.9 symbols/min [2025-09-29T02:02:18.961464] [DEBUG] [LOCAL ] HUM: Loaded 49568 existing records from primary storage. [2025-09-29T02:02:18.962746] [DEBUG] [LOCAL ] HUBS: Loaded 39953 existing records from primary storage. [2025-09-29T02:02:18.977305] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T02:02:18.999438] [INFO ] [MAIN ] HUBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:18.998777] [INFO ] [MAIN ] HUM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:19.027024] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBS took 0.9s. Estimated remaining: 6m 4s. Rate: 215.0 symbols/min [2025-09-29T02:02:19.031329] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-29T02:02:19.060247] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUM took 0.8s. Estimated remaining: 6m 4s. Rate: 215.1 symbols/min [2025-09-29T02:02:19.087776] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:19.366730] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-29T02:02:19.405347] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-29T02:02:19.398667] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:19.503736] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:19.525245] [DEBUG] [LOCAL ] HUN: Loaded 53976 existing records from primary storage. [2025-09-29T02:02:19.525950] [INFO ] [MAIN ] HUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:19.526722] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUN took 0.7s. Estimated remaining: 6m 4s. Rate: 215.0 symbols/min [2025-09-29T02:02:19.653515] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-29T02:02:19.654340] [DEBUG] [LOCAL ] HVT: Loaded 16133 existing records from primary storage. [2025-09-29T02:02:19.677720] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-29T02:02:19.680182] [INFO ] [MAIN ] HVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:19.695218] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HVT took 0.6s. Estimated remaining: 6m 3s. Rate: 215.1 symbols/min [2025-09-29T02:02:19.746426] [DEBUG] [LOCAL ] HUYA: Loaded 44956 existing records from primary storage. [2025-09-29T02:02:19.806962] [INFO ] [MAIN ] HUYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:19.846684] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:19.857685] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HUYA took 0.8s. Estimated remaining: 6m 3s. Rate: 215.2 symbols/min [2025-09-29T02:02:20.054503] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T02:02:20.095409] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:20.096804] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-29T02:02:20.179770] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:20.239422] [DEBUG] [LOCAL ] HY: Loaded 10192 existing records from primary storage. [2025-09-29T02:02:20.241482] [DEBUG] [LOCAL ] HWM: Loaded 53767 existing records from primary storage. [2025-09-29T02:02:20.241983] [INFO ] [MAIN ] HY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:20.242271] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HY took 0.4s. Estimated remaining: 6m 3s. Rate: 215.1 symbols/min [2025-09-29T02:02:20.242503] [INFO ] [MAIN ] HWM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:20.298215] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HWM took 0.8s. Estimated remaining: 6m 2s. Rate: 215.3 symbols/min [2025-09-29T02:02:20.408056] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T02:02:20.460615] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-29T02:02:20.477330] [DEBUG] [LOCAL ] HXL: Loaded 46661 existing records from primary storage. [2025-09-29T02:02:20.516002] [INFO ] [MAIN ] HXL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:20.577446] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HXL took 0.9s. Estimated remaining: 6m 2s. Rate: 215.2 symbols/min [2025-09-29T02:02:20.584731] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:20.598012] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-29T02:02:20.623435] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-29T02:02:20.680481] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-29T02:02:20.728282] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-29T02:02:20.749018] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:20.783404] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-29T02:02:20.788711] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-29T02:02:20.788880] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-29T02:02:20.810824] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-29T02:02:20.836190] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-29T02:02:20.895575] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-29T02:02:20.895791] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-29T02:02:20.951815] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-29T02:02:20.985935] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-29T02:02:20.996173] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-29T02:02:20.995936] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:21.078151] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.18 seconds). [2025-09-29T02:02:21.131501] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-29T02:02:21.247076] [DEBUG] [LOCAL ] HYI: Loaded 9254 existing records from primary storage. [2025-09-29T02:02:21.315316] [INFO ] [MAIN ] HYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:21.390288] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HYI took 0.8s. Estimated remaining: 6m 2s. Rate: 214.9 symbols/min [2025-09-29T02:02:21.492284] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T02:02:21.513212] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-29T02:02:21.816102] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:21.848994] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-29T02:02:21.955788] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:21.962817] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T02:02:21.993794] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:21.995193] [INFO ] [REMOTE ] HTFC: Full fetch complete (837 records). [2025-09-29T02:02:21.995465] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-29T02:02:21.989891] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-29T02:02:22.160393] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-29T02:02:22.162157] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-29T02:02:22.266228] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-29T02:02:22.267566] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:22.277356] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:22.278231] [DEBUG] [LOCAL ] HYT: Loaded 33853 existing records from primary storage. [2025-09-29T02:02:22.278304] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-29T02:02:22.278596] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-29T02:02:22.278752] [INFO ] [MAIN ] HYT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:22.278878] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-29T02:02:22.279000] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYT took 0.8s. Estimated remaining: 6m 3s. Rate: 214.4 symbols/min [2025-09-29T02:02:22.279312] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-29T02:02:22.330405] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HTFC took 5.9s. Estimated remaining: 6m 2s. Rate: 214.6 symbols/min [2025-09-29T02:02:22.391462] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:02:22.437410] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-29T02:02:22.453779] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-29T02:02:22.475259] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-29T02:02:22.614333] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:22.676639] [DEBUG] [LOCAL ] HYTR: Loaded 3208 existing records from primary storage. [2025-09-29T02:02:22.697198] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:22.697415] [INFO ] [MAIN ] HYTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:22.698266] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYTR took 0.4s. Estimated remaining: 6m 2s. Rate: 214.5 symbols/min [2025-09-29T02:02:22.746727] [DEBUG] [LOCAL ] HZO: Loaded 29733 existing records from primary storage. [2025-09-29T02:02:22.747114] [INFO ] [MAIN ] HZO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:22.747220] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HZO took 0.4s. Estimated remaining: 6m 1s. Rate: 214.7 symbols/min [2025-09-29T02:02:22.792949] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T02:02:22.794285] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-29T02:02:22.811914] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-29T02:02:22.813258] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-29T02:02:22.923141] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.13 seconds). [2025-09-29T02:02:22.924481] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-29T02:02:22.929170] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.12 seconds). [2025-09-29T02:02:22.930505] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-29T02:02:23.048242] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.12 seconds). [2025-09-29T02:02:23.049324] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-29T02:02:23.066013] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.14 seconds). [2025-09-29T02:02:23.067289] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-29T02:02:23.259338] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.19 seconds). [2025-09-29T02:02:23.262247] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-29T02:02:23.262363] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:02:23.264125] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-29T02:02:23.377779] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.12 seconds). [2025-09-29T02:02:23.378863] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-29T02:02:23.382672] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.12 seconds). [2025-09-29T02:02:23.383898] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-29T02:02:23.503751] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.12 seconds). [2025-09-29T02:02:23.504781] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-29T02:02:23.590280] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:02:23.591524] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-29T02:02:23.710118] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:02:23.712946] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-29T02:02:23.713051] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.12 seconds). [2025-09-29T02:02:23.714911] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-29T02:02:23.832743] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.12 seconds). [2025-09-29T02:02:23.835450] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.12 seconds). [2025-09-29T02:02:23.836673] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-29T02:02:23.837944] [INFO ] [REMOTE ] HYAC: Full fetch complete (866 records). [2025-09-29T02:02:23.839116] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-29T02:02:23.839726] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:02:23.839810] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:23.839881] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:23.839958] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-29T02:02:23.840040] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-29T02:02:23.840111] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-29T02:02:23.840294] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-29T02:02:23.840427] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYAC took 3.6s. Estimated remaining: 6m 2s. Rate: 214.1 symbols/min [2025-09-29T02:02:23.957293] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.12 seconds). [2025-09-29T02:02:23.958116] [INFO ] [REMOTE ] HYBX: Full fetch complete (799 records). [2025-09-29T02:02:23.958214] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-29T02:02:24.147530] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T02:02:24.147766] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:24.147847] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:24.147924] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-29T02:02:24.148061] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-29T02:02:24.148138] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-29T02:02:24.148275] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-29T02:02:24.148393] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HYBX took 3.8s. Estimated remaining: 6m 2s. Rate: 214.1 symbols/min [2025-09-29T02:02:24.795435] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:24.878097] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:24.918786] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:24.953818] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:24.962969] [DEBUG] [LOCAL ] IAE: Loaded 6104 existing records from primary storage. [2025-09-29T02:02:24.965203] [INFO ] [MAIN ] IAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:24.965363] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 0.8s. Estimated remaining: 6m 2s. Rate: 213.7 symbols/min [2025-09-29T02:02:25.232524] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:25.261091] [DEBUG] [LOCAL ] IAG: Loaded 54225 existing records from primary storage. [2025-09-29T02:02:25.278492] [INFO ] [MAIN ] IAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:25.282354] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IAG took 1.1s. Estimated remaining: 6m 2s. Rate: 213.7 symbols/min [2025-09-29T02:02:25.308781] [DEBUG] [LOCAL ] IBM: Loaded 54416 existing records from primary storage. [2025-09-29T02:02:25.342145] [INFO ] [MAIN ] IBM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:25.365516] [DEBUG] [LOCAL ] IBN: Loaded 53654 existing records from primary storage. [2025-09-29T02:02:25.359178] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBM took 1.2s. Estimated remaining: 6m 1s. Rate: 213.8 symbols/min [2025-09-29T02:02:25.385080] [INFO ] [MAIN ] IBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:25.445329] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBN took 1.3s. Estimated remaining: 6m 1s. Rate: 214.0 symbols/min [2025-09-29T02:02:25.792556] [DEBUG] [LOCAL ] IBP: Loaded 29584 existing records from primary storage. [2025-09-29T02:02:25.775731] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:25.803511] [INFO ] [MAIN ] IBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:25.818739] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBP took 0.9s. Estimated remaining: 6m 1s. Rate: 213.9 symbols/min [2025-09-29T02:02:25.877872] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:26.050553] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:26.181782] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:26.183508] [DEBUG] [LOCAL ] IBTA: Loaded 38445 existing records from primary storage. [2025-09-29T02:02:26.184395] [INFO ] [MAIN ] IBTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.184948] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IBTA took 0.9s. Estimated remaining: 6m 1s. Rate: 213.8 symbols/min [2025-09-29T02:02:26.388691] [DEBUG] [LOCAL ] ICE: Loaded 53800 existing records from primary storage. [2025-09-29T02:02:26.423080] [DEBUG] [LOCAL ] ICL: Loaded 39135 existing records from primary storage. [2025-09-29T02:02:26.440572] [INFO ] [MAIN ] ICL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.460401] [INFO ] [MAIN ] ICE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.461153] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICE took 1.1s. Estimated remaining: 6m 0s. Rate: 213.9 symbols/min [2025-09-29T02:02:26.460267] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:26.462737] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICL took 1.0s. Estimated remaining: 5m 60s. Rate: 214.0 symbols/min [2025-09-29T02:02:26.608329] [DEBUG] [LOCAL ] IDA: Loaded 32398 existing records from primary storage. [2025-09-29T02:02:26.664173] [INFO ] [MAIN ] IDA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.706869] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDA took 0.9s. Estimated remaining: 5m 59s. Rate: 214.1 symbols/min [2025-09-29T02:02:26.734372] [DEBUG] [LOCAL ] IDE: Loaded 8755 existing records from primary storage. [2025-09-29T02:02:26.785038] [INFO ] [MAIN ] IDE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.880055] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDE took 0.7s. Estimated remaining: 5m 59s. Rate: 214.1 symbols/min [2025-09-29T02:02:26.955800] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.022705] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.253005] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.285220] [DEBUG] [LOCAL ] IDT: Loaded 17885 existing records from primary storage. [2025-09-29T02:02:27.323834] [INFO ] [MAIN ] IDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:27.356710] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.355685] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDT took 0.9s. Estimated remaining: 5m 59s. Rate: 214.0 symbols/min [2025-09-29T02:02:27.513926] [DEBUG] [LOCAL ] IEX: Loaded 38978 existing records from primary storage. [2025-09-29T02:02:27.569606] [INFO ] [MAIN ] IEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:27.581350] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 1.1s. Estimated remaining: 5m 59s. Rate: 214.0 symbols/min [2025-09-29T02:02:27.625837] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.626394] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-09-29T02:02:27.639200] [DEBUG] [LOCAL ] IFF: Loaded 51727 existing records from primary storage. [2025-09-29T02:02:27.697619] [INFO ] [MAIN ] IFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:27.709207] [INFO ] [MAIN ] IFF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:27.703540] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 0.7s. Estimated remaining: 5m 58s. Rate: 214.2 symbols/min [2025-09-29T02:02:27.736293] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 1.0s. Estimated remaining: 5m 57s. Rate: 214.3 symbols/min [2025-09-29T02:02:28.077220] [DEBUG] [LOCAL ] IFS: Loaded 23359 existing records from primary storage. [2025-09-29T02:02:28.078715] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:28.089262] [INFO ] [MAIN ] IFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:28.161801] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFS took 0.8s. Estimated remaining: 5m 57s. Rate: 214.2 symbols/min [2025-09-29T02:02:28.244812] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:28.295569] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:28.352044] [DEBUG] [LOCAL ] IGA: Loaded 9779 existing records from primary storage. [2025-09-29T02:02:28.419581] [DEBUG] [LOCAL ] IGI: Loaded 3756 existing records from primary storage. [2025-09-29T02:02:28.422714] [INFO ] [MAIN ] IGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:28.422427] [DEBUG] [LOCAL ] IGD: Loaded 19170 existing records from primary storage. [2025-09-29T02:02:28.419890] [INFO ] [MAIN ] IGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:28.428401] [INFO ] [MAIN ] IGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:28.428524] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGI took 0.6s. Estimated remaining: 5m 57s. Rate: 214.2 symbols/min [2025-09-29T02:02:28.454902] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGD took 0.7s. Estimated remaining: 5m 57s. Rate: 214.4 symbols/min [2025-09-29T02:02:28.538759] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:28.544154] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGA took 0.8s. Estimated remaining: 5m 56s. Rate: 214.6 symbols/min [2025-09-29T02:02:28.995502] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.129834] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.137151] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.139154] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-09-29T02:02:29.142175] [DEBUG] [LOCAL ] IH: Loaded 3450 existing records from primary storage. [2025-09-29T02:02:29.143073] [INFO ] [MAIN ] IGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.143414] [INFO ] [MAIN ] IH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.143881] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGR took 0.9s. Estimated remaining: 5m 56s. Rate: 214.3 symbols/min [2025-09-29T02:02:29.149686] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IH took 0.7s. Estimated remaining: 5m 55s. Rate: 214.5 symbols/min [2025-09-29T02:02:29.269966] [DEBUG] [LOCAL ] IHD: Loaded 7225 existing records from primary storage. [2025-09-29T02:02:29.338052] [INFO ] [MAIN ] IHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.354046] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IHD took 0.8s. Estimated remaining: 5m 55s. Rate: 214.6 symbols/min [2025-09-29T02:02:29.518894] [DEBUG] [LOCAL ] IHG: Loaded 24977 existing records from primary storage. [2025-09-29T02:02:29.622792] [INFO ] [MAIN ] IHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.643496] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHG took 1.1s. Estimated remaining: 5m 55s. Rate: 214.6 symbols/min [2025-09-29T02:02:29.684065] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.745796] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.902631] [DEBUG] [LOCAL ] IIF: Loaded 5787 existing records from primary storage. [2025-09-29T02:02:29.930381] [INFO ] [MAIN ] IIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.924595] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.951451] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIF took 0.8s. Estimated remaining: 5m 55s. Rate: 214.5 symbols/min [2025-09-29T02:02:30.090596] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:30.155944] [DEBUG] [LOCAL ] IHS: Loaded 39400 existing records from primary storage. [2025-09-29T02:02:30.178923] [INFO ] [MAIN ] IHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:30.194578] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 1.1s. Estimated remaining: 5m 54s. Rate: 214.6 symbols/min [2025-09-29T02:02:30.267974] [DEBUG] [LOCAL ] IIIN: Loaded 16828 existing records from primary storage. [2025-09-29T02:02:30.309811] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:30.310028] [INFO ] [MAIN ] IIIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:30.310367] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 0.9s. Estimated remaining: 5m 54s. Rate: 214.7 symbols/min [2025-09-29T02:02:30.417175] [DEBUG] [LOCAL ] IIM: Loaded 16102 existing records from primary storage. [2025-09-29T02:02:30.473456] [INFO ] [MAIN ] IIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:30.537382] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 0.9s. Estimated remaining: 5m 53s. Rate: 214.7 symbols/min [2025-09-29T02:02:30.623909] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:30.753325] [DEBUG] [LOCAL ] IIPR: Loaded 30052 existing records from primary storage. [2025-09-29T02:02:30.802629] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:30.833104] [INFO ] [MAIN ] IIPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:30.837670] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIPR took 0.9s. Estimated remaining: 5m 53s. Rate: 214.7 symbols/min [2025-09-29T02:02:31.032368] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:31.146549] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:31.168408] [DEBUG] [LOCAL ] IMAX: Loaded 43382 existing records from primary storage. [2025-09-29T02:02:31.169271] [INFO ] [MAIN ] IMAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:31.169860] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IMAX took 0.9s. Estimated remaining: 5m 53s. Rate: 214.7 symbols/min [2025-09-29T02:02:31.281400] [DEBUG] [LOCAL ] INFA: Loaded 50602 existing records from primary storage. [2025-09-29T02:02:31.292915] [INFO ] [MAIN ] INFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:31.323332] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 1.0s. Estimated remaining: 5m 53s. Rate: 214.8 symbols/min [2025-09-29T02:02:31.502159] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:31.504383] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-29T02:02:31.545116] [INFO ] [MAIN ] INFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:31.571068] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 0.9s. Estimated remaining: 5m 52s. Rate: 214.8 symbols/min [2025-09-29T02:02:31.576389] [DEBUG] [LOCAL ] ING: Loaded 51537 existing records from primary storage. [2025-09-29T02:02:31.614749] [INFO ] [MAIN ] ING: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:31.634214] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. ING took 0.8s. Estimated remaining: 5m 52s. Rate: 214.9 symbols/min [2025-09-29T02:02:31.754543] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:31.990173] [DEBUG] [LOCAL ] INGM: Loaded 29224 existing records from primary storage. [2025-09-29T02:02:32.029328] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:32.035537] [INFO ] [MAIN ] INGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:32.051535] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGM took 0.9s. Estimated remaining: 5m 52s. Rate: 214.8 symbols/min [2025-09-29T02:02:32.166556] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:32.212055] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-29T02:02:32.225289] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-29T02:02:32.257550] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-29T02:02:32.269895] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-29T02:02:32.284585] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-29T02:02:32.284876] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-29T02:02:32.291940] [DEBUG] [LOCAL ] INGR: Loaded 33913 existing records from primary storage. [2025-09-29T02:02:32.333159] [INFO ] [MAIN ] INGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:32.359418] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGR took 1.0s. Estimated remaining: 5m 51s. Rate: 214.8 symbols/min [2025-09-29T02:02:32.493249] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:32.627120] [DEBUG] [LOCAL ] INN: Loaded 42433 existing records from primary storage. [2025-09-29T02:02:32.730599] [INFO ] [MAIN ] INN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:32.752685] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 1.2s. Estimated remaining: 5m 51s. Rate: 214.7 symbols/min [2025-09-29T02:02:32.918344] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:33.166103] [DEBUG] [LOCAL ] INSP: Loaded 37492 existing records from primary storage. [2025-09-29T02:02:33.208788] [INFO ] [MAIN ] INSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.310760] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 1.2s. Estimated remaining: 5m 51s. Rate: 214.5 symbols/min [2025-09-29T02:02:33.315237] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:33.310565] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:33.369605] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-29T02:02:33.413942] [DEBUG] [LOCAL ] INSW: Loaded 40831 existing records from primary storage. [2025-09-29T02:02:33.446755] [INFO ] [MAIN ] INSW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.452998] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSW took 1.1s. Estimated remaining: 5m 51s. Rate: 214.6 symbols/min [2025-09-29T02:02:33.575239] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:33.597297] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:33.625564] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-29T02:02:33.643198] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:33.657774] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-09-29T02:02:33.658983] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:33.670438] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-29T02:02:33.720832] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-29T02:02:33.767832] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:33.762284] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-29T02:02:33.787217] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-29T02:02:33.787363] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INR took 2.1s. Estimated remaining: 5m 51s. Rate: 214.6 symbols/min [2025-09-29T02:02:33.789941] [DEBUG] [LOCAL ] INVH: Loaded 53918 existing records from primary storage. [2025-09-29T02:02:33.791327] [INFO ] [MAIN ] INVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.791889] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVH took 1.0s. Estimated remaining: 5m 50s. Rate: 214.8 symbols/min [2025-09-29T02:02:33.803722] [DEBUG] [LOCAL ] INVX: Loaded 29366 existing records from primary storage. [2025-09-29T02:02:33.804100] [INFO ] [MAIN ] INVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.804243] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVX took 0.5s. Estimated remaining: 5m 49s. Rate: 215.0 symbols/min [2025-09-29T02:02:33.856714] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-29T02:02:33.857140] [INFO ] [MAIN ] IONQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.857429] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 0.4s. Estimated remaining: 5m 49s. Rate: 215.1 symbols/min [2025-09-29T02:02:34.507608] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:34.595443] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:34.661831] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:34.682724] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:34.716142] [DEBUG] [LOCAL ] IPI: Loaded 21704 existing records from primary storage. [2025-09-29T02:02:34.717580] [INFO ] [MAIN ] IPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:34.717719] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 0.8s. Estimated remaining: 5m 49s. Rate: 214.7 symbols/min [2025-09-29T02:02:34.938514] [DEBUG] [LOCAL ] IOT: Loaded 54249 existing records from primary storage. [2025-09-29T02:02:35.040122] [INFO ] [MAIN ] IOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.043465] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-09-29T02:02:35.044530] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IOT took 1.2s. Estimated remaining: 5m 49s. Rate: 214.7 symbols/min [2025-09-29T02:02:35.042277] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.066920] [INFO ] [MAIN ] IPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.074181] [DEBUG] [LOCAL ] IP: Loaded 54093 existing records from primary storage. [2025-09-29T02:02:35.095951] [INFO ] [MAIN ] IP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.103007] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IPG took 1.2s. Estimated remaining: 5m 49s. Rate: 214.8 symbols/min [2025-09-29T02:02:35.143483] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 1.2s. Estimated remaining: 5m 48s. Rate: 215.0 symbols/min [2025-09-29T02:02:35.468630] [DEBUG] [LOCAL ] IQI: Loaded 18161 existing records from primary storage. [2025-09-29T02:02:35.529112] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.534627] [INFO ] [MAIN ] IQI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.594334] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 0.9s. Estimated remaining: 5m 48s. Rate: 214.9 symbols/min [2025-09-29T02:02:35.713399] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.738001] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.945763] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.964181] [DEBUG] [LOCAL ] IQV: Loaded 50895 existing records from primary storage. [2025-09-29T02:02:35.965083] [INFO ] [MAIN ] IQV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.965443] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IQV took 0.9s. Estimated remaining: 5m 48s. Rate: 214.8 symbols/min [2025-09-29T02:02:36.133812] [DEBUG] [LOCAL ] IRM: Loaded 50159 existing records from primary storage. [2025-09-29T02:02:36.146338] [INFO ] [MAIN ] IRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.180862] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRM took 0.9s. Estimated remaining: 5m 47s. Rate: 214.9 symbols/min [2025-09-29T02:02:36.287999] [DEBUG] [LOCAL ] IR: Loaded 53470 existing records from primary storage. [2025-09-29T02:02:36.298272] [DEBUG] [LOCAL ] IRS: Loaded 22136 existing records from primary storage. [2025-09-29T02:02:36.355461] [INFO ] [MAIN ] IR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.355322] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:36.367542] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IR took 1.2s. Estimated remaining: 5m 47s. Rate: 214.9 symbols/min [2025-09-29T02:02:36.361017] [INFO ] [MAIN ] IRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.396550] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRS took 0.7s. Estimated remaining: 5m 46s. Rate: 215.1 symbols/min [2025-09-29T02:02:36.633557] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:36.817157] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:36.901292] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:36.932144] [DEBUG] [LOCAL ] IRT: Loaded 51146 existing records from primary storage. [2025-09-29T02:02:36.930055] [DEBUG] [LOCAL ] ISD: Loaded 15803 existing records from primary storage. [2025-09-29T02:02:36.933895] [INFO ] [MAIN ] IRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.934735] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IRT took 1.0s. Estimated remaining: 5m 46s. Rate: 214.9 symbols/min [2025-09-29T02:02:36.934156] [INFO ] [MAIN ] ISD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.947748] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ISD took 0.8s. Estimated remaining: 5m 46s. Rate: 215.1 symbols/min [2025-09-29T02:02:37.239977] [DEBUG] [LOCAL ] ITGR: Loaded 31996 existing records from primary storage. [2025-09-29T02:02:37.300621] [DEBUG] [LOCAL ] IT: Loaded 42234 existing records from primary storage. [2025-09-29T02:02:37.319558] [INFO ] [MAIN ] ITGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:37.319804] [INFO ] [MAIN ] IT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:37.346241] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:37.412101] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:37.356055] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ITGR took 0.9s. Estimated remaining: 5m 46s. Rate: 215.0 symbols/min [2025-09-29T02:02:37.417784] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. IT took 1.0s. Estimated remaining: 5m 45s. Rate: 215.2 symbols/min [2025-09-29T02:02:37.721809] [DEBUG] [LOCAL ] ITT: Loaded 33511 existing records from primary storage. [2025-09-29T02:02:37.776099] [INFO ] [MAIN ] ITT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:37.859572] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:37.858110] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 0.9s. Estimated remaining: 5m 45s. Rate: 215.1 symbols/min [2025-09-29T02:02:37.857217] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:38.024287] [DEBUG] [LOCAL ] ITUB: Loaded 54084 existing records from primary storage. [2025-09-29T02:02:38.041669] [INFO ] [MAIN ] ITUB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:38.042412] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITUB took 1.1s. Estimated remaining: 5m 45s. Rate: 215.1 symbols/min [2025-09-29T02:02:38.142159] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:38.301530] [DEBUG] [LOCAL ] IVR: Loaded 48557 existing records from primary storage. [2025-09-29T02:02:38.302159] [DEBUG] [LOCAL ] ITW: Loaded 46782 existing records from primary storage. [2025-09-29T02:02:38.308626] [INFO ] [MAIN ] IVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:38.309399] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. IVR took 0.9s. Estimated remaining: 5m 44s. Rate: 215.1 symbols/min [2025-09-29T02:02:38.314875] [INFO ] [MAIN ] ITW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:38.380200] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. ITW took 1.0s. Estimated remaining: 5m 44s. Rate: 215.3 symbols/min [2025-09-29T02:02:38.558106] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:38.559395] [DEBUG] [LOCAL ] IVT: Loaded 31325 existing records from primary storage. [2025-09-29T02:02:38.644407] [INFO ] [MAIN ] IVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:38.675803] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVT took 0.8s. Estimated remaining: 5m 44s. Rate: 215.3 symbols/min [2025-09-29T02:02:38.915212] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:38.976982] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:39.113381] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:39.144561] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-09-29T02:02:39.145913] [INFO ] [MAIN ] IVZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:39.146856] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVZ took 1.1s. Estimated remaining: 5m 44s. Rate: 215.1 symbols/min [2025-09-29T02:02:39.187253] [DEBUG] [LOCAL ] IX: Loaded 22926 existing records from primary storage. [2025-09-29T02:02:39.214699] [INFO ] [MAIN ] IX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:39.262984] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IX took 0.9s. Estimated remaining: 5m 43s. Rate: 215.2 symbols/min [2025-09-29T02:02:39.333602] [DEBUG] [LOCAL ] J: Loaded 40873 existing records from primary storage. [2025-09-29T02:02:39.419769] [INFO ] [MAIN ] J: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:39.489117] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. J took 1.1s. Estimated remaining: 5m 43s. Rate: 215.3 symbols/min [2025-09-29T02:02:39.523429] [DEBUG] [LOCAL ] JBGS: Loaded 43089 existing records from primary storage. [2025-09-29T02:02:39.572074] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:39.605110] [INFO ] [MAIN ] JBGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:39.626155] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBGS took 0.9s. Estimated remaining: 5m 42s. Rate: 215.4 symbols/min [2025-09-29T02:02:39.941620] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:39.968104] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:40.048510] [DEBUG] [LOCAL ] JBI: Loaded 44362 existing records from primary storage. [2025-09-29T02:02:40.073424] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:40.074571] [INFO ] [MAIN ] JBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:40.075293] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBI took 0.9s. Estimated remaining: 5m 42s. Rate: 215.3 symbols/min [2025-09-29T02:02:40.074771] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-29T02:02:40.075746] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-29T02:02:40.114365] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-29T02:02:40.139403] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-29T02:02:40.188920] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-29T02:02:40.236065] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-29T02:02:40.242908] [DEBUG] [LOCAL ] JBND: Loaded 26051 existing records from primary storage. [2025-09-29T02:02:40.295095] [INFO ] [MAIN ] JBND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:40.390614] [DEBUG] [LOCAL ] JBL: Loaded 49145 existing records from primary storage. [2025-09-29T02:02:40.396735] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBND took 0.9s. Estimated remaining: 5m 42s. Rate: 215.2 symbols/min [2025-09-29T02:02:40.407232] [INFO ] [MAIN ] JBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:40.475921] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:40.531807] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-29T02:02:40.510278] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBL took 1.2s. Estimated remaining: 5m 42s. Rate: 215.3 symbols/min [2025-09-29T02:02:40.538389] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-29T02:02:40.564830] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-29T02:02:40.602470] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-29T02:02:40.667141] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-29T02:02:40.667452] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-29T02:02:41.436213] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:41.580521] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:41.724805] [DEBUG] [LOCAL ] JCE: Loaded 6591 existing records from primary storage. [2025-09-29T02:02:41.725313] [INFO ] [MAIN ] JCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:41.742802] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JCE took 1.2s. Estimated remaining: 5m 42s. Rate: 214.7 symbols/min [2025-09-29T02:02:41.761428] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:41.786340] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-29T02:02:42.106756] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:42.136160] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:42.142941] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:42.160193] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-29T02:02:42.160354] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-29T02:02:42.161793] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:42.161902] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-09-29T02:02:42.161985] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:42.162051] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-29T02:02:42.162198] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-29T02:02:42.162670] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-29T02:02:42.164708] [DEBUG] [LOCAL ] JCI: Loaded 54327 existing records from primary storage. [2025-09-29T02:02:42.162802] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-29T02:02:42.165490] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBS took 2.5s. Estimated remaining: 5m 42s. Rate: 214.6 symbols/min [2025-09-29T02:02:42.165689] [INFO ] [MAIN ] JCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:42.166571] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCI took 1.6s. Estimated remaining: 5m 42s. Rate: 214.8 symbols/min [2025-09-29T02:02:42.277588] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:42.350238] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-29T02:02:42.376006] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:42.389565] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-09-29T02:02:42.410532] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:42.446278] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-29T02:02:42.505519] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:42.528082] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-29T02:02:42.562608] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-29T02:02:42.568262] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:42.568812] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-29T02:02:42.569554] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JBTM took 2.5s. Estimated remaining: 5m 41s. Rate: 214.7 symbols/min [2025-09-29T02:02:42.624771] [DEBUG] [LOCAL ] JEF: Loaded 50763 existing records from primary storage. [2025-09-29T02:02:42.674486] [INFO ] [MAIN ] JEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:42.695817] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JEF took 0.9s. Estimated remaining: 5m 41s. Rate: 214.8 symbols/min [2025-09-29T02:02:42.701982] [DEBUG] [LOCAL ] JEQ: Loaded 9336 existing records from primary storage. [2025-09-29T02:02:42.718562] [INFO ] [MAIN ] JEQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:42.763710] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEQ took 0.6s. Estimated remaining: 5m 41s. Rate: 215.0 symbols/min [2025-09-29T02:02:43.068463] [DEBUG] [LOCAL ] JELD: Loaded 46791 existing records from primary storage. [2025-09-29T02:02:43.066756] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.090005] [INFO ] [MAIN ] JELD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:43.124016] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JELD took 1.0s. Estimated remaining: 5m 40s. Rate: 214.9 symbols/min [2025-09-29T02:02:43.217608] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.337256] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.479315] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.479515] [DEBUG] [LOCAL ] JGH: Loaded 11064 existing records from primary storage. [2025-09-29T02:02:43.492372] [INFO ] [MAIN ] JGH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:43.493280] [DEBUG] [LOCAL ] JFR: Loaded 30975 existing records from primary storage. [2025-09-29T02:02:43.493921] [INFO ] [MAIN ] JFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:43.493552] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JGH took 0.8s. Estimated remaining: 5m 40s. Rate: 214.8 symbols/min [2025-09-29T02:02:43.500409] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JFR took 0.9s. Estimated remaining: 5m 40s. Rate: 215.0 symbols/min [2025-09-29T02:02:43.601397] [DEBUG] [LOCAL ] JHI: Loaded 3641 existing records from primary storage. [2025-09-29T02:02:43.664317] [INFO ] [MAIN ] JHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:43.732573] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHI took 0.6s. Estimated remaining: 5m 39s. Rate: 215.1 symbols/min [2025-09-29T02:02:43.920031] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.965241] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.880317] [DEBUG] [LOCAL ] JHG: Loaded 48497 existing records from primary storage. [2025-09-29T02:02:44.005513] [INFO ] [MAIN ] JHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.017928] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 1.2s. Estimated remaining: 5m 39s. Rate: 215.0 symbols/min [2025-09-29T02:02:44.049752] [DEBUG] [LOCAL ] JHS: Loaded 2878 existing records from primary storage. [2025-09-29T02:02:44.139824] [INFO ] [MAIN ] JHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.202835] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHS took 0.7s. Estimated remaining: 5m 39s. Rate: 215.1 symbols/min [2025-09-29T02:02:44.232514] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:44.336603] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:44.359484] [DEBUG] [LOCAL ] JHX: Loaded 51216 existing records from primary storage. [2025-09-29T02:02:44.359983] [INFO ] [MAIN ] JHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.360457] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JHX took 0.9s. Estimated remaining: 5m 38s. Rate: 215.2 symbols/min [2025-09-29T02:02:44.368416] [DEBUG] [LOCAL ] JILL: Loaded 16931 existing records from primary storage. [2025-09-29T02:02:44.368999] [INFO ] [MAIN ] JILL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.369186] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JILL took 0.6s. Estimated remaining: 5m 38s. Rate: 215.4 symbols/min [2025-09-29T02:02:44.410377] [DEBUG] [LOCAL ] JKS: Loaded 40672 existing records from primary storage. [2025-09-29T02:02:44.410808] [INFO ] [MAIN ] JKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.410913] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 0.4s. Estimated remaining: 5m 37s. Rate: 215.5 symbols/min [2025-09-29T02:02:45.073595] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.126060] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-29T02:02:45.095601] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.182182] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-29T02:02:45.183186] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.207265] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.207709] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-29T02:02:45.208388] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-29T02:02:45.208494] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-29T02:02:45.208579] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-29T02:02:45.278008] [DEBUG] [LOCAL ] JLS: Loaded 4142 existing records from primary storage. [2025-09-29T02:02:45.306406] [INFO ] [MAIN ] JLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:45.337861] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JLS took 0.9s. Estimated remaining: 5m 38s. Rate: 215.1 symbols/min [2025-09-29T02:02:45.415534] [DEBUG] [LOCAL ] JLL: Loaded 32458 existing records from primary storage. [2025-09-29T02:02:45.476164] [INFO ] [MAIN ] JLL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:45.540473] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLL took 1.1s. Estimated remaining: 5m 37s. Rate: 215.1 symbols/min [2025-09-29T02:02:45.751763] [DEBUG] [LOCAL ] JMIA: Loaded 51279 existing records from primary storage. [2025-09-29T02:02:45.807770] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.803312] [INFO ] [MAIN ] JMIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:45.891580] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 1.5s. Estimated remaining: 5m 37s. Rate: 215.1 symbols/min [2025-09-29T02:02:46.063741] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:46.220487] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:46.221178] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-29T02:02:46.305089] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:46.372826] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-29T02:02:46.384368] [INFO ] [MAIN ] JNJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:46.399567] [DEBUG] [LOCAL ] JOE: Loaded 24860 existing records from primary storage. [2025-09-29T02:02:46.402788] [INFO ] [MAIN ] JOE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:46.402022] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JNJ took 1.0s. Estimated remaining: 5m 37s. Rate: 214.9 symbols/min [2025-09-29T02:02:46.426923] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-09-29T02:02:46.420306] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOE took 0.5s. Estimated remaining: 5m 36s. Rate: 215.1 symbols/min [2025-09-29T02:02:46.464484] [INFO ] [MAIN ] JOBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:46.480725] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOBY took 0.9s. Estimated remaining: 5m 36s. Rate: 215.3 symbols/min [2025-09-29T02:02:46.625004] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:02:46.694205] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-29T02:02:46.951292] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:46.987520] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.025891] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T02:02:47.046769] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-29T02:02:47.070356] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.076742] [DEBUG] [LOCAL ] JOF: Loaded 7177 existing records from primary storage. [2025-09-29T02:02:47.077187] [INFO ] [MAIN ] JOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.077317] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOF took 0.7s. Estimated remaining: 5m 36s. Rate: 215.1 symbols/min [2025-09-29T02:02:47.287077] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.318247] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-29T02:02:47.318847] [INFO ] [MAIN ] JPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.319277] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JPM took 0.8s. Estimated remaining: 5m 36s. Rate: 215.1 symbols/min [2025-09-29T02:02:47.444066] [DEBUG] [LOCAL ] JPC: Loaded 37620 existing records from primary storage. [2025-09-29T02:02:47.464041] [INFO ] [MAIN ] JPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.444380] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T02:02:47.469745] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JPC took 1.0s. Estimated remaining: 5m 35s. Rate: 215.2 symbols/min [2025-09-29T02:02:47.486998] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-29T02:02:47.633625] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.670543] [DEBUG] [LOCAL ] JQC: Loaded 34194 existing records from primary storage. [2025-09-29T02:02:47.694821] [INFO ] [MAIN ] JQC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.699221] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JQC took 0.6s. Estimated remaining: 5m 35s. Rate: 215.2 symbols/min [2025-09-29T02:02:47.827830] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.869962] [DEBUG] [LOCAL ] JRI: Loaded 15068 existing records from primary storage. [2025-09-29T02:02:47.894086] [INFO ] [MAIN ] JRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.893935] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-29T02:02:47.904804] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRI took 0.6s. Estimated remaining: 5m 35s. Rate: 215.2 symbols/min [2025-09-29T02:02:47.911042] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-29T02:02:48.124033] [DEBUG] [LOCAL ] JRS: Loaded 11250 existing records from primary storage. [2025-09-29T02:02:48.123387] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:48.137988] [INFO ] [MAIN ] JRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:48.138597] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRS took 0.6s. Estimated remaining: 5m 34s. Rate: 215.3 symbols/min [2025-09-29T02:02:48.314775] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T02:02:48.326510] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:48.338931] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-29T02:02:48.446684] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:48.466496] [DEBUG] [LOCAL ] JXN: Loaded 46558 existing records from primary storage. [2025-09-29T02:02:48.467884] [INFO ] [MAIN ] JXN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:48.468627] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 0.7s. Estimated remaining: 5m 34s. Rate: 215.2 symbols/min [2025-09-29T02:02:48.610864] [DEBUG] [LOCAL ] KAI: Loaded 13729 existing records from primary storage. [2025-09-29T02:02:48.611425] [INFO ] [MAIN ] KAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:48.622811] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 0.5s. Estimated remaining: 5m 34s. Rate: 215.3 symbols/min [2025-09-29T02:02:48.708943] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T02:02:48.762353] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:48.760417] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-29T02:02:48.822840] [DEBUG] [LOCAL ] K: Loaded 50637 existing records from primary storage. [2025-09-29T02:02:48.840017] [INFO ] [MAIN ] K: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:48.851308] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. K took 0.9s. Estimated remaining: 5m 33s. Rate: 215.4 symbols/min [2025-09-29T02:02:48.972818] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.125443] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-29T02:02:49.121457] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.132799] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-29T02:02:49.150348] [DEBUG] [LOCAL ] KAR: Loaded 40411 existing records from primary storage. [2025-09-29T02:02:49.151251] [INFO ] [MAIN ] KAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:49.151365] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 0.7s. Estimated remaining: 5m 33s. Rate: 215.3 symbols/min [2025-09-29T02:02:49.234717] [DEBUG] [LOCAL ] KB: Loaded 24453 existing records from primary storage. [2025-09-29T02:02:49.269249] [INFO ] [MAIN ] KB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:49.292161] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 0.7s. Estimated remaining: 5m 33s. Rate: 215.4 symbols/min [2025-09-29T02:02:49.362611] [DEBUG] [LOCAL ] KBDC: Loaded 21252 existing records from primary storage. [2025-09-29T02:02:49.438426] [INFO ] [MAIN ] KBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:49.432625] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.463721] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 0.6s. Estimated remaining: 5m 32s. Rate: 215.5 symbols/min [2025-09-29T02:02:49.501704] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T02:02:49.558294] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-29T02:02:49.709281] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.802888] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.822580] [DEBUG] [LOCAL ] KBH: Loaded 49678 existing records from primary storage. [2025-09-29T02:02:49.823359] [INFO ] [MAIN ] KBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:49.823924] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBH took 0.7s. Estimated remaining: 5m 32s. Rate: 215.4 symbols/min [2025-09-29T02:02:49.961027] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-29T02:02:49.967958] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-29T02:02:50.064613] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:50.082523] [DEBUG] [LOCAL ] KBR: Loaded 48899 existing records from primary storage. [2025-09-29T02:02:50.083425] [INFO ] [MAIN ] KBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:50.083883] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBR took 0.8s. Estimated remaining: 5m 32s. Rate: 215.5 symbols/min [2025-09-29T02:02:50.192950] [DEBUG] [LOCAL ] KEN: Loaded 4784 existing records from primary storage. [2025-09-29T02:02:50.211260] [INFO ] [MAIN ] KEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:50.224041] [DEBUG] [LOCAL ] KD: Loaded 53068 existing records from primary storage. [2025-09-29T02:02:50.224472] [INFO ] [MAIN ] KD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:50.224224] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KEN took 0.4s. Estimated remaining: 5m 31s. Rate: 215.5 symbols/min [2025-09-29T02:02:50.230407] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KD took 0.8s. Estimated remaining: 5m 31s. Rate: 215.7 symbols/min [2025-09-29T02:02:50.341302] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-29T02:02:50.469488] [INFO ] [REMOTE ] JMM: Full fetch complete (2292 records). [2025-09-29T02:02:50.506608] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:50.522305] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-29T02:02:50.751346] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:50.869132] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:50.902774] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-29T02:02:50.924752] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-29T02:02:50.926341] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-29T02:02:50.969138] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-29T02:02:50.970239] [DEBUG] [LOCAL ] KEP: Loaded 31169 existing records from primary storage. [2025-09-29T02:02:50.970484] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-29T02:02:50.966316] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-29T02:02:50.971086] [INFO ] [MAIN ] KEP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:50.971912] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:50.971619] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEP took 0.9s. Estimated remaining: 5m 31s. Rate: 215.4 symbols/min [2025-09-29T02:02:50.971323] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-29T02:02:50.977693] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:50.988766] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-29T02:02:51.022954] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-29T02:02:51.047185] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-29T02:02:51.084244] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-29T02:02:51.122249] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. JMM took 6.7s. Estimated remaining: 5m 30s. Rate: 215.5 symbols/min [2025-09-29T02:02:51.337108] [DEBUG] [LOCAL ] KEX: Loaded 38712 existing records from primary storage. [2025-09-29T02:02:51.414062] [INFO ] [MAIN ] KEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:51.489074] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:51.516166] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEX took 1.3s. Estimated remaining: 5m 30s. Rate: 215.4 symbols/min [2025-09-29T02:02:51.846678] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.062984] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.066433] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:52.070440] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-29T02:02:52.069910] [DEBUG] [LOCAL ] KF: Loaded 2486 existing records from primary storage. [2025-09-29T02:02:52.071085] [INFO ] [MAIN ] KF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.072695] [DEBUG] [LOCAL ] KEYS: Loaded 43955 existing records from primary storage. [2025-09-29T02:02:52.074035] [INFO ] [MAIN ] KEYS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.074670] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KEYS took 1.1s. Estimated remaining: 5m 30s. Rate: 215.3 symbols/min [2025-09-29T02:02:52.080630] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KF took 0.9s. Estimated remaining: 5m 30s. Rate: 215.4 symbols/min [2025-09-29T02:02:52.389086] [DEBUG] [LOCAL ] KFRC: Loaded 19766 existing records from primary storage. [2025-09-29T02:02:52.419285] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.436708] [INFO ] [MAIN ] KFRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.442401] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KFRC took 0.9s. Estimated remaining: 5m 30s. Rate: 215.4 symbols/min [2025-09-29T02:02:52.573025] [DEBUG] [LOCAL ] KFS: Loaded 8471 existing records from primary storage. [2025-09-29T02:02:52.607926] [INFO ] [MAIN ] KFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.612606] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.640540] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 0.6s. Estimated remaining: 5m 29s. Rate: 215.4 symbols/min [2025-09-29T02:02:52.758374] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.896285] [DEBUG] [LOCAL ] KFY: Loaded 31057 existing records from primary storage. [2025-09-29T02:02:52.923447] [INFO ] [MAIN ] KFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.968106] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFY took 0.9s. Estimated remaining: 5m 29s. Rate: 215.4 symbols/min [2025-09-29T02:02:53.110800] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:53.210067] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-29T02:02:53.235732] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T02:02:53.234508] [INFO ] [MAIN ] KGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:53.247275] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGC took 0.8s. Estimated remaining: 5m 29s. Rate: 215.4 symbols/min [2025-09-29T02:02:53.295167] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-29T02:02:53.322421] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:53.538420] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:53.554897] [DEBUG] [LOCAL ] KGS: Loaded 46487 existing records from primary storage. [2025-09-29T02:02:53.555909] [INFO ] [MAIN ] KGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:53.556389] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGS took 0.9s. Estimated remaining: 5m 28s. Rate: 215.4 symbols/min [2025-09-29T02:02:53.710954] [DEBUG] [LOCAL ] KIO: Loaded 21625 existing records from primary storage. [2025-09-29T02:02:53.744148] [INFO ] [MAIN ] KIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:53.806280] [DEBUG] [LOCAL ] KIM: Loaded 53831 existing records from primary storage. [2025-09-29T02:02:53.772008] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIO took 0.5s. Estimated remaining: 5m 28s. Rate: 215.4 symbols/min [2025-09-29T02:02:53.810628] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:53.810867] [INFO ] [MAIN ] KIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:53.850016] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KIM took 0.9s. Estimated remaining: 5m 28s. Rate: 215.5 symbols/min [2025-09-29T02:02:54.148053] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:54.268945] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:54.271880] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-29T02:02:54.288270] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-29T02:02:54.288932] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-29T02:02:54.289097] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-29T02:02:54.289493] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-29T02:02:54.289750] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-29T02:02:54.321115] [DEBUG] [LOCAL ] KKR: Loaded 54281 existing records from primary storage. [2025-09-29T02:02:54.350495] [INFO ] [MAIN ] KKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:54.409872] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKR took 0.9s. Estimated remaining: 5m 28s. Rate: 215.4 symbols/min [2025-09-29T02:02:54.410410] [DEBUG] [LOCAL ] KKRS: Loaded 5801 existing records from primary storage. [2025-09-29T02:02:54.442083] [INFO ] [MAIN ] KKRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:54.514260] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KKRS took 0.7s. Estimated remaining: 5m 27s. Rate: 215.5 symbols/min [2025-09-29T02:02:54.506636] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T02:02:54.621907] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-29T02:02:54.930508] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:54.957918] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-29T02:02:54.981362] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-29T02:02:54.991958] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-29T02:02:55.063281] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:55.014280] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-29T02:02:55.069180] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-29T02:02:55.069618] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-29T02:02:55.255105] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:55.295951] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-29T02:02:55.469371] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:55.471251] [DEBUG] [LOCAL ] KLC: Loaded 37107 existing records from primary storage. [2025-09-29T02:02:55.493085] [INFO ] [MAIN ] KLC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:55.503810] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-29T02:02:55.504471] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KLC took 1.0s. Estimated remaining: 5m 28s. Rate: 215.0 symbols/min [2025-09-29T02:02:55.520399] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:55.527602] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-09-29T02:02:55.553980] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:55.582807] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-29T02:02:55.618479] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:55.619127] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-29T02:02:55.618823] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-29T02:02:55.620269] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-29T02:02:55.620507] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-29T02:02:55.620730] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKRT took 1.8s. Estimated remaining: 5m 27s. Rate: 215.1 symbols/min [2025-09-29T02:02:55.650036] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T02:02:55.660988] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-29T02:02:55.756503] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:55.756937] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-29T02:02:55.757031] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:55.757154] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-09-29T02:02:55.757228] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:55.757323] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-29T02:02:55.757426] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-29T02:02:55.757507] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-29T02:02:55.757633] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-29T02:02:55.757750] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLAR took 1.3s. Estimated remaining: 5m 27s. Rate: 215.2 symbols/min [2025-09-29T02:02:56.455995] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T02:02:56.468475] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-29T02:02:56.893840] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T02:02:56.905743] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-29T02:02:57.743763] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T02:02:57.756391] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-29T02:02:58.282286] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T02:02:58.294084] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-29T02:02:59.121508] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T02:02:59.134303] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-29T02:03:00.006262] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T02:03:00.018433] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-29T02:03:00.980303] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T02:03:00.992705] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-29T02:03:00.992924] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-29T02:03:01.202385] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:03:01.203593] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:01.203708] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:01.203789] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-29T02:03:01.203929] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-29T02:03:01.204019] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-29T02:03:01.204174] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-29T02:03:01.204712] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KEY took 11.0s. Estimated remaining: 5m 32s. Rate: 211.9 symbols/min [2025-09-29T02:03:01.762127] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:01.840113] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:01.948797] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:02.042453] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:02.047342] [DEBUG] [LOCAL ] KMPB: Loaded 3646 existing records from primary storage. [2025-09-29T02:03:02.051870] [INFO ] [MAIN ] KMPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:02.052137] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 0.8s. Estimated remaining: 5m 32s. Rate: 211.6 symbols/min [2025-09-29T02:03:02.261834] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-29T02:03:02.299536] [INFO ] [MAIN ] KMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:02.341195] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMI took 1.1s. Estimated remaining: 5m 31s. Rate: 211.6 symbols/min [2025-09-29T02:03:02.338403] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:02.391011] [DEBUG] [LOCAL ] KMT: Loaded 43687 existing records from primary storage. [2025-09-29T02:03:02.374139] [DEBUG] [LOCAL ] KMPR: Loaded 39117 existing records from primary storage. [2025-09-29T02:03:02.411727] [INFO ] [MAIN ] KMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:02.412097] [INFO ] [MAIN ] KMPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:02.412847] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMPR took 1.1s. Estimated remaining: 5m 31s. Rate: 211.7 symbols/min [2025-09-29T02:03:02.423547] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMT took 1.2s. Estimated remaining: 5m 30s. Rate: 211.9 symbols/min [2025-09-29T02:03:02.825851] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:02.920919] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.019244] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.021285] [DEBUG] [LOCAL ] KMX: Loaded 53897 existing records from primary storage. [2025-09-29T02:03:03.022902] [INFO ] [MAIN ] KMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.023169] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 1.0s. Estimated remaining: 5m 30s. Rate: 211.7 symbols/min [2025-09-29T02:03:03.159977] [DEBUG] [LOCAL ] KNOP: Loaded 10274 existing records from primary storage. [2025-09-29T02:03:03.182526] [DEBUG] [LOCAL ] KN: Loaded 39393 existing records from primary storage. [2025-09-29T02:03:03.190666] [INFO ] [MAIN ] KNOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.199253] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KNOP took 0.8s. Estimated remaining: 5m 30s. Rate: 211.8 symbols/min [2025-09-29T02:03:03.196575] [INFO ] [MAIN ] KN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.215931] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KN took 0.9s. Estimated remaining: 5m 30s. Rate: 211.9 symbols/min [2025-09-29T02:03:03.438389] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.450248] [DEBUG] [LOCAL ] KNF: Loaded 36435 existing records from primary storage. [2025-09-29T02:03:03.489582] [INFO ] [MAIN ] KNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.520915] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNF took 1.1s. Estimated remaining: 5m 29s. Rate: 211.9 symbols/min [2025-09-29T02:03:03.811756] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.944191] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.975663] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.975982] [DEBUG] [LOCAL ] KNSL: Loaded 18372 existing records from primary storage. [2025-09-29T02:03:03.976633] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-29T02:03:03.976737] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-29T02:03:03.977242] [INFO ] [MAIN ] KNSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.978120] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNSL took 1.0s. Estimated remaining: 5m 29s. Rate: 211.8 symbols/min [2025-09-29T02:03:03.978246] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-29T02:03:03.986569] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-29T02:03:04.000476] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-29T02:03:04.007604] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-29T02:03:04.361592] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:04.385925] [DEBUG] [LOCAL ] KNTK: Loaded 46794 existing records from primary storage. [2025-09-29T02:03:04.467160] [DEBUG] [LOCAL ] KNX: Loaded 53363 existing records from primary storage. [2025-09-29T02:03:04.465927] [INFO ] [MAIN ] KNTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:04.474833] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 1.3s. Estimated remaining: 5m 29s. Rate: 211.7 symbols/min [2025-09-29T02:03:04.485029] [INFO ] [MAIN ] KNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:04.522689] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 1.2s. Estimated remaining: 5m 29s. Rate: 211.8 symbols/min [2025-09-29T02:03:04.952363] [DEBUG] [LOCAL ] KODK: Loaded 44025 existing records from primary storage. [2025-09-29T02:03:04.999903] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:05.049357] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.067859] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-29T02:03:05.068289] [INFO ] [MAIN ] KODK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:05.087442] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 1.1s. Estimated remaining: 5m 29s. Rate: 211.6 symbols/min [2025-09-29T02:03:05.110867] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.295518] [DEBUG] [LOCAL ] KOP: Loaded 18066 existing records from primary storage. [2025-09-29T02:03:05.303801] [INFO ] [MAIN ] KOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:05.338853] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KOP took 0.7s. Estimated remaining: 5m 28s. Rate: 211.7 symbols/min [2025-09-29T02:03:05.356333] [DEBUG] [LOCAL ] KOF: Loaded 26219 existing records from primary storage. [2025-09-29T02:03:05.343249] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.380145] [INFO ] [MAIN ] KOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:05.424361] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOF took 0.9s. Estimated remaining: 5m 28s. Rate: 211.8 symbols/min [2025-09-29T02:03:05.460919] [DEBUG] [LOCAL ] KORE: Loaded 2010 existing records from primary storage. [2025-09-29T02:03:05.501321] [INFO ] [MAIN ] KORE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:05.507094] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KORE took 0.4s. Estimated remaining: 5m 27s. Rate: 211.9 symbols/min [2025-09-29T02:03:05.798469] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.942255] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.943441] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:06.002298] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T02:03:06.016203] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-29T02:03:06.037603] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-09-29T02:03:06.038271] [INFO ] [MAIN ] KOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:06.051552] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KOS took 0.7s. Estimated remaining: 5m 27s. Rate: 211.7 symbols/min [2025-09-29T02:03:06.200327] [DEBUG] [LOCAL ] KRC: Loaded 49114 existing records from primary storage. [2025-09-29T02:03:06.252260] [INFO ] [MAIN ] KRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:06.269612] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KRC took 0.8s. Estimated remaining: 5m 27s. Rate: 211.8 symbols/min [2025-09-29T02:03:06.306590] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:06.308488] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-09-29T02:03:06.309432] [INFO ] [MAIN ] KR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:06.309609] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KR took 0.9s. Estimated remaining: 5m 26s. Rate: 211.9 symbols/min [2025-09-29T02:03:06.742507] [DEBUG] [LOCAL ] KREF: Loaded 37767 existing records from primary storage. [2025-09-29T02:03:06.740701] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:06.744070] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:06.744558] [INFO ] [MAIN ] KREF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:06.745517] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KREF took 0.7s. Estimated remaining: 5m 26s. Rate: 211.8 symbols/min [2025-09-29T02:03:06.745674] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-29T02:03:06.758425] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-29T02:03:06.770198] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-29T02:03:06.796737] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-29T02:03:06.815923] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-29T02:03:06.836840] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-29T02:03:07.043885] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:07.192937] [DEBUG] [LOCAL ] KRG: Loaded 49859 existing records from primary storage. [2025-09-29T02:03:07.272736] [INFO ] [MAIN ] KRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:07.297620] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRG took 1.0s. Estimated remaining: 5m 26s. Rate: 211.7 symbols/min [2025-09-29T02:03:07.344264] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T02:03:07.309829] [DEBUG] [LOCAL ] KRO: Loaded 26448 existing records from primary storage. [2025-09-29T02:03:07.385715] [INFO ] [MAIN ] KRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:07.417976] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRO took 0.7s. Estimated remaining: 5m 26s. Rate: 211.8 symbols/min [2025-09-29T02:03:07.455725] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-29T02:03:07.658822] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:07.680308] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-29T02:03:07.821423] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:07.852442] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:07.881796] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:07.882135] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-29T02:03:07.882237] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:07.882312] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-09-29T02:03:07.882398] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:07.882788] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-29T02:03:07.882891] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-29T02:03:07.882976] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-29T02:03:07.883074] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-29T02:03:07.883164] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRMN took 1.6s. Estimated remaining: 5m 26s. Rate: 211.7 symbols/min [2025-09-29T02:03:08.025867] [DEBUG] [LOCAL ] KRP: Loaded 37947 existing records from primary storage. [2025-09-29T02:03:08.027059] [INFO ] [MAIN ] KRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.048286] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 0.7s. Estimated remaining: 5m 25s. Rate: 211.7 symbols/min [2025-09-29T02:03:08.163725] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:08.186213] [DEBUG] [LOCAL ] KSS: Loaded 54385 existing records from primary storage. [2025-09-29T02:03:08.191027] [INFO ] [MAIN ] KSS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.207684] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KSS took 0.8s. Estimated remaining: 5m 25s. Rate: 211.8 symbols/min [2025-09-29T02:03:08.450397] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:08.545998] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:08.593420] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T02:03:08.591077] [DEBUG] [LOCAL ] KT: Loaded 46336 existing records from primary storage. [2025-09-29T02:03:08.604120] [INFO ] [MAIN ] KT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.608367] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 0.7s. Estimated remaining: 5m 25s. Rate: 211.7 symbols/min [2025-09-29T02:03:08.627451] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-29T02:03:08.672043] [DEBUG] [LOCAL ] KTF: Loaded 13065 existing records from primary storage. [2025-09-29T02:03:08.716216] [INFO ] [MAIN ] KTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.755504] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KTF took 0.5s. Estimated remaining: 5m 24s. Rate: 211.8 symbols/min [2025-09-29T02:03:08.933099] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:08.961749] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-29T02:03:08.968990] [DEBUG] [LOCAL ] KTB: Loaded 41738 existing records from primary storage. [2025-09-29T02:03:08.991092] [INFO ] [MAIN ] KTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.990794] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-29T02:03:08.991262] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTB took 0.9s. Estimated remaining: 5m 24s. Rate: 211.9 symbols/min [2025-09-29T02:03:09.046240] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-29T02:03:09.082814] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-29T02:03:09.145570] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:09.163492] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-29T02:03:09.179906] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-29T02:03:09.389226] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:09.666495] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-29T02:03:09.678216] [INFO ] [MAIN ] KVUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:09.694286] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KVUE took 0.9s. Estimated remaining: 5m 24s. Rate: 211.6 symbols/min [2025-09-29T02:03:09.780424] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:09.826134] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-29T02:03:09.877605] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T02:03:09.875957] [DEBUG] [LOCAL ] KVYO: Loaded 50696 existing records from primary storage. [2025-09-29T02:03:09.922169] [INFO ] [MAIN ] KVYO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:09.955323] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KVYO took 1.0s. Estimated remaining: 5m 24s. Rate: 211.6 symbols/min [2025-09-29T02:03:09.967863] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-29T02:03:10.128835] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:10.240554] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:10.286201] [DEBUG] [LOCAL ] KWR: Loaded 16931 existing records from primary storage. [2025-09-29T02:03:10.287348] [DEBUG] [LOCAL ] KW: Loaded 41236 existing records from primary storage. [2025-09-29T02:03:10.287744] [INFO ] [MAIN ] KWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:10.287976] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 0.3s. Estimated remaining: 5m 24s. Rate: 211.6 symbols/min [2025-09-29T02:03:10.301216] [INFO ] [MAIN ] KW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:10.301904] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KW took 0.6s. Estimated remaining: 5m 23s. Rate: 211.7 symbols/min [2025-09-29T02:03:10.364035] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-29T02:03:10.396527] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-29T02:03:10.689468] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:10.709711] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:10.758557] [DEBUG] [LOCAL ] KYN: Loaded 30432 existing records from primary storage. [2025-09-29T02:03:10.759020] [INFO ] [MAIN ] KYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:10.759635] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KYN took 0.5s. Estimated remaining: 5m 23s. Rate: 211.6 symbols/min [2025-09-29T02:03:10.882608] [DEBUG] [LOCAL ] L: Loaded 41562 existing records from primary storage. [2025-09-29T02:03:10.888493] [INFO ] [MAIN ] L: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:10.888739] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. L took 0.6s. Estimated remaining: 5m 22s. Rate: 211.7 symbols/min [2025-09-29T02:03:11.051877] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.105472] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T02:03:11.181243] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.181825] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-29T02:03:11.227075] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T02:03:11.256894] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-29T02:03:11.278783] [DEBUG] [LOCAL ] LAD: Loaded 24089 existing records from primary storage. [2025-09-29T02:03:11.293299] [INFO ] [MAIN ] LAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:11.294944] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. LAD took 0.4s. Estimated remaining: 5m 22s. Rate: 211.7 symbols/min [2025-09-29T02:03:11.323117] [DEBUG] [LOCAL ] LAC: Loaded 53091 existing records from primary storage. [2025-09-29T02:03:11.379934] [INFO ] [MAIN ] LAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:11.420320] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LAC took 0.7s. Estimated remaining: 5m 22s. Rate: 211.8 symbols/min [2025-09-29T02:03:11.563988] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.677672] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T02:03:11.687366] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-29T02:03:11.760260] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.782004] [DEBUG] [LOCAL ] LANV: Loaded 2851 existing records from primary storage. [2025-09-29T02:03:11.782327] [INFO ] [MAIN ] LANV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:11.783352] [DEBUG] [LOCAL ] LADR: Loaded 39204 existing records from primary storage. [2025-09-29T02:03:11.783828] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LANV took 0.4s. Estimated remaining: 5m 22s. Rate: 211.7 symbols/min [2025-09-29T02:03:11.783988] [INFO ] [MAIN ] LADR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:11.789628] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LADR took 0.5s. Estimated remaining: 5m 21s. Rate: 211.9 symbols/min [2025-09-29T02:03:11.985258] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.985889] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-29T02:03:11.986234] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-29T02:03:11.986683] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-29T02:03:11.986845] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-29T02:03:11.987072] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-29T02:03:11.987194] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-29T02:03:12.312724] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T02:03:12.322673] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-29T02:03:12.439166] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:12.441477] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T02:03:12.441828] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-29T02:03:12.454836] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-29T02:03:12.573178] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:12.573545] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-29T02:03:12.573637] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:12.573744] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-09-29T02:03:12.573813] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:12.573887] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-29T02:03:12.573984] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-29T02:03:12.574058] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-29T02:03:12.574154] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-29T02:03:12.574259] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAR took 0.8s. Estimated remaining: 5m 21s. Rate: 211.6 symbols/min [2025-09-29T02:03:12.792402] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T02:03:12.794127] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-29T02:03:12.924283] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.13 seconds). [2025-09-29T02:03:12.925834] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-29T02:03:13.053636] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.13 seconds). [2025-09-29T02:03:13.055720] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-29T02:03:13.180918] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T02:03:13.196428] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-29T02:03:13.196555] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.14 seconds). [2025-09-29T02:03:13.199230] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-29T02:03:13.719165] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T02:03:13.721950] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-29T02:03:14.005886] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T02:03:14.018785] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-29T02:03:14.093027] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-29T02:03:14.094924] [INFO ] [REMOTE ] KUKE: Full fetch complete (8120 records). [2025-09-29T02:03:14.095040] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-29T02:03:14.295156] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:03:14.295426] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:14.295526] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:14.295662] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-29T02:03:14.295783] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-29T02:03:14.295864] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-29T02:03:14.295981] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-29T02:03:14.296130] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. KUKE took 5.7s. Estimated remaining: 5m 22s. Rate: 210.7 symbols/min [2025-09-29T02:03:14.840107] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T02:03:14.852154] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-29T02:03:15.603426] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T02:03:15.614800] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-29T02:03:15.615038] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-29T02:03:15.837965] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:03:15.838880] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:15.838978] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:15.839094] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-29T02:03:15.839243] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-29T02:03:15.839360] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-29T02:03:15.839482] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-29T02:03:15.840511] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. KO took 12.3s. Estimated remaining: 5m 23s. Rate: 210.0 symbols/min [2025-09-29T02:03:16.469860] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.622752] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.645002] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.651891] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.674336] [DEBUG] [LOCAL ] LAW: Loaded 14171 existing records from primary storage. [2025-09-29T02:03:16.674893] [INFO ] [MAIN ] LAW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:16.675043] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 0.8s. Estimated remaining: 5m 23s. Rate: 209.6 symbols/min [2025-09-29T02:03:16.985661] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.906189] [DEBUG] [LOCAL ] LB: Loaded 38116 existing records from primary storage. [2025-09-29T02:03:16.987600] [DEBUG] [LOCAL ] LAZ: Loaded 45784 existing records from primary storage. [2025-09-29T02:03:17.001763] [INFO ] [MAIN ] LB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.004888] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LB took 1.2s. Estimated remaining: 5m 23s. Rate: 209.6 symbols/min [2025-09-29T02:03:17.004717] [INFO ] [MAIN ] LAZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.011908] [DEBUG] [LOCAL ] LBRT: Loaded 53695 existing records from primary storage. [2025-09-29T02:03:17.010691] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LAZ took 1.1s. Estimated remaining: 5m 23s. Rate: 209.8 symbols/min [2025-09-29T02:03:17.018565] [INFO ] [MAIN ] LBRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.035513] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LBRT took 1.2s. Estimated remaining: 5m 22s. Rate: 209.9 symbols/min [2025-09-29T02:03:17.578602] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:17.626774] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:17.634032] [DEBUG] [LOCAL ] LC: Loaded 48605 existing records from primary storage. [2025-09-29T02:03:17.655551] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:17.656286] [INFO ] [MAIN ] LC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.657096] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 1.0s. Estimated remaining: 5m 22s. Rate: 209.7 symbols/min [2025-09-29T02:03:17.866109] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:17.898282] [DEBUG] [LOCAL ] LCII: Loaded 28900 existing records from primary storage. [2025-09-29T02:03:17.898698] [INFO ] [MAIN ] LCII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.898887] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 0.9s. Estimated remaining: 5m 22s. Rate: 209.8 symbols/min [2025-09-29T02:03:18.035078] [DEBUG] [LOCAL ] LDP: Loaded 13128 existing records from primary storage. [2025-09-29T02:03:18.046469] [DEBUG] [LOCAL ] LDOS: Loaded 46407 existing records from primary storage. [2025-09-29T02:03:18.053940] [DEBUG] [LOCAL ] LDI: Loaded 44776 existing records from primary storage. [2025-09-29T02:03:18.059896] [INFO ] [MAIN ] LDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.059412] [INFO ] [MAIN ] LDOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.060686] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDOS took 1.0s. Estimated remaining: 5m 21s. Rate: 209.8 symbols/min [2025-09-29T02:03:18.060233] [INFO ] [MAIN ] LDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.061408] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDI took 1.0s. Estimated remaining: 5m 21s. Rate: 210.0 symbols/min [2025-09-29T02:03:18.115486] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 0.4s. Estimated remaining: 5m 20s. Rate: 210.1 symbols/min [2025-09-29T02:03:18.394070] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:18.614864] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:18.718439] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:18.747237] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:18.768777] [DEBUG] [LOCAL ] LEA: Loaded 42464 existing records from primary storage. [2025-09-29T02:03:18.769762] [INFO ] [MAIN ] LEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.769916] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 0.9s. Estimated remaining: 5m 20s. Rate: 209.9 symbols/min [2025-09-29T02:03:18.889154] [DEBUG] [LOCAL ] LEO: Loaded 17785 existing records from primary storage. [2025-09-29T02:03:18.929219] [INFO ] [MAIN ] LEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.929536] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEO took 0.8s. Estimated remaining: 5m 20s. Rate: 210.0 symbols/min [2025-09-29T02:03:18.942600] [DEBUG] [LOCAL ] LEG: Loaded 51130 existing records from primary storage. [2025-09-29T02:03:19.053588] [INFO ] [MAIN ] LEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.158017] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:19.158241] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEG took 1.1s. Estimated remaining: 5m 20s. Rate: 210.0 symbols/min [2025-09-29T02:03:19.185858] [DEBUG] [LOCAL ] LEN: Loaded 53967 existing records from primary storage. [2025-09-29T02:03:19.208688] [INFO ] [MAIN ] LEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.253782] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 1.1s. Estimated remaining: 5m 19s. Rate: 210.1 symbols/min [2025-09-29T02:03:19.461685] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:19.683871] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:19.689577] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:19.693291] [DEBUG] [LOCAL ] LFT: Loaded 18286 existing records from primary storage. [2025-09-29T02:03:19.709934] [INFO ] [MAIN ] LFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.710217] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LFT took 0.8s. Estimated remaining: 5m 19s. Rate: 210.0 symbols/min [2025-09-29T02:03:19.711317] [DEBUG] [LOCAL ] LEVI: Loaded 52306 existing records from primary storage. [2025-09-29T02:03:19.729187] [INFO ] [MAIN ] LEVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.765752] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 1.0s. Estimated remaining: 5m 19s. Rate: 210.2 symbols/min [2025-09-29T02:03:19.861164] [DEBUG] [LOCAL ] LGI: Loaded 10137 existing records from primary storage. [2025-09-29T02:03:19.908120] [INFO ] [MAIN ] LGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.934321] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LGI took 0.8s. Estimated remaining: 5m 18s. Rate: 210.2 symbols/min [2025-09-29T02:03:20.172677] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.251268] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.230565] [DEBUG] [LOCAL ] LH: Loaded 38660 existing records from primary storage. [2025-09-29T02:03:20.268420] [INFO ] [MAIN ] LH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:20.269565] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 1.0s. Estimated remaining: 5m 18s. Rate: 210.2 symbols/min [2025-09-29T02:03:20.440036] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.548884] [DEBUG] [LOCAL ] LII: Loaded 28648 existing records from primary storage. [2025-09-29T02:03:20.594830] [INFO ] [MAIN ] LII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:20.594450] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.595346] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 0.8s. Estimated remaining: 5m 18s. Rate: 210.2 symbols/min [2025-09-29T02:03:20.613678] [DEBUG] [LOCAL ] LHX: Loaded 49413 existing records from primary storage. [2025-09-29T02:03:20.681146] [INFO ] [MAIN ] LHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:20.692698] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LHX took 1.0s. Estimated remaining: 5m 17s. Rate: 210.3 symbols/min [2025-09-29T02:03:20.750491] [DEBUG] [LOCAL ] LITB: Loaded 4436 existing records from primary storage. [2025-09-29T02:03:20.834406] [INFO ] [MAIN ] LITB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:20.940372] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.901052] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LITB took 0.6s. Estimated remaining: 5m 17s. Rate: 210.3 symbols/min [2025-09-29T02:03:20.946705] [DEBUG] [LOCAL ] LION: Loaded 43950 existing records from primary storage. [2025-09-29T02:03:21.003068] [INFO ] [MAIN ] LION: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:21.040128] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LION took 1.1s. Estimated remaining: 5m 17s. Rate: 210.4 symbols/min [2025-09-29T02:03:21.179985] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.356912] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.461366] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.503357] [DEBUG] [LOCAL ] LMND: Loaded 52647 existing records from primary storage. [2025-09-29T02:03:21.520273] [INFO ] [MAIN ] LMND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:21.520516] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 0.8s. Estimated remaining: 5m 16s. Rate: 210.3 symbols/min [2025-09-29T02:03:21.538379] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-09-29T02:03:21.580821] [INFO ] [MAIN ] LLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:21.592455] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LLY took 1.0s. Estimated remaining: 5m 16s. Rate: 210.4 symbols/min [2025-09-29T02:03:21.817813] [DEBUG] [LOCAL ] LMT: Loaded 50608 existing records from primary storage. [2025-09-29T02:03:21.882703] [INFO ] [MAIN ] LMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:21.901605] [DEBUG] [LOCAL ] LNC: Loaded 52369 existing records from primary storage. [2025-09-29T02:03:21.976635] [INFO ] [MAIN ] LNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:22.008427] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.969862] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.964509] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 1.0s. Estimated remaining: 5m 16s. Rate: 210.4 symbols/min [2025-09-29T02:03:22.047936] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 1.0s. Estimated remaining: 5m 15s. Rate: 210.5 symbols/min [2025-09-29T02:03:22.174075] [DEBUG] [LOCAL ] LND: Loaded 5013 existing records from primary storage. [2025-09-29T02:03:22.289944] [INFO ] [MAIN ] LND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:22.327181] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 0.8s. Estimated remaining: 5m 15s. Rate: 210.5 symbols/min [2025-09-29T02:03:22.326512] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:22.572597] [DEBUG] [LOCAL ] LNN: Loaded 11404 existing records from primary storage. [2025-09-29T02:03:22.591205] [DEBUG] [LOCAL ] LNG: Loaded 52224 existing records from primary storage. [2025-09-29T02:03:22.594020] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:22.615406] [INFO ] [MAIN ] LNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:22.620913] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNG took 1.0s. Estimated remaining: 5m 15s. Rate: 210.5 symbols/min [2025-09-29T02:03:22.621069] [INFO ] [MAIN ] LNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:22.699319] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:22.660246] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LNN took 0.7s. Estimated remaining: 5m 14s. Rate: 210.6 symbols/min [2025-09-29T02:03:23.113745] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.109528] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.115289] [DEBUG] [LOCAL ] LOB: Loaded 27886 existing records from primary storage. [2025-09-29T02:03:23.117367] [DEBUG] [LOCAL ] LOAR: Loaded 42150 existing records from primary storage. [2025-09-29T02:03:23.118200] [INFO ] [MAIN ] LOAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:23.118301] [INFO ] [MAIN ] LOB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:23.118786] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LOAR took 1.0s. Estimated remaining: 5m 14s. Rate: 210.5 symbols/min [2025-09-29T02:03:23.130180] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOB took 0.8s. Estimated remaining: 5m 14s. Rate: 210.7 symbols/min [2025-09-29T02:03:23.259554] [DEBUG] [LOCAL ] LOCL: Loaded 3644 existing records from primary storage. [2025-09-29T02:03:23.302221] [INFO ] [MAIN ] LOCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:23.368463] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOCL took 0.7s. Estimated remaining: 5m 13s. Rate: 210.7 symbols/min [2025-09-29T02:03:23.435266] [DEBUG] [LOCAL ] LOMA: Loaded 32576 existing records from primary storage. [2025-09-29T02:03:23.507302] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.528361] [INFO ] [MAIN ] LOMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:23.564960] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LOMA took 0.8s. Estimated remaining: 5m 13s. Rate: 210.8 symbols/min [2025-09-29T02:03:23.750454] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.868448] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.953686] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.011460] [DEBUG] [LOCAL ] LPL: Loaded 26305 existing records from primary storage. [2025-09-29T02:03:24.012180] [INFO ] [MAIN ] LPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.012357] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPL took 0.6s. Estimated remaining: 5m 13s. Rate: 210.7 symbols/min [2025-09-29T02:03:24.152980] [DEBUG] [LOCAL ] LOW: Loaded 53721 existing records from primary storage. [2025-09-29T02:03:24.159048] [DEBUG] [LOCAL ] LPG: Loaded 40536 existing records from primary storage. [2025-09-29T02:03:24.169888] [INFO ] [MAIN ] LPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.186142] [INFO ] [MAIN ] LOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.186348] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LOW took 1.1s. Estimated remaining: 5m 12s. Rate: 210.8 symbols/min [2025-09-29T02:03:24.187011] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPG took 1.0s. Estimated remaining: 5m 12s. Rate: 210.9 symbols/min [2025-09-29T02:03:24.215334] [DEBUG] [LOCAL ] LPX: Loaded 40311 existing records from primary storage. [2025-09-29T02:03:24.280241] [INFO ] [MAIN ] LPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.426295] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LPX took 0.8s. Estimated remaining: 5m 11s. Rate: 210.9 symbols/min [2025-09-29T02:03:24.421027] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.744236] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.788934] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.883966] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.910928] [DEBUG] [LOCAL ] LRN: Loaded 40503 existing records from primary storage. [2025-09-29T02:03:24.922571] [INFO ] [MAIN ] LRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.922719] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LRN took 0.9s. Estimated remaining: 5m 11s. Rate: 210.8 symbols/min [2025-09-29T02:03:24.935361] [DEBUG] [LOCAL ] LTC: Loaded 30478 existing records from primary storage. [2025-09-29T02:03:24.935943] [INFO ] [MAIN ] LTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.936062] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LTC took 0.7s. Estimated remaining: 5m 11s. Rate: 211.0 symbols/min [2025-09-29T02:03:24.961771] [DEBUG] [LOCAL ] LSPD: Loaded 43782 existing records from primary storage. [2025-09-29T02:03:24.962369] [INFO ] [MAIN ] LSPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.962513] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LSPD took 0.8s. Estimated remaining: 5m 10s. Rate: 211.1 symbols/min [2025-09-29T02:03:24.999581] [DEBUG] [LOCAL ] LTH: Loaded 52563 existing records from primary storage. [2025-09-29T02:03:25.000011] [INFO ] [MAIN ] LTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:25.000143] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 0.5s. Estimated remaining: 5m 10s. Rate: 211.3 symbols/min [2025-09-29T02:03:25.747440] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:25.816807] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:25.810250] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:25.816933] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-29T02:03:25.838617] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:25.840077] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-29T02:03:25.840817] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-29T02:03:25.841094] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-29T02:03:25.841420] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-29T02:03:25.841557] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-29T02:03:26.070511] [DEBUG] [LOCAL ] LTM: Loaded 37076 existing records from primary storage. [2025-09-29T02:03:26.115141] [INFO ] [MAIN ] LTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:26.123549] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LTM took 1.1s. Estimated remaining: 5m 10s. Rate: 210.8 symbols/min [2025-09-29T02:03:26.318858] [DEBUG] [LOCAL ] LU: Loaded 49679 existing records from primary storage. [2025-09-29T02:03:26.389269] [INFO ] [MAIN ] LU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:26.407543] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LU took 1.4s. Estimated remaining: 5m 10s. Rate: 210.8 symbols/min [2025-09-29T02:03:26.407357] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-29T02:03:26.436571] [INFO ] [MAIN ] LUMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:26.463715] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LUMN took 1.5s. Estimated remaining: 5m 10s. Rate: 210.9 symbols/min [2025-09-29T02:03:26.822772] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:26.862241] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:26.862673] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-29T02:03:27.056279] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:27.057913] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:27.058274] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-29T02:03:27.058907] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-29T02:03:27.059220] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-29T02:03:27.059369] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-29T02:03:27.059553] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-29T02:03:27.059726] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-29T02:03:27.410017] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-29T02:03:27.445826] [DEBUG] [LOCAL ] LVS: Loaded 54342 existing records from primary storage. [2025-09-29T02:03:27.445992] [INFO ] [MAIN ] LUV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:27.466630] [INFO ] [MAIN ] LVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:27.477359] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUV took 1.3s. Estimated remaining: 5m 10s. Rate: 210.5 symbols/min [2025-09-29T02:03:27.505172] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LVS took 1.0s. Estimated remaining: 5m 9s. Rate: 210.6 symbols/min [2025-09-29T02:03:27.632120] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:27.668766] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-29T02:03:27.883269] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:27.893090] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:27.948630] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:27.950091] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-29T02:03:27.950828] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:27.949438] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T02:03:27.951142] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-09-29T02:03:27.956306] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:27.956509] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-29T02:03:27.957798] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-29T02:03:27.957515] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-29T02:03:27.957887] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-29T02:03:27.958958] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-29T02:03:27.959320] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LUXE took 1.6s. Estimated remaining: 5m 9s. Rate: 210.5 symbols/min [2025-09-29T02:03:28.086916] [DEBUG] [LOCAL ] LVWR: Loaded 17668 existing records from primary storage. [2025-09-29T02:03:28.087675] [INFO ] [MAIN ] LVWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.088213] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVWR took 0.6s. Estimated remaining: 5m 9s. Rate: 210.6 symbols/min [2025-09-29T02:03:28.262582] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:28.339581] [DEBUG] [LOCAL ] LW: Loaded 51915 existing records from primary storage. [2025-09-29T02:03:28.373034] [INFO ] [MAIN ] LW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.391365] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LW took 0.8s. Estimated remaining: 5m 9s. Rate: 210.6 symbols/min [2025-09-29T02:03:28.429191] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:28.495601] [DEBUG] [LOCAL ] LXFR: Loaded 17259 existing records from primary storage. [2025-09-29T02:03:28.519885] [INFO ] [MAIN ] LXFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.520275] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LXFR took 0.6s. Estimated remaining: 5m 8s. Rate: 210.7 symbols/min [2025-09-29T02:03:28.730439] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:28.833233] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:28.865858] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T02:03:28.891023] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-29T02:03:28.893256] [DEBUG] [LOCAL ] LXP: Loaded 51361 existing records from primary storage. [2025-09-29T02:03:28.895026] [INFO ] [MAIN ] LXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.896532] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXP took 0.8s. Estimated remaining: 5m 8s. Rate: 210.7 symbols/min [2025-09-29T02:03:28.957958] [DEBUG] [LOCAL ] LXU: Loaded 32354 existing records from primary storage. [2025-09-29T02:03:28.977262] [INFO ] [MAIN ] LXU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.983072] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 0.6s. Estimated remaining: 5m 7s. Rate: 210.8 symbols/min [2025-09-29T02:03:29.281723] [DEBUG] [LOCAL ] LYB: Loaded 54379 existing records from primary storage. [2025-09-29T02:03:29.288073] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:29.344938] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:29.346599] [INFO ] [MAIN ] LYB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:29.346827] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LYB took 0.8s. Estimated remaining: 5m 7s. Rate: 210.7 symbols/min [2025-09-29T02:03:29.583520] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:29.602050] [DEBUG] [LOCAL ] LYG: Loaded 53606 existing records from primary storage. [2025-09-29T02:03:29.602845] [INFO ] [MAIN ] LYG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:29.603318] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 0.7s. Estimated remaining: 5m 7s. Rate: 210.7 symbols/min [2025-09-29T02:03:29.712552] [DEBUG] [LOCAL ] LYV: Loaded 51906 existing records from primary storage. [2025-09-29T02:03:29.739949] [INFO ] [MAIN ] LYV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:29.762436] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYV took 0.8s. Estimated remaining: 5m 7s. Rate: 210.8 symbols/min [2025-09-29T02:03:29.838026] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T02:03:29.872741] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:29.909000] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-29T02:03:29.991684] [DEBUG] [LOCAL ] LZB: Loaded 36113 existing records from primary storage. [2025-09-29T02:03:30.001436] [INFO ] [MAIN ] LZB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.002037] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZB took 0.7s. Estimated remaining: 5m 6s. Rate: 210.8 symbols/min [2025-09-29T02:03:30.093171] [DEBUG] [LOCAL ] LZM: Loaded 13905 existing records from primary storage. [2025-09-29T02:03:30.117165] [INFO ] [MAIN ] LZM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.157580] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 0.6s. Estimated remaining: 5m 6s. Rate: 210.9 symbols/min [2025-09-29T02:03:30.236256] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:30.385689] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:30.494622] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:30.557788] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-29T02:03:30.560090] [INFO ] [MAIN ] M: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.560840] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. M took 0.8s. Estimated remaining: 5m 6s. Rate: 210.8 symbols/min [2025-09-29T02:03:30.589767] [DEBUG] [LOCAL ] MA: Loaded 53329 existing records from primary storage. [2025-09-29T02:03:30.623284] [INFO ] [MAIN ] MA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.655538] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MA took 0.6s. Estimated remaining: 5m 5s. Rate: 211.0 symbols/min [2025-09-29T02:03:30.775764] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T02:03:30.889457] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-29T02:03:30.924167] [DEBUG] [LOCAL ] MAA: Loaded 43354 existing records from primary storage. [2025-09-29T02:03:30.974178] [INFO ] [MAIN ] MAA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.968573] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:30.990743] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MAA took 0.8s. Estimated remaining: 5m 5s. Rate: 210.9 symbols/min [2025-09-29T02:03:31.032209] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:31.253075] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:31.287432] [DEBUG] [LOCAL ] MAGN: Loaded 35466 existing records from primary storage. [2025-09-29T02:03:31.288329] [INFO ] [MAIN ] MAGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:31.288511] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAGN took 0.6s. Estimated remaining: 5m 5s. Rate: 210.9 symbols/min [2025-09-29T02:03:31.432752] [DEBUG] [LOCAL ] MAC: Loaded 50469 existing records from primary storage. [2025-09-29T02:03:31.474846] [INFO ] [MAIN ] MAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:31.515375] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAC took 0.9s. Estimated remaining: 5m 4s. Rate: 211.0 symbols/min [2025-09-29T02:03:31.521909] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:31.640173] [DEBUG] [LOCAL ] MAIN: Loaded 41929 existing records from primary storage. [2025-09-29T02:03:31.663003] [INFO ] [MAIN ] MAIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:31.673474] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAIN took 0.6s. Estimated remaining: 5m 4s. Rate: 211.0 symbols/min [2025-09-29T02:03:31.872639] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:31.922209] [DEBUG] [LOCAL ] MAN: Loaded 44216 existing records from primary storage. [2025-09-29T02:03:31.949807] [INFO ] [MAIN ] MAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:31.973432] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAN took 0.7s. Estimated remaining: 5m 4s. Rate: 211.0 symbols/min [2025-09-29T02:03:32.038080] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:32.095138] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T02:03:32.149469] [DEBUG] [LOCAL ] MANU: Loaded 27544 existing records from primary storage. [2025-09-29T02:03:32.175174] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-29T02:03:32.174087] [INFO ] [MAIN ] MANU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:32.193102] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MANU took 0.7s. Estimated remaining: 5m 3s. Rate: 211.1 symbols/min [2025-09-29T02:03:32.334084] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:32.509144] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:32.529387] [DEBUG] [LOCAL ] MAS: Loaded 53102 existing records from primary storage. [2025-09-29T02:03:32.530562] [INFO ] [MAIN ] MAS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:32.530753] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAS took 0.9s. Estimated remaining: 5m 3s. Rate: 211.0 symbols/min [2025-09-29T02:03:32.675334] [DEBUG] [LOCAL ] MATV: Loaded 37964 existing records from primary storage. [2025-09-29T02:03:32.697316] [INFO ] [MAIN ] MATV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:32.735089] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATV took 0.8s. Estimated remaining: 5m 3s. Rate: 211.1 symbols/min [2025-09-29T02:03:32.777481] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:32.900309] [DEBUG] [LOCAL ] MATX: Loaded 31851 existing records from primary storage. [2025-09-29T02:03:32.941617] [INFO ] [MAIN ] MATX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:32.974942] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATX took 0.7s. Estimated remaining: 5m 2s. Rate: 211.1 symbols/min [2025-09-29T02:03:33.099527] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:33.176205] [DEBUG] [LOCAL ] MAX: Loaded 31209 existing records from primary storage. [2025-09-29T02:03:33.177833] [INFO ] [MAIN ] MAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:33.189440] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T02:03:33.190147] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAX took 0.7s. Estimated remaining: 5m 2s. Rate: 211.1 symbols/min [2025-09-29T02:03:33.247556] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-29T02:03:33.653106] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:33.661831] [DEBUG] [LOCAL ] MBC: Loaded 43803 existing records from primary storage. [2025-09-29T02:03:33.689968] [INFO ] [MAIN ] MBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:33.702774] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MBC took 0.9s. Estimated remaining: 5m 2s. Rate: 211.0 symbols/min [2025-09-29T02:03:33.802954] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:33.909317] [DEBUG] [LOCAL ] MBI: Loaded 24930 existing records from primary storage. [2025-09-29T02:03:33.939204] [INFO ] [MAIN ] MBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:33.939824] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBI took 0.9s. Estimated remaining: 5m 2s. Rate: 211.0 symbols/min [2025-09-29T02:03:34.078128] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:34.302004] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T02:03:34.255829] [DEBUG] [LOCAL ] MCB: Loaded 11834 existing records from primary storage. [2025-09-29T02:03:34.303080] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:34.310871] [INFO ] [MAIN ] MCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:34.313375] [DEBUG] [LOCAL ] MC: Loaded 44878 existing records from primary storage. [2025-09-29T02:03:34.313622] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MCB took 0.6s. Estimated remaining: 5m 1s. Rate: 211.0 symbols/min [2025-09-29T02:03:34.314197] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-29T02:03:34.319524] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-29T02:03:34.326628] [INFO ] [MAIN ] MC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:34.344898] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MC took 1.1s. Estimated remaining: 5m 1s. Rate: 211.1 symbols/min [2025-09-29T02:03:34.333270] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-29T02:03:34.406536] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-29T02:03:34.496961] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-29T02:03:34.549799] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-29T02:03:34.631485] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:34.626983] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-29T02:03:34.775268] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:34.808701] [DEBUG] [LOCAL ] MCI: Loaded 6477 existing records from primary storage. [2025-09-29T02:03:34.820135] [INFO ] [MAIN ] MCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:34.848754] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCI took 0.5s. Estimated remaining: 5m 1s. Rate: 211.0 symbols/min [2025-09-29T02:03:35.246810] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:35.237019] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T02:03:35.291274] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-29T02:03:35.393182] [DEBUG] [LOCAL ] MCN: Loaded 8231 existing records from primary storage. [2025-09-29T02:03:35.437981] [DEBUG] [LOCAL ] MCK: Loaded 39985 existing records from primary storage. [2025-09-29T02:03:35.445909] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:35.438291] [INFO ] [MAIN ] MCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:35.446668] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCN took 0.6s. Estimated remaining: 5m 1s. Rate: 210.8 symbols/min [2025-09-29T02:03:35.447000] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-29T02:03:35.446495] [INFO ] [MAIN ] MCK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:35.453884] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCK took 1.1s. Estimated remaining: 5m 0s. Rate: 211.0 symbols/min [2025-09-29T02:03:35.799993] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:35.858356] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:35.875103] [DEBUG] [LOCAL ] MCR: Loaded 8858 existing records from primary storage. [2025-09-29T02:03:35.875498] [INFO ] [MAIN ] MCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:35.875630] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCR took 0.4s. Estimated remaining: 5m 0s. Rate: 210.9 symbols/min [2025-09-29T02:03:36.017197] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T02:03:36.077191] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-29T02:03:36.106533] [DEBUG] [LOCAL ] MCO: Loaded 40102 existing records from primary storage. [2025-09-29T02:03:36.117685] [INFO ] [MAIN ] MCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:36.117288] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:36.117917] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCO took 0.7s. Estimated remaining: 4m 60s. Rate: 210.9 symbols/min [2025-09-29T02:03:36.143182] [DEBUG] [LOCAL ] MCS: Loaded 21454 existing records from primary storage. [2025-09-29T02:03:36.143685] [INFO ] [MAIN ] MCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:36.143829] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCS took 0.3s. Estimated remaining: 4m 59s. Rate: 211.1 symbols/min [2025-09-29T02:03:36.311113] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T02:03:36.322464] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-29T02:03:36.744031] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T02:03:36.749528] [INFO ] [REMOTE ] LUCK: Full fetch complete (40658 records). [2025-09-29T02:03:36.749709] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-29T02:03:36.962080] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:03:36.962731] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:36.963027] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:36.963117] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-29T02:03:36.963236] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-29T02:03:36.963403] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-29T02:03:36.963592] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-29T02:03:36.963862] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. LUCK took 12.0s. Estimated remaining: 4m 59s. Rate: 210.8 symbols/min [2025-09-29T02:03:37.133881] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T02:03:37.145259] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-29T02:03:37.880628] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T02:03:37.891455] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-29T02:03:38.282295] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-29T02:03:38.298203] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-29T02:03:39.073110] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-29T02:03:39.084954] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-29T02:03:40.066872] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T02:03:40.078548] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-29T02:03:40.902565] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T02:03:40.913913] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-29T02:03:41.759618] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T02:03:41.771969] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-29T02:03:42.533806] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T02:03:42.546306] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-29T02:03:43.356263] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T02:03:43.368936] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-09-29T02:03:43.369130] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-29T02:03:43.600356] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:03:43.601323] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:43.601418] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:43.601522] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-29T02:03:43.601632] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-29T02:03:43.601733] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-29T02:03:43.601829] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-29T02:03:43.603034] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCD took 9.7s. Estimated remaining: 5m 4s. Rate: 207.3 symbols/min [2025-09-29T02:03:44.335635] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.336547] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.338205] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.412695] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.421920] [DEBUG] [LOCAL ] MDST: Loaded 5688 existing records from primary storage. [2025-09-29T02:03:44.423067] [INFO ] [MAIN ] MDST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:44.423718] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 0.8s. Estimated remaining: 5m 4s. Rate: 207.0 symbols/min [2025-09-29T02:03:44.628853] [DEBUG] [LOCAL ] MCY: Loaded 25345 existing records from primary storage. [2025-09-29T02:03:44.627968] [DEBUG] [LOCAL ] MD: Loaded 39064 existing records from primary storage. [2025-09-29T02:03:44.663876] [INFO ] [MAIN ] MD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:44.669864] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MD took 1.0s. Estimated remaining: 5m 4s. Rate: 207.0 symbols/min [2025-09-29T02:03:44.669401] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.670094] [INFO ] [MAIN ] MCY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:44.671129] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MCY took 1.1s. Estimated remaining: 5m 4s. Rate: 207.2 symbols/min [2025-09-29T02:03:44.963707] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-29T02:03:45.027755] [INFO ] [MAIN ] MDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.079770] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.105095] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 1.5s. Estimated remaining: 5m 3s. Rate: 207.1 symbols/min [2025-09-29T02:03:45.107780] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.211367] [DEBUG] [LOCAL ] MDV: Loaded 8733 existing records from primary storage. [2025-09-29T02:03:45.250013] [INFO ] [MAIN ] MDV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.268497] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDV took 0.6s. Estimated remaining: 5m 3s. Rate: 207.1 symbols/min [2025-09-29T02:03:45.257589] [DEBUG] [LOCAL ] MDU: Loaded 48643 existing records from primary storage. [2025-09-29T02:03:45.306766] [INFO ] [MAIN ] MDU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.338363] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MDU took 0.9s. Estimated remaining: 5m 3s. Rate: 207.3 symbols/min [2025-09-29T02:03:45.485506] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.491548] [DEBUG] [LOCAL ] MEC: Loaded 16695 existing records from primary storage. [2025-09-29T02:03:45.532766] [INFO ] [MAIN ] MEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.539050] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 0.8s. Estimated remaining: 5m 2s. Rate: 207.3 symbols/min [2025-09-29T02:03:45.784522] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.915433] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.949683] [DEBUG] [LOCAL ] MED: Loaded 22043 existing records from primary storage. [2025-09-29T02:03:45.982913] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.958250] [INFO ] [MAIN ] MED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.984627] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MED took 0.9s. Estimated remaining: 5m 2s. Rate: 207.2 symbols/min [2025-09-29T02:03:46.136294] [DEBUG] [LOCAL ] MEG: Loaded 32426 existing records from primary storage. [2025-09-29T02:03:46.212155] [DEBUG] [LOCAL ] MEGI: Loaded 20630 existing records from primary storage. [2025-09-29T02:03:46.168052] [INFO ] [MAIN ] MEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:46.216907] [INFO ] [MAIN ] MEGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:46.213209] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEG took 0.9s. Estimated remaining: 5m 2s. Rate: 207.3 symbols/min [2025-09-29T02:03:46.218390] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEGI took 0.9s. Estimated remaining: 5m 1s. Rate: 207.4 symbols/min [2025-09-29T02:03:46.379620] [DEBUG] [LOCAL ] MEI: Loaded 32933 existing records from primary storage. [2025-09-29T02:03:46.283698] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:46.413826] [INFO ] [MAIN ] MEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:46.455555] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 0.9s. Estimated remaining: 5m 1s. Rate: 207.4 symbols/min [2025-09-29T02:03:46.640436] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:46.791382] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:46.879222] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:46.898963] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-09-29T02:03:46.918543] [INFO ] [MAIN ] MFAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:46.920192] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MFAN took 0.6s. Estimated remaining: 5m 1s. Rate: 207.3 symbols/min [2025-09-29T02:03:46.957913] [DEBUG] [LOCAL ] MET: Loaded 54089 existing records from primary storage. [2025-09-29T02:03:47.004344] [INFO ] [MAIN ] MET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:47.004115] [DEBUG] [LOCAL ] MFAO: Loaded 3853 existing records from primary storage. [2025-09-29T02:03:47.021721] [DEBUG] [LOCAL ] MFA: Loaded 46019 existing records from primary storage. [2025-09-29T02:03:47.042578] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MET took 1.1s. Estimated remaining: 5m 0s. Rate: 207.4 symbols/min [2025-09-29T02:03:47.042921] [INFO ] [MAIN ] MFAO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:47.067478] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 0.6s. Estimated remaining: 4m 60s. Rate: 207.6 symbols/min [2025-09-29T02:03:47.067123] [INFO ] [MAIN ] MFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:47.100629] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFA took 0.9s. Estimated remaining: 4m 59s. Rate: 207.7 symbols/min [2025-09-29T02:03:47.312171] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:47.661357] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:47.764224] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:47.802487] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:47.804264] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-29T02:03:47.804424] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-29T02:03:47.804548] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-29T02:03:47.804659] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-29T02:03:47.804738] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-29T02:03:47.804817] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-29T02:03:47.936149] [DEBUG] [LOCAL ] MFC: Loaded 52000 existing records from primary storage. [2025-09-29T02:03:47.948017] [DEBUG] [LOCAL ] MFM: Loaded 14390 existing records from primary storage. [2025-09-29T02:03:47.970271] [INFO ] [MAIN ] MFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:47.970905] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFM took 0.9s. Estimated remaining: 4m 59s. Rate: 207.4 symbols/min [2025-09-29T02:03:47.982155] [INFO ] [MAIN ] MFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:48.044176] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFC took 1.1s. Estimated remaining: 4m 59s. Rate: 207.5 symbols/min [2025-09-29T02:03:48.399433] [DEBUG] [LOCAL ] MFG: Loaded 49748 existing records from primary storage. [2025-09-29T02:03:48.421353] [INFO ] [MAIN ] MFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:48.475617] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFG took 1.4s. Estimated remaining: 4m 59s. Rate: 207.4 symbols/min [2025-09-29T02:03:48.665057] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:48.726960] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:48.806715] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-29T02:03:48.821002] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:48.889014] [DEBUG] [LOCAL ] MFSG: Loaded 5267 existing records from primary storage. [2025-09-29T02:03:48.900474] [INFO ] [MAIN ] MFSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:48.908624] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFSG took 0.9s. Estimated remaining: 4m 59s. Rate: 207.4 symbols/min [2025-09-29T02:03:49.010013] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.016410] [DEBUG] [LOCAL ] MFSI: Loaded 11358 existing records from primary storage. [2025-09-29T02:03:49.062446] [INFO ] [MAIN ] MFSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.068249] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSI took 1.0s. Estimated remaining: 4m 58s. Rate: 207.4 symbols/min [2025-09-29T02:03:49.092436] [DEBUG] [LOCAL ] MFSV: Loaded 2514 existing records from primary storage. [2025-09-29T02:03:49.142313] [INFO ] [MAIN ] MFSV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.200572] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T02:03:49.211873] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSV took 0.6s. Estimated remaining: 4m 58s. Rate: 207.5 symbols/min [2025-09-29T02:03:49.213615] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-29T02:03:49.257167] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.525727] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.542728] [DEBUG] [LOCAL ] MG: Loaded 16832 existing records from primary storage. [2025-09-29T02:03:49.559220] [INFO ] [MAIN ] MG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.569029] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T02:03:49.573767] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MG took 0.6s. Estimated remaining: 4m 58s. Rate: 207.5 symbols/min [2025-09-29T02:03:49.599897] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.601184] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-29T02:03:49.719193] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-29T02:03:49.723193] [INFO ] [MAIN ] MGF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.723314] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 0.5s. Estimated remaining: 4m 57s. Rate: 207.6 symbols/min [2025-09-29T02:03:49.836959] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-29T02:03:49.901608] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-29T02:03:49.926765] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.960453] [DEBUG] [LOCAL ] MGA: Loaded 51414 existing records from primary storage. [2025-09-29T02:03:49.961519] [INFO ] [MAIN ] MGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.972553] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGA took 0.9s. Estimated remaining: 4m 57s. Rate: 207.6 symbols/min [2025-09-29T02:03:50.121887] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.164344] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-29T02:03:50.165440] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-29T02:03:50.263238] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.268369] [DEBUG] [LOCAL ] MGR: Loaded 5675 existing records from primary storage. [2025-09-29T02:03:50.272873] [DEBUG] [LOCAL ] MGRB: Loaded 4102 existing records from primary storage. [2025-09-29T02:03:50.274896] [INFO ] [MAIN ] MGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:50.290826] [INFO ] [MAIN ] MGRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:50.291503] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGR took 0.6s. Estimated remaining: 4m 57s. Rate: 207.6 symbols/min [2025-09-29T02:03:50.293211] [DEBUG] [LOCAL ] MGM: Loaded 54388 existing records from primary storage. [2025-09-29T02:03:50.293424] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGRB took 0.3s. Estimated remaining: 4m 56s. Rate: 207.7 symbols/min [2025-09-29T02:03:50.310460] [INFO ] [MAIN ] MGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:50.328482] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGM took 0.7s. Estimated remaining: 4m 56s. Rate: 207.8 symbols/min [2025-09-29T02:03:50.485989] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-29T02:03:50.570295] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-29T02:03:50.776601] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.841026] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.924751] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.930147] [DEBUG] [LOCAL ] MGRD: Loaded 2231 existing records from primary storage. [2025-09-29T02:03:50.931003] [INFO ] [MAIN ] MGRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:50.931130] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRD took 0.6s. Estimated remaining: 4m 56s. Rate: 207.7 symbols/min [2025-09-29T02:03:50.958149] [DEBUG] [LOCAL ] MGRE: Loaded 6684 existing records from primary storage. [2025-09-29T02:03:51.000403] [INFO ] [MAIN ] MGRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:51.027753] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRE took 0.7s. Estimated remaining: 4m 55s. Rate: 207.8 symbols/min [2025-09-29T02:03:51.011189] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T02:03:51.061693] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-29T02:03:51.285662] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:51.297435] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-29T02:03:51.336351] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-29T02:03:51.387629] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:51.387984] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T02:03:51.388289] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-29T02:03:51.389412] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-29T02:03:51.392919] [DEBUG] [LOCAL ] MGY: Loaded 53195 existing records from primary storage. [2025-09-29T02:03:51.389596] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-29T02:03:51.390996] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-29T02:03:51.394089] [INFO ] [MAIN ] MGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:51.395491] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-29T02:03:51.395624] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGY took 1.1s. Estimated remaining: 4m 55s. Rate: 207.7 symbols/min [2025-09-29T02:03:51.610170] [DEBUG] [LOCAL ] MHD: Loaded 12297 existing records from primary storage. [2025-09-29T02:03:51.648475] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-29T02:03:51.681897] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-29T02:03:51.664802] [INFO ] [MAIN ] MHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:51.688782] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MHD took 0.6s. Estimated remaining: 4m 55s. Rate: 207.7 symbols/min [2025-09-29T02:03:51.790621] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:52.032869] [DEBUG] [LOCAL ] MHF: Loaded 8713 existing records from primary storage. [2025-09-29T02:03:52.057785] [INFO ] [MAIN ] MHF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:52.074102] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MHF took 0.7s. Estimated remaining: 4m 54s. Rate: 207.7 symbols/min [2025-09-29T02:03:52.165776] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:52.214488] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-29T02:03:52.274014] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-29T02:03:52.310197] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:52.332783] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-29T02:03:52.439588] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:52.450462] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-29T02:03:52.450574] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-29T02:03:52.450746] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-29T02:03:52.450824] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-29T02:03:52.450955] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-29T02:03:52.451025] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-29T02:03:52.498626] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:52.538250] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-29T02:03:52.571624] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:52.584848] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-09-29T02:03:52.610841] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:52.617504] [DEBUG] [LOCAL ] MHK: Loaded 43076 existing records from primary storage. [2025-09-29T02:03:52.610981] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-29T02:03:52.642560] [INFO ] [MAIN ] MHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:52.655820] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHK took 0.9s. Estimated remaining: 4m 54s. Rate: 207.5 symbols/min [2025-09-29T02:03:52.653994] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-29T02:03:52.692118] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-29T02:03:52.778059] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T02:03:52.772586] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-29T02:03:52.815384] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MH took 1.9s. Estimated remaining: 4m 54s. Rate: 207.6 symbols/min [2025-09-29T02:03:52.827275] [INFO ] [REMOTE ] MFSB: Full fetch complete (1610 records). [2025-09-29T02:03:52.895197] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-29T02:03:53.308752] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:53.351046] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:53.351617] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-29T02:03:53.519210] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-29T02:03:53.527800] [DEBUG] [LOCAL ] MHN: Loaded 7867 existing records from primary storage. [2025-09-29T02:03:53.549280] [INFO ] [MAIN ] MHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:53.549504] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:53.549717] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHN took 0.8s. Estimated remaining: 4m 54s. Rate: 207.4 symbols/min [2025-09-29T02:03:53.548790] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:53.550815] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:53.550940] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-29T02:03:53.556508] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-29T02:03:53.575240] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-29T02:03:53.602320] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-29T02:03:53.608786] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MFSB took 6.5s. Estimated remaining: 4m 54s. Rate: 207.5 symbols/min [2025-09-29T02:03:53.756279] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:03:53.800960] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-29T02:03:53.830285] [DEBUG] [LOCAL ] MHO: Loaded 24650 existing records from primary storage. [2025-09-29T02:03:53.902738] [INFO ] [MAIN ] MHO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:53.907382] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:53.957491] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHO took 1.1s. Estimated remaining: 4m 53s. Rate: 207.5 symbols/min [2025-09-29T02:03:53.965313] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-29T02:03:53.989841] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:53.990708] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-29T02:03:53.991307] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-29T02:03:53.991391] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-29T02:03:53.991483] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-29T02:03:53.991557] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-29T02:03:54.099878] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-29T02:03:54.126071] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-29T02:03:54.147241] [DEBUG] [LOCAL ] MIN: Loaded 13224 existing records from primary storage. [2025-09-29T02:03:54.187220] [INFO ] [MAIN ] MIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:54.225718] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIN took 0.6s. Estimated remaining: 4m 53s. Rate: 207.5 symbols/min [2025-09-29T02:03:54.429024] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T02:03:54.442213] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:54.442586] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-29T02:03:54.443546] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-29T02:03:54.637243] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-09-29T02:03:54.638458] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-29T02:03:54.639080] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:54.640044] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-29T02:03:54.640135] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:54.640211] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-09-29T02:03:54.640279] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:54.640355] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-29T02:03:54.640444] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-29T02:03:54.640517] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-29T02:03:54.640606] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-29T02:03:54.640748] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MIAX took 1.1s. Estimated remaining: 4m 53s. Rate: 207.4 symbols/min [2025-09-29T02:03:54.919729] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-29T02:03:54.920967] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-29T02:03:55.269493] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T02:03:55.271254] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-29T02:03:55.470304] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T02:03:55.471579] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-29T02:03:55.602073] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.13 seconds). [2025-09-29T02:03:55.603070] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-29T02:03:55.736766] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.13 seconds). [2025-09-29T02:03:55.738106] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-29T02:03:55.937326] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:03:55.938207] [INFO ] [REMOTE ] MHLA: Full fetch complete (1547 records). [2025-09-29T02:03:55.938303] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-29T02:03:56.125082] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T02:03:56.125298] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:56.125379] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:56.125458] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-29T02:03:56.125553] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-29T02:03:56.125634] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-29T02:03:56.125753] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-29T02:03:56.125849] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MHLA took 4.0s. Estimated remaining: 4m 53s. Rate: 206.8 symbols/min [2025-09-29T02:03:56.790255] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:56.793712] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:56.845114] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:56.884566] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-29T02:03:56.908942] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-29T02:03:56.908572] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:56.909505] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-29T02:03:56.910109] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-29T02:03:56.910208] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-29T02:03:56.910282] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-29T02:03:56.969035] [DEBUG] [LOCAL ] MITP: Loaded 2467 existing records from primary storage. [2025-09-29T02:03:56.980565] [INFO ] [MAIN ] MITP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:57.033252] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITP took 0.9s. Estimated remaining: 4m 54s. Rate: 206.4 symbols/min [2025-09-29T02:03:57.048535] [DEBUG] [LOCAL ] MITT: Loaded 23379 existing records from primary storage. [2025-09-29T02:03:57.086280] [INFO ] [MAIN ] MITT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:57.159245] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITT took 1.0s. Estimated remaining: 4m 53s. Rate: 206.5 symbols/min [2025-09-29T02:03:57.462743] [DEBUG] [LOCAL ] MIR: Loaded 51622 existing records from primary storage. [2025-09-29T02:03:57.575051] [INFO ] [MAIN ] MIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:57.605517] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MIR took 1.5s. Estimated remaining: 4m 53s. Rate: 206.5 symbols/min [2025-09-29T02:03:57.695521] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:57.820012] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:57.931545] [DEBUG] [LOCAL ] MIY: Loaded 6084 existing records from primary storage. [2025-09-29T02:03:57.937991] [INFO ] [MAIN ] MIY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:57.938145] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MIY took 0.9s. Estimated remaining: 4m 53s. Rate: 206.4 symbols/min [2025-09-29T02:03:57.912805] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:57.967355] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-29T02:03:58.121470] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:58.269601] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:58.270577] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-29T02:03:58.273613] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-29T02:03:58.294380] [DEBUG] [LOCAL ] MKC: Loaded 53204 existing records from primary storage. [2025-09-29T02:03:58.305002] [INFO ] [MAIN ] MKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:58.305633] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MKC took 1.1s. Estimated remaining: 4m 52s. Rate: 206.4 symbols/min [2025-09-29T02:03:58.454829] [DEBUG] [LOCAL ] MKL: Loaded 34588 existing records from primary storage. [2025-09-29T02:03:58.455847] [INFO ] [MAIN ] MKL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:58.467111] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKL took 0.8s. Estimated remaining: 4m 52s. Rate: 206.5 symbols/min [2025-09-29T02:03:58.569660] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:58.576116] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-29T02:03:58.589172] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-29T02:03:58.678675] [DEBUG] [LOCAL ] MLI: Loaded 44447 existing records from primary storage. [2025-09-29T02:03:58.680618] [INFO ] [MAIN ] MLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:58.709265] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLI took 0.8s. Estimated remaining: 4m 52s. Rate: 206.5 symbols/min [2025-09-29T02:03:58.825506] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:58.958787] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T02:03:58.959992] [DEBUG] [LOCAL ] MLM: Loaded 31068 existing records from primary storage. [2025-09-29T02:03:58.988035] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-29T02:03:59.000772] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.002352] [INFO ] [MAIN ] MLM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.002933] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLM took 0.7s. Estimated remaining: 4m 51s. Rate: 206.5 symbols/min [2025-09-29T02:03:59.086283] [DEBUG] [LOCAL ] MLNK: Loaded 25921 existing records from primary storage. [2025-09-29T02:03:59.101500] [INFO ] [MAIN ] MLNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.101678] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLNK took 0.6s. Estimated remaining: 4m 51s. Rate: 206.6 symbols/min [2025-09-29T02:03:59.154045] [DEBUG] [LOCAL ] MLP: Loaded 3120 existing records from primary storage. [2025-09-29T02:03:59.189217] [INFO ] [MAIN ] MLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.228564] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLP took 0.5s. Estimated remaining: 4m 51s. Rate: 206.7 symbols/min [2025-09-29T02:03:59.333527] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.500273] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T02:03:59.544803] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-29T02:03:59.550735] [DEBUG] [LOCAL ] MLR: Loaded 12982 existing records from primary storage. [2025-09-29T02:03:59.561673] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.609681] [INFO ] [MAIN ] MLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.618244] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLR took 0.6s. Estimated remaining: 4m 50s. Rate: 206.6 symbols/min [2025-09-29T02:03:59.676616] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.828447] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-09-29T02:03:59.850889] [INFO ] [MAIN ] MMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.870512] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.871129] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MMD took 0.6s. Estimated remaining: 4m 50s. Rate: 206.6 symbols/min [2025-09-29T02:04:00.015055] [DEBUG] [LOCAL ] MMC: Loaded 52551 existing records from primary storage. [2025-09-29T02:04:00.027963] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-29T02:04:00.049979] [DEBUG] [LOCAL ] MMI: Loaded 15452 existing records from primary storage. [2025-09-29T02:04:00.033850] [INFO ] [MAIN ] MMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:00.075888] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-29T02:04:00.073885] [INFO ] [MAIN ] MMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:00.083681] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMC took 1.0s. Estimated remaining: 4m 50s. Rate: 206.7 symbols/min [2025-09-29T02:04:00.108618] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:00.114149] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMI took 0.5s. Estimated remaining: 4m 49s. Rate: 206.8 symbols/min [2025-09-29T02:04:00.141232] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-29T02:04:00.169426] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-29T02:04:00.224397] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-29T02:04:00.301723] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-29T02:04:00.326544] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-29T02:04:00.351517] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-29T02:04:00.522885] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:00.545587] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T02:04:00.571404] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:00.593676] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-29T02:04:00.571637] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-29T02:04:00.615271] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-29T02:04:00.633496] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-29T02:04:00.654872] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-29T02:04:00.677179] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-29T02:04:00.677349] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-29T02:04:00.876114] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T02:04:00.944249] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-29T02:04:01.156091] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:04:01.224364] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-29T02:04:01.246914] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:01.272298] [DEBUG] [LOCAL ] MMM: Loaded 53995 existing records from primary storage. [2025-09-29T02:04:01.283579] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-29T02:04:01.305414] [INFO ] [MAIN ] MMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:01.330399] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMM took 1.2s. Estimated remaining: 4m 50s. Rate: 206.3 symbols/min [2025-09-29T02:04:01.517960] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-29T02:04:01.518226] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:01.531834] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-29T02:04:01.548085] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-29T02:04:01.557827] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:01.568793] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:01.558024] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-09-29T02:04:01.590368] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-29T02:04:01.618957] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:01.644794] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-29T02:04:01.663259] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:01.663615] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-29T02:04:01.663926] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-29T02:04:01.664343] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-29T02:04:01.664458] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMID took 1.8s. Estimated remaining: 4m 49s. Rate: 206.3 symbols/min [2025-09-29T02:04:01.800910] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-29T02:04:01.820163] [INFO ] [REMOTE ] MITN: Full fetch complete (2309 records). [2025-09-29T02:04:01.820772] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-29T02:04:01.826958] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-29T02:04:01.878202] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-29T02:04:01.933140] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:01.986691] [DEBUG] [LOCAL ] MMS: Loaded 34398 existing records from primary storage. [2025-09-29T02:04:02.021889] [INFO ] [MAIN ] MMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:02.054486] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMS took 0.7s. Estimated remaining: 4m 49s. Rate: 206.3 symbols/min [2025-09-29T02:04:02.141168] [DEBUG] [LOCAL ] MMT: Loaded 10987 existing records from primary storage. [2025-09-29T02:04:02.160943] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T02:04:02.178002] [INFO ] [MAIN ] MMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:02.200698] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-29T02:04:02.231352] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMT took 0.6s. Estimated remaining: 4m 49s. Rate: 206.3 symbols/min [2025-09-29T02:04:02.292512] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:02.328749] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:02.346108] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:02.380603] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-29T02:04:02.434329] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-29T02:04:02.481635] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-29T02:04:02.542628] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-29T02:04:02.573799] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:02.597991] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:02.577217] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MITN took 6.5s. Estimated remaining: 4m 49s. Rate: 206.3 symbols/min [2025-09-29T02:04:02.602473] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T02:04:02.617872] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-29T02:04:02.756987] [DEBUG] [LOCAL ] MMU: Loaded 17156 existing records from primary storage. [2025-09-29T02:04:02.800225] [INFO ] [MAIN ] MMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:02.810723] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MMU took 0.8s. Estimated remaining: 4m 48s. Rate: 206.3 symbols/min [2025-09-29T02:04:02.853053] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:02.901036] [DEBUG] [LOCAL ] MNR: Loaded 24918 existing records from primary storage. [2025-09-29T02:04:02.920338] [INFO ] [MAIN ] MNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:02.940828] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T02:04:02.959251] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-29T02:04:02.946216] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MNR took 0.7s. Estimated remaining: 4m 48s. Rate: 206.4 symbols/min [2025-09-29T02:04:03.205678] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:03.261815] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:03.263608] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-29T02:04:03.261997] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-29T02:04:03.278474] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-29T02:04:03.278595] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-29T02:04:03.278920] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-29T02:04:03.279112] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-29T02:04:03.279238] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-29T02:04:03.279329] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-29T02:04:03.279503] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-29T02:04:03.280782] [DEBUG] [LOCAL ] MNSO: Loaded 45049 existing records from primary storage. [2025-09-29T02:04:03.280970] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-29T02:04:03.279680] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-29T02:04:03.281350] [INFO ] [MAIN ] MNSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:03.281464] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-29T02:04:03.283969] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNSO took 0.7s. Estimated remaining: 4m 48s. Rate: 206.4 symbols/min [2025-09-29T02:04:03.511169] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T02:04:03.633164] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-29T02:04:03.917391] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:04.041221] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-29T02:04:04.113206] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-29T02:04:04.289596] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:04.299145] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-29T02:04:04.342847] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:04.343972] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-29T02:04:04.362560] [DEBUG] [LOCAL ] MOD: Loaded 46169 existing records from primary storage. [2025-09-29T02:04:04.362968] [INFO ] [MAIN ] MOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:04.363074] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MOD took 1.0s. Estimated remaining: 4m 48s. Rate: 206.0 symbols/min [2025-09-29T02:04:04.482042] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-29T02:04:04.483593] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-29T02:04:04.534739] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:04.564608] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:04.565569] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-29T02:04:04.565782] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:04.566186] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-09-29T02:04:04.566267] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:04.566350] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-29T02:04:04.566454] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-29T02:04:04.566530] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-29T02:04:04.566636] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-29T02:04:04.566757] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MNTN took 1.7s. Estimated remaining: 4m 47s. Rate: 206.0 symbols/min [2025-09-29T02:04:04.778852] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T02:04:04.804246] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:04.806283] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-29T02:04:04.831420] [DEBUG] [LOCAL ] MODG: Loaded 52353 existing records from primary storage. [2025-09-29T02:04:04.831972] [INFO ] [MAIN ] MODG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:04.832081] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MODG took 0.5s. Estimated remaining: 4m 47s. Rate: 206.0 symbols/min [2025-09-29T02:04:05.038493] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:05.052972] [DEBUG] [LOCAL ] MOH: Loaded 42444 existing records from primary storage. [2025-09-29T02:04:05.056103] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-29T02:04:05.058616] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-29T02:04:05.056735] [INFO ] [MAIN ] MOH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:05.059968] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOH took 0.5s. Estimated remaining: 4m 47s. Rate: 206.1 symbols/min [2025-09-29T02:04:05.275571] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:05.299151] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-29T02:04:05.300977] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T02:04:05.303786] [INFO ] [REMOTE ] MMKT: Full fetch complete (2099 records). [2025-09-29T02:04:05.316558] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-29T02:04:05.317276] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-29T02:04:05.387498] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-09-29T02:04:05.421348] [INFO ] [MAIN ] MOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:05.422500] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MOS took 0.6s. Estimated remaining: 4m 47s. Rate: 206.0 symbols/min [2025-09-29T02:04:05.574452] [DEBUG] [LOCAL ] MOV: Loaded 22417 existing records from primary storage. [2025-09-29T02:04:05.661344] [INFO ] [MAIN ] MOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:05.668680] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:05.674525] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:05.685012] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOV took 0.6s. Estimated remaining: 4m 46s. Rate: 206.0 symbols/min [2025-09-29T02:04:05.679770] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:05.695886] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-29T02:04:05.723733] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-29T02:04:05.753265] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-29T02:04:05.761923] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:05.794828] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-29T02:04:05.809830] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MMKT took 5.7s. Estimated remaining: 4m 46s. Rate: 206.1 symbols/min [2025-09-29T02:04:06.081052] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:06.185909] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:06.188763] [DEBUG] [LOCAL ] MP: Loaded 54444 existing records from primary storage. [2025-09-29T02:04:06.195004] [INFO ] [MAIN ] MP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:06.194431] [DEBUG] [LOCAL ] MPA: Loaded 5268 existing records from primary storage. [2025-09-29T02:04:06.195418] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MP took 0.8s. Estimated remaining: 4m 46s. Rate: 206.1 symbols/min [2025-09-29T02:04:06.195816] [INFO ] [MAIN ] MPA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:06.219286] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPA took 0.5s. Estimated remaining: 4m 45s. Rate: 206.2 symbols/min [2025-09-29T02:04:06.573269] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:06.662930] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:06.684344] [DEBUG] [LOCAL ] MPC: Loaded 52889 existing records from primary storage. [2025-09-29T02:04:06.682169] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T02:04:06.695510] [INFO ] [MAIN ] MPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:06.695831] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPC took 0.9s. Estimated remaining: 4m 45s. Rate: 206.1 symbols/min [2025-09-29T02:04:06.711199] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-29T02:04:06.754766] [DEBUG] [LOCAL ] MPV: Loaded 5098 existing records from primary storage. [2025-09-29T02:04:06.783568] [INFO ] [MAIN ] MPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:06.812097] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPV took 0.6s. Estimated remaining: 4m 45s. Rate: 206.2 symbols/min [2025-09-29T02:04:07.007429] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.069607] [DEBUG] [LOCAL ] MPLX: Loaded 51491 existing records from primary storage. [2025-09-29T02:04:07.082579] [INFO ] [MAIN ] MPLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.115402] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPLX took 0.9s. Estimated remaining: 4m 44s. Rate: 206.2 symbols/min [2025-09-29T02:04:07.179140] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.301446] [DEBUG] [LOCAL ] MPX: Loaded 4213 existing records from primary storage. [2025-09-29T02:04:07.301880] [INFO ] [MAIN ] MPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.307775] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPX took 0.5s. Estimated remaining: 4m 44s. Rate: 206.2 symbols/min [2025-09-29T02:04:07.439157] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.499745] [DEBUG] [LOCAL ] MPW: Loaded 54275 existing records from primary storage. [2025-09-29T02:04:07.528267] [INFO ] [MAIN ] MPW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.528862] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPW took 0.8s. Estimated remaining: 4m 44s. Rate: 206.3 symbols/min [2025-09-29T02:04:07.652714] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.674575] [DEBUG] [LOCAL ] MQT: Loaded 8523 existing records from primary storage. [2025-09-29T02:04:07.704364] [INFO ] [MAIN ] MQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.720324] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MQT took 0.6s. Estimated remaining: 4m 43s. Rate: 206.3 symbols/min [2025-09-29T02:04:07.837949] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.845230] [DEBUG] [LOCAL ] MQY: Loaded 16979 existing records from primary storage. [2025-09-29T02:04:07.846425] [INFO ] [MAIN ] MQY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.871748] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 0.5s. Estimated remaining: 4m 43s. Rate: 206.4 symbols/min [2025-09-29T02:04:07.878308] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T02:04:07.889854] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-29T02:04:07.930354] [DEBUG] [LOCAL ] MRC: Loaded 38128 existing records from primary storage. [2025-09-29T02:04:07.930768] [INFO ] [MAIN ] MRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.930947] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MRC took 0.3s. Estimated remaining: 4m 42s. Rate: 206.5 symbols/min [2025-09-29T02:04:08.644110] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T02:04:08.657134] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-29T02:04:09.472031] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T02:04:09.483895] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-29T02:04:10.256279] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-29T02:04:10.268421] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-29T02:04:11.013985] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T02:04:11.026164] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-29T02:04:11.788185] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T02:04:11.804866] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-29T02:04:12.631924] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T02:04:12.644320] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-29T02:04:13.376775] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T02:04:13.387028] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-29T02:04:13.387228] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-29T02:04:13.600411] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:04:13.602052] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:13.602173] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:13.602267] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-29T02:04:13.602381] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-29T02:04:13.602466] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-29T02:04:13.602594] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-29T02:04:13.603068] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MO took 10.6s. Estimated remaining: 4m 46s. Rate: 203.8 symbols/min [2025-09-29T02:04:14.414818] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:14.360617] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:14.419116] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:14.442104] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:14.442726] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-29T02:04:14.442843] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-29T02:04:14.443563] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-29T02:04:14.443671] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-29T02:04:14.443759] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-29T02:04:14.443862] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-29T02:04:14.673611] [DEBUG] [LOCAL ] MSA: Loaded 18988 existing records from primary storage. [2025-09-29T02:04:14.730555] [INFO ] [MAIN ] MSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:14.745849] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MSA took 1.1s. Estimated remaining: 4m 46s. Rate: 203.4 symbols/min [2025-09-29T02:04:14.948145] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-29T02:04:14.985921] [DEBUG] [LOCAL ] MS: Loaded 54472 existing records from primary storage. [2025-09-29T02:04:14.992081] [INFO ] [MAIN ] MRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:15.029374] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MRK took 1.4s. Estimated remaining: 4m 46s. Rate: 203.4 symbols/min [2025-09-29T02:04:15.018610] [INFO ] [MAIN ] MS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:15.086334] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MS took 1.5s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-29T02:04:15.196429] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:15.209927] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:15.258794] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-29T02:04:15.423835] [DEBUG] [LOCAL ] MSB: Loaded 7895 existing records from primary storage. [2025-09-29T02:04:15.461953] [INFO ] [MAIN ] MSB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:15.485511] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MSB took 0.7s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-29T02:04:15.538988] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:15.584098] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:15.631991] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-29T02:04:15.644460] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:15.670869] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:15.687777] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-09-29T02:04:15.693595] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:15.687936] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-29T02:04:15.713404] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-29T02:04:15.724895] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-29T02:04:15.713546] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-29T02:04:15.725271] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-29T02:04:15.725749] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-29T02:04:15.736887] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-29T02:04:15.759002] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MRP took 2.1s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-29T02:04:15.789098] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-29T02:04:15.832805] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:15.838419] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-29T02:04:15.845571] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-29T02:04:16.006115] [DEBUG] [LOCAL ] MSCI: Loaded 35351 existing records from primary storage. [2025-09-29T02:04:16.073856] [DEBUG] [LOCAL ] MSD: Loaded 15775 existing records from primary storage. [2025-09-29T02:04:16.084632] [INFO ] [MAIN ] MSCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:16.111106] [INFO ] [MAIN ] MSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:16.129175] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSCI took 1.0s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-29T02:04:16.232228] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSD took 0.6s. Estimated remaining: 4m 44s. Rate: 203.5 symbols/min [2025-09-29T02:04:16.383298] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:16.734873] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:16.751867] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-29T02:04:16.821330] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:16.902441] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:16.917572] [DEBUG] [LOCAL ] MSDL: Loaded 38645 existing records from primary storage. [2025-09-29T02:04:16.918092] [INFO ] [MAIN ] MSDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:16.918198] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSDL took 1.1s. Estimated remaining: 4m 44s. Rate: 203.4 symbols/min [2025-09-29T02:04:17.069013] [DEBUG] [LOCAL ] MSGS: Loaded 17318 existing records from primary storage. [2025-09-29T02:04:17.127478] [INFO ] [MAIN ] MSGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:17.163367] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T02:04:17.160485] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:17.160719] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSGS took 0.8s. Estimated remaining: 4m 44s. Rate: 203.4 symbols/min [2025-09-29T02:04:17.165784] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-29T02:04:17.164493] [DEBUG] [LOCAL ] MSGE: Loaded 27513 existing records from primary storage. [2025-09-29T02:04:17.167394] [INFO ] [MAIN ] MSGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:17.173103] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSGE took 1.0s. Estimated remaining: 4m 43s. Rate: 203.5 symbols/min [2025-09-29T02:04:17.522799] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:17.583366] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-29T02:04:17.587919] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-29T02:04:17.608973] [DEBUG] [LOCAL ] MSI: Loaded 41128 existing records from primary storage. [2025-09-29T02:04:17.602475] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T02:04:17.614066] [INFO ] [MAIN ] MSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:17.614222] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-29T02:04:17.614637] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSI took 0.7s. Estimated remaining: 4m 43s. Rate: 203.4 symbols/min [2025-09-29T02:04:17.613903] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-29T02:04:17.611396] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:17.614972] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-29T02:04:17.651551] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-29T02:04:17.671009] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-29T02:04:17.963214] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:18.021281] [DEBUG] [LOCAL ] MSM: Loaded 36004 existing records from primary storage. [2025-09-29T02:04:18.033435] [INFO ] [MAIN ] MSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:18.045001] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSM took 0.8s. Estimated remaining: 4m 43s. Rate: 203.4 symbols/min [2025-09-29T02:04:18.111861] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T02:04:18.173469] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-29T02:04:18.463635] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:18.547344] [DEBUG] [LOCAL ] MT: Loaded 51417 existing records from primary storage. [2025-09-29T02:04:18.561344] [INFO ] [MAIN ] MT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:18.561852] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MT took 0.9s. Estimated remaining: 4m 43s. Rate: 203.3 symbols/min [2025-09-29T02:04:18.566233] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:18.575155] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-29T02:04:18.575295] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-29T02:04:18.614383] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-29T02:04:18.757969] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:18.791519] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-29T02:04:18.808094] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:18.796360] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:18.809967] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-09-29T02:04:18.810070] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:18.810222] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-29T02:04:18.811035] [DEBUG] [LOCAL ] MTAL: Loaded 37002 existing records from primary storage. [2025-09-29T02:04:18.811770] [INFO ] [MAIN ] MTAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:18.811591] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-29T02:04:18.812471] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MTAL took 0.8s. Estimated remaining: 4m 42s. Rate: 203.3 symbols/min [2025-09-29T02:04:18.812664] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-29T02:04:18.825757] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-29T02:04:18.849454] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MSIF took 1.7s. Estimated remaining: 4m 42s. Rate: 203.4 symbols/min [2025-09-29T02:04:18.885122] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-29T02:04:18.936097] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-29T02:04:19.220617] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:19.243942] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:19.263181] [DEBUG] [LOCAL ] MTB: Loaded 47562 existing records from primary storage. [2025-09-29T02:04:19.263827] [INFO ] [MAIN ] MTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:19.264077] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTB took 0.7s. Estimated remaining: 4m 42s. Rate: 203.4 symbols/min [2025-09-29T02:04:19.408519] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T02:04:19.410532] [DEBUG] [LOCAL ] MTD: Loaded 15342 existing records from primary storage. [2025-09-29T02:04:19.412361] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-29T02:04:19.418627] [INFO ] [MAIN ] MTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:19.420096] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTD took 0.6s. Estimated remaining: 4m 41s. Rate: 203.4 symbols/min [2025-09-29T02:04:19.618363] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:19.662032] [DEBUG] [LOCAL ] MTDR: Loaded 52316 existing records from primary storage. [2025-09-29T02:04:19.684154] [INFO ] [MAIN ] MTDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:19.724900] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTDR took 0.8s. Estimated remaining: 4m 41s. Rate: 203.4 symbols/min [2025-09-29T02:04:19.747719] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:19.748137] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T02:04:19.755766] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-29T02:04:19.959500] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:20.011387] [DEBUG] [LOCAL ] MTG: Loaded 52091 existing records from primary storage. [2025-09-29T02:04:20.012025] [INFO ] [MAIN ] MTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:20.012136] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTG took 0.7s. Estimated remaining: 4m 41s. Rate: 203.4 symbols/min [2025-09-29T02:04:20.048166] [DEBUG] [LOCAL ] MTH: Loaded 44547 existing records from primary storage. [2025-09-29T02:04:20.088921] [INFO ] [MAIN ] MTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:20.102796] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTH took 0.7s. Estimated remaining: 4m 40s. Rate: 203.5 symbols/min [2025-09-29T02:04:20.116427] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T02:04:20.160984] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-29T02:04:20.370224] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:20.381001] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-29T02:04:20.383126] [DEBUG] [LOCAL ] MTN: Loaded 39607 existing records from primary storage. [2025-09-29T02:04:20.393766] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-29T02:04:20.434092] [INFO ] [MAIN ] MTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:20.435684] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTN took 0.7s. Estimated remaining: 4m 40s. Rate: 203.5 symbols/min [2025-09-29T02:04:20.432349] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-29T02:04:20.459399] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:20.474730] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-29T02:04:20.528121] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-29T02:04:20.529007] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-29T02:04:20.579431] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T02:04:20.645423] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-29T02:04:20.791965] [DEBUG] [LOCAL ] MTRN: Loaded 18303 existing records from primary storage. [2025-09-29T02:04:20.846524] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:20.846772] [INFO ] [MAIN ] MTRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:20.890806] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTRN took 0.8s. Estimated remaining: 4m 40s. Rate: 203.4 symbols/min [2025-09-29T02:04:21.148700] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T02:04:21.221557] [INFO ] [REMOTE ] MSC: Full fetch complete (2509 records). [2025-09-29T02:04:21.250964] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-29T02:04:21.239776] [DEBUG] [LOCAL ] MTUS: Loaded 28984 existing records from primary storage. [2025-09-29T02:04:21.334135] [INFO ] [MAIN ] MTUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:21.415865] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTUS took 1.0s. Estimated remaining: 4m 40s. Rate: 203.3 symbols/min [2025-09-29T02:04:21.427519] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:21.469358] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:21.496687] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-29T02:04:21.732638] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-29T02:04:21.761305] [DEBUG] [LOCAL ] MTW: Loaded 26888 existing records from primary storage. [2025-09-29T02:04:21.762132] [INFO ] [MAIN ] MTW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:21.761962] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:21.767444] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTW took 0.9s. Estimated remaining: 4m 40s. Rate: 203.3 symbols/min [2025-09-29T02:04:21.779799] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:21.795673] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-29T02:04:21.845895] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-29T02:04:21.872285] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:21.873703] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-29T02:04:21.889327] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-29T02:04:21.917370] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MSC took 6.8s. Estimated remaining: 4m 39s. Rate: 203.4 symbols/min [2025-09-29T02:04:22.088689] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T02:04:22.109969] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.122031] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-29T02:04:22.175386] [DEBUG] [LOCAL ] MTX: Loaded 23150 existing records from primary storage. [2025-09-29T02:04:22.223411] [INFO ] [MAIN ] MTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:22.250927] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.251054] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTX took 0.8s. Estimated remaining: 4m 39s. Rate: 203.3 symbols/min [2025-09-29T02:04:22.386076] [DEBUG] [LOCAL ] MUA: Loaded 12391 existing records from primary storage. [2025-09-29T02:04:22.416680] [DEBUG] [LOCAL ] MTZ: Loaded 43922 existing records from primary storage. [2025-09-29T02:04:22.417203] [INFO ] [MAIN ] MTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:22.422522] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MTZ took 0.6s. Estimated remaining: 4m 38s. Rate: 203.4 symbols/min [2025-09-29T02:04:22.417059] [INFO ] [MAIN ] MUA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:22.450025] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUA took 0.5s. Estimated remaining: 4m 38s. Rate: 203.5 symbols/min [2025-09-29T02:04:22.511213] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.596126] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T02:04:22.624856] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-29T02:04:22.819854] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.873586] [DEBUG] [LOCAL ] MUC: Loaded 20721 existing records from primary storage. [2025-09-29T02:04:22.906376] [INFO ] [MAIN ] MUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:22.909035] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.912090] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T02:04:22.913839] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-29T02:04:22.914242] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUC took 0.7s. Estimated remaining: 4m 38s. Rate: 203.4 symbols/min [2025-09-29T02:04:23.053923] [DEBUG] [LOCAL ] MUE: Loaded 12092 existing records from primary storage. [2025-09-29T02:04:23.081050] [INFO ] [MAIN ] MUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:23.097398] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 0.7s. Estimated remaining: 4m 37s. Rate: 203.5 symbols/min [2025-09-29T02:04:23.185929] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:23.227252] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T02:04:23.265724] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-29T02:04:23.318020] [DEBUG] [LOCAL ] MUFG: Loaded 53341 existing records from primary storage. [2025-09-29T02:04:23.388455] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:23.394610] [DEBUG] [LOCAL ] MUJ: Loaded 13473 existing records from primary storage. [2025-09-29T02:04:23.388598] [INFO ] [MAIN ] MUFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:23.395202] [INFO ] [MAIN ] MUJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:23.395284] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUFG took 0.9s. Estimated remaining: 4m 37s. Rate: 203.5 symbols/min [2025-09-29T02:04:23.395570] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUJ took 0.5s. Estimated remaining: 4m 37s. Rate: 203.6 symbols/min [2025-09-29T02:04:23.641075] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T02:04:23.646608] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-29T02:04:23.773571] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:23.810476] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:23.825666] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-29T02:04:23.825864] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-29T02:04:23.826371] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-29T02:04:23.826451] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-29T02:04:23.826527] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-29T02:04:23.826596] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-29T02:04:23.959229] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T02:04:23.990344] [DEBUG] [LOCAL ] MUR: Loaded 53705 existing records from primary storage. [2025-09-29T02:04:24.002288] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-29T02:04:24.038721] [INFO ] [MAIN ] MUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:24.096752] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUR took 1.0s. Estimated remaining: 4m 37s. Rate: 203.4 symbols/min [2025-09-29T02:04:24.125513] [DEBUG] [LOCAL ] MUSA: Loaded 25221 existing records from primary storage. [2025-09-29T02:04:24.190109] [INFO ] [MAIN ] MUSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:24.237099] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUSA took 0.8s. Estimated remaining: 4m 36s. Rate: 203.5 symbols/min [2025-09-29T02:04:24.468717] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:24.536535] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-29T02:04:24.617769] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T02:04:24.636038] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:24.642318] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-29T02:04:24.726803] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:24.754136] [DEBUG] [LOCAL ] MVF: Loaded 12921 existing records from primary storage. [2025-09-29T02:04:24.754483] [INFO ] [MAIN ] MVF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:24.754601] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MVF took 0.4s. Estimated remaining: 4m 36s. Rate: 203.4 symbols/min [2025-09-29T02:04:24.798254] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T02:04:24.807876] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-29T02:04:24.863081] [DEBUG] [LOCAL ] MUX: Loaded 43253 existing records from primary storage. [2025-09-29T02:04:24.894292] [INFO ] [MAIN ] MUX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:24.905713] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MUX took 0.7s. Estimated remaining: 4m 36s. Rate: 203.5 symbols/min [2025-09-29T02:04:24.997218] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:24.997033] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:25.002918] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-29T02:04:25.011093] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:25.011030] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T02:04:25.024635] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-09-29T02:04:25.024200] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-29T02:04:25.040531] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:25.062063] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-29T02:04:25.086378] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-29T02:04:25.110101] [DEBUG] [LOCAL ] MVO: Loaded 9140 existing records from primary storage. [2025-09-29T02:04:25.100276] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-29T02:04:25.120734] [INFO ] [MAIN ] MVO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:25.125992] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-29T02:04:25.153486] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MUSE took 1.8s. Estimated remaining: 4m 35s. Rate: 203.5 symbols/min [2025-09-29T02:04:25.182488] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:25.182716] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVO took 0.4s. Estimated remaining: 4m 35s. Rate: 203.6 symbols/min [2025-09-29T02:04:25.197918] [DEBUG] [LOCAL ] MVT: Loaded 10355 existing records from primary storage. [2025-09-29T02:04:25.198238] [INFO ] [MAIN ] MVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:25.198339] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVT took 0.3s. Estimated remaining: 4m 34s. Rate: 203.8 symbols/min [2025-09-29T02:04:25.265779] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-29T02:04:25.267493] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-29T02:04:25.395586] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.13 seconds). [2025-09-29T02:04:25.397279] [INFO ] [REMOTE ] MTR: Full fetch complete (2549 records). [2025-09-29T02:04:25.397443] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-29T02:04:25.643189] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:25.643432] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:25.643543] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:25.643675] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-29T02:04:25.643821] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-29T02:04:25.643924] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-29T02:04:25.644061] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-29T02:04:25.644179] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MTR took 5.6s. Estimated remaining: 4m 34s. Rate: 203.7 symbols/min [2025-09-29T02:04:26.607354] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:26.578339] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:26.633962] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-29T02:04:26.639603] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-29T02:04:26.686144] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:26.686529] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-29T02:04:26.663225] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:26.687307] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-29T02:04:26.687746] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-29T02:04:26.687835] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-29T02:04:26.816609] [DEBUG] [LOCAL ] MXF: Loaded 5984 existing records from primary storage. [2025-09-29T02:04:26.822266] [INFO ] [MAIN ] MXF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:26.877932] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXF took 1.2s. Estimated remaining: 4m 35s. Rate: 203.2 symbols/min [2025-09-29T02:04:26.879227] [DEBUG] [LOCAL ] MX: Loaded 23379 existing records from primary storage. [2025-09-29T02:04:26.890892] [INFO ] [MAIN ] MX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:26.891187] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MX took 1.2s. Estimated remaining: 4m 34s. Rate: 203.4 symbols/min [2025-09-29T02:04:27.333978] [DEBUG] [LOCAL ] MWA: Loaded 47633 existing records from primary storage. [2025-09-29T02:04:27.465731] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:27.466066] [INFO ] [MAIN ] MWA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:27.511346] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MWA took 1.9s. Estimated remaining: 4m 34s. Rate: 203.2 symbols/min [2025-09-29T02:04:27.504965] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:27.701000] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:27.727115] [DEBUG] [LOCAL ] MYD: Loaded 13946 existing records from primary storage. [2025-09-29T02:04:27.715709] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-29T02:04:27.744999] [INFO ] [MAIN ] MYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:27.757535] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MYD took 0.9s. Estimated remaining: 4m 34s. Rate: 203.2 symbols/min [2025-09-29T02:04:27.961368] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:27.956749] [DEBUG] [LOCAL ] MYE: Loaded 25346 existing records from primary storage. [2025-09-29T02:04:28.001633] [INFO ] [MAIN ] MYE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:28.012981] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYE took 1.1s. Estimated remaining: 4m 33s. Rate: 203.3 symbols/min [2025-09-29T02:04:28.108814] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T02:04:28.146372] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:28.157274] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-29T02:04:28.250850] [DEBUG] [LOCAL ] MYI: Loaded 19636 existing records from primary storage. [2025-09-29T02:04:28.245012] [DEBUG] [LOCAL ] MYN: Loaded 10324 existing records from primary storage. [2025-09-29T02:04:28.305931] [INFO ] [MAIN ] MYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:28.310969] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:28.311752] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYN took 0.5s. Estimated remaining: 4m 33s. Rate: 203.3 symbols/min [2025-09-29T02:04:28.306074] [INFO ] [MAIN ] MYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:28.324212] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYI took 0.8s. Estimated remaining: 4m 33s. Rate: 203.4 symbols/min [2025-09-29T02:04:28.576360] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-29T02:04:28.590253] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-29T02:04:28.744156] [DEBUG] [LOCAL ] NABL: Loaded 40294 existing records from primary storage. [2025-09-29T02:04:28.769013] [INFO ] [MAIN ] NABL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:28.748670] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:28.769199] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. NABL took 0.8s. Estimated remaining: 4m 32s. Rate: 203.3 symbols/min [2025-09-29T02:04:28.768340] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.010000] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T02:04:29.006858] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.023773] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-29T02:04:29.011235] [DEBUG] [LOCAL ] NAC: Loaded 25076 existing records from primary storage. [2025-09-29T02:04:29.026138] [DEBUG] [LOCAL ] NAD: Loaded 34318 existing records from primary storage. [2025-09-29T02:04:29.030594] [INFO ] [MAIN ] NAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.031223] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAC took 0.7s. Estimated remaining: 4m 32s. Rate: 203.3 symbols/min [2025-09-29T02:04:29.030885] [INFO ] [MAIN ] NAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.057819] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAD took 0.7s. Estimated remaining: 4m 32s. Rate: 203.5 symbols/min [2025-09-29T02:04:29.251443] [DEBUG] [LOCAL ] NAN: Loaded 9084 existing records from primary storage. [2025-09-29T02:04:29.379541] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T02:04:29.396365] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.348439] [INFO ] [MAIN ] NAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.413891] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-29T02:04:29.407289] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAN took 0.6s. Estimated remaining: 4m 31s. Rate: 203.4 symbols/min [2025-09-29T02:04:29.551357] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.707970] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.736683] [DEBUG] [LOCAL ] NAZ: Loaded 2703 existing records from primary storage. [2025-09-29T02:04:29.764478] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-29T02:04:29.765822] [INFO ] [MAIN ] NAZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.768440] [DEBUG] [LOCAL ] NAT: Loaded 49859 existing records from primary storage. [2025-09-29T02:04:29.767362] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-29T02:04:29.770261] [INFO ] [MAIN ] NAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.768896] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAZ took 0.3s. Estimated remaining: 4m 31s. Rate: 203.4 symbols/min [2025-09-29T02:04:29.771494] [DEBUG] [LOCAL ] NATL: Loaded 33367 existing records from primary storage. [2025-09-29T02:04:29.777087] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NAT took 0.7s. Estimated remaining: 4m 31s. Rate: 203.6 symbols/min [2025-09-29T02:04:29.783733] [INFO ] [MAIN ] NATL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.863226] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NATL took 0.8s. Estimated remaining: 4m 30s. Rate: 203.7 symbols/min [2025-09-29T02:04:30.040837] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-29T02:04:30.096567] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-29T02:04:30.280907] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.278579] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.367418] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.372901] [DEBUG] [LOCAL ] NBB: Loaded 8967 existing records from primary storage. [2025-09-29T02:04:30.373733] [INFO ] [MAIN ] NBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:30.373886] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBB took 0.6s. Estimated remaining: 4m 30s. Rate: 203.5 symbols/min [2025-09-29T02:04:30.526984] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T02:04:30.541796] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-29T02:04:30.564074] [DEBUG] [LOCAL ] NBHC: Loaded 23530 existing records from primary storage. [2025-09-29T02:04:30.567509] [INFO ] [MAIN ] NBHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:30.569468] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBHC took 0.8s. Estimated remaining: 4m 30s. Rate: 203.6 symbols/min [2025-09-29T02:04:30.713754] [DEBUG] [LOCAL ] NBR: Loaded 35286 existing records from primary storage. [2025-09-29T02:04:30.758364] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.789721] [INFO ] [MAIN ] NBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:30.801434] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBR took 0.9s. Estimated remaining: 4m 29s. Rate: 203.6 symbols/min [2025-09-29T02:04:30.935171] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.987355] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-29T02:04:31.033352] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-29T02:04:31.025161] [DEBUG] [LOCAL ] NC: Loaded 1933 existing records from primary storage. [2025-09-29T02:04:31.047114] [INFO ] [MAIN ] NC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:31.041730] [DEBUG] [LOCAL ] NBXG: Loaded 22794 existing records from primary storage. [2025-09-29T02:04:31.079705] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NC took 0.5s. Estimated remaining: 4m 29s. Rate: 203.6 symbols/min [2025-09-29T02:04:31.123896] [INFO ] [MAIN ] NBXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:31.162069] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NBXG took 0.8s. Estimated remaining: 4m 29s. Rate: 203.7 symbols/min [2025-09-29T02:04:31.146541] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:31.439564] [DEBUG] [LOCAL ] NCA: Loaded 10178 existing records from primary storage. [2025-09-29T02:04:31.459197] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:31.475742] [INFO ] [MAIN ] NCA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:31.488947] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NCA took 0.7s. Estimated remaining: 4m 28s. Rate: 203.7 symbols/min [2025-09-29T02:04:31.527238] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T02:04:31.531588] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:31.533842] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-29T02:04:31.670550] [DEBUG] [LOCAL ] NCDL: Loaded 21828 existing records from primary storage. [2025-09-29T02:04:31.671057] [INFO ] [MAIN ] NCDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:31.671970] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCDL took 0.6s. Estimated remaining: 4m 28s. Rate: 203.8 symbols/min [2025-09-29T02:04:31.810884] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:31.830446] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-29T02:04:31.875858] [INFO ] [REMOTE ] MXE: Full fetch complete (2667 records). [2025-09-29T02:04:31.917281] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-29T02:04:31.930517] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-29T02:04:31.984509] [INFO ] [MAIN ] NCLH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:32.011512] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCLH took 0.8s. Estimated remaining: 4m 28s. Rate: 203.7 symbols/min [2025-09-29T02:04:32.102023] [DEBUG] [LOCAL ] NCV: Loaded 13602 existing records from primary storage. [2025-09-29T02:04:32.184575] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:32.214926] [INFO ] [MAIN ] NCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:32.238636] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCV took 0.7s. Estimated remaining: 4m 27s. Rate: 203.8 symbols/min [2025-09-29T02:04:32.486004] [DEBUG] [LOCAL ] NCZ: Loaded 11998 existing records from primary storage. [2025-09-29T02:04:32.506038] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:32.546290] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:32.558301] [INFO ] [MAIN ] NCZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:32.579580] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCZ took 0.9s. Estimated remaining: 4m 27s. Rate: 203.8 symbols/min [2025-09-29T02:04:32.574082] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:32.602441] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:32.675195] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-29T02:04:32.725314] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-29T02:04:32.804272] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-29T02:04:32.805143] [DEBUG] [LOCAL ] NDMO: Loaded 16978 existing records from primary storage. [2025-09-29T02:04:32.837434] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-29T02:04:32.837919] [INFO ] [MAIN ] NDMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:32.816100] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:32.838033] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. MXE took 7.2s. Estimated remaining: 4m 27s. Rate: 203.8 symbols/min [2025-09-29T02:04:32.849751] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NDMO took 0.8s. Estimated remaining: 4m 26s. Rate: 203.9 symbols/min [2025-09-29T02:04:33.020380] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.390731] [DEBUG] [LOCAL ] NE: Loaded 53157 existing records from primary storage. [2025-09-29T02:04:33.401037] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.398588] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.401638] [INFO ] [MAIN ] NE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:33.402746] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NE took 1.1s. Estimated remaining: 4m 26s. Rate: 203.8 symbols/min [2025-09-29T02:04:33.409276] [DEBUG] [LOCAL ] NEA: Loaded 35808 existing records from primary storage. [2025-09-29T02:04:33.427509] [INFO ] [MAIN ] NEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:33.448816] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEA took 0.9s. Estimated remaining: 4m 26s. Rate: 203.9 symbols/min [2025-09-29T02:04:33.744548] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.862072] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.866494] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-09-29T02:04:33.868693] [INFO ] [MAIN ] NEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:33.868900] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEE took 1.0s. Estimated remaining: 4m 25s. Rate: 203.8 symbols/min [2025-09-29T02:04:33.908534] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-09-29T02:04:33.953004] [INFO ] [MAIN ] NEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:33.972225] [DEBUG] [LOCAL ] NEU: Loaded 8259 existing records from primary storage. [2025-09-29T02:04:33.988184] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEM took 1.1s. Estimated remaining: 4m 25s. Rate: 203.9 symbols/min [2025-09-29T02:04:34.022321] [INFO ] [MAIN ] NEU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:34.061585] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEU took 0.6s. Estimated remaining: 4m 25s. Rate: 204.0 symbols/min [2025-09-29T02:04:34.313206] [DEBUG] [LOCAL ] NET: Loaded 53808 existing records from primary storage. [2025-09-29T02:04:34.356398] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:34.403191] [INFO ] [MAIN ] NET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:34.409989] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NET took 1.0s. Estimated remaining: 4m 24s. Rate: 204.0 symbols/min [2025-09-29T02:04:34.495965] [DEBUG] [LOCAL ] NEUE: Loaded 2271 existing records from primary storage. [2025-09-29T02:04:34.449878] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:34.541008] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:34.561584] [INFO ] [MAIN ] NEUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:34.588479] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NEUE took 0.7s. Estimated remaining: 4m 24s. Rate: 204.1 symbols/min [2025-09-29T02:04:34.681397] [DEBUG] [LOCAL ] NEXA: Loaded 4307 existing records from primary storage. [2025-09-29T02:04:34.733441] [INFO ] [MAIN ] NEXA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:34.773350] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NEXA took 0.8s. Estimated remaining: 4m 24s. Rate: 204.1 symbols/min [2025-09-29T02:04:34.846460] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.029879] [DEBUG] [LOCAL ] NFG: Loaded 39084 existing records from primary storage. [2025-09-29T02:04:35.078627] [INFO ] [MAIN ] NFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.082492] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.083346] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NFG took 1.0s. Estimated remaining: 4m 23s. Rate: 204.1 symbols/min [2025-09-29T02:04:35.196214] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.221323] [DEBUG] [LOCAL ] NFJ: Loaded 20592 existing records from primary storage. [2025-09-29T02:04:35.265403] [INFO ] [MAIN ] NFJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.283571] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NFJ took 0.8s. Estimated remaining: 4m 23s. Rate: 204.1 symbols/min [2025-09-29T02:04:35.475521] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.533111] [DEBUG] [LOCAL ] NGG: Loaded 46809 existing records from primary storage. [2025-09-29T02:04:35.596072] [INFO ] [MAIN ] NGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.625433] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGG took 1.0s. Estimated remaining: 4m 23s. Rate: 204.1 symbols/min [2025-09-29T02:04:35.627369] [DEBUG] [LOCAL ] NGL: Loaded 30754 existing records from primary storage. [2025-09-29T02:04:35.626383] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.633432] [INFO ] [MAIN ] NGL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.633172] [DEBUG] [LOCAL ] NGS: Loaded 11682 existing records from primary storage. [2025-09-29T02:04:35.634078] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGL took 0.8s. Estimated remaining: 4m 22s. Rate: 204.3 symbols/min [2025-09-29T02:04:35.634805] [INFO ] [MAIN ] NGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.634900] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGS took 0.5s. Estimated remaining: 4m 22s. Rate: 204.4 symbols/min [2025-09-29T02:04:35.659775] [DEBUG] [LOCAL ] NGVC: Loaded 22650 existing records from primary storage. [2025-09-29T02:04:35.660120] [INFO ] [MAIN ] NGVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.660252] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NGVC took 0.4s. Estimated remaining: 4m 21s. Rate: 204.5 symbols/min [2025-09-29T02:04:36.191358] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.361805] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.396451] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.423736] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.430403] [DEBUG] [LOCAL ] NIC: Loaded 9026 existing records from primary storage. [2025-09-29T02:04:36.430971] [INFO ] [MAIN ] NIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:36.431077] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NIC took 0.8s. Estimated remaining: 4m 21s. Rate: 204.3 symbols/min [2025-09-29T02:04:36.601939] [DEBUG] [LOCAL ] NHI: Loaded 22283 existing records from primary storage. [2025-09-29T02:04:36.647541] [INFO ] [MAIN ] NHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:36.654320] [DEBUG] [LOCAL ] NGVT: Loaded 24631 existing records from primary storage. [2025-09-29T02:04:36.668251] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NHI took 1.0s. Estimated remaining: 4m 21s. Rate: 204.3 symbols/min [2025-09-29T02:04:36.669128] [INFO ] [MAIN ] NGVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:36.671399] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NGVT took 1.0s. Estimated remaining: 4m 21s. Rate: 204.5 symbols/min [2025-09-29T02:04:36.751618] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.783321] [DEBUG] [LOCAL ] NI: Loaded 54201 existing records from primary storage. [2025-09-29T02:04:36.848672] [INFO ] [MAIN ] NI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:36.865307] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 1.2s. Estimated remaining: 4m 20s. Rate: 204.5 symbols/min [2025-09-29T02:04:37.035240] [DEBUG] [LOCAL ] NIE: Loaded 11869 existing records from primary storage. [2025-09-29T02:04:37.083334] [INFO ] [MAIN ] NIE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:37.200104] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIE took 0.8s. Estimated remaining: 4m 20s. Rate: 204.5 symbols/min [2025-09-29T02:04:37.199321] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.355247] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.418561] [DEBUG] [LOCAL ] NIM: Loaded 4149 existing records from primary storage. [2025-09-29T02:04:37.399525] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.434506] [INFO ] [MAIN ] NIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:37.465458] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NIM took 0.8s. Estimated remaining: 4m 20s. Rate: 204.5 symbols/min [2025-09-29T02:04:37.629603] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.672058] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-29T02:04:37.690715] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-29T02:04:37.697680] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-29T02:04:37.692143] [DEBUG] [LOCAL ] NINE: Loaded 28624 existing records from primary storage. [2025-09-29T02:04:37.713861] [INFO ] [MAIN ] NINE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:37.708319] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-29T02:04:37.768613] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.768846] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-29T02:04:37.769170] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-29T02:04:37.764231] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NINE took 1.0s. Estimated remaining: 4m 19s. Rate: 204.5 symbols/min [2025-09-29T02:04:38.138569] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-29T02:04:38.196543] [INFO ] [MAIN ] NIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:38.238545] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NIO took 1.4s. Estimated remaining: 4m 19s. Rate: 204.4 symbols/min [2025-09-29T02:04:38.285380] [DEBUG] [LOCAL ] NJR: Loaded 38739 existing records from primary storage. [2025-09-29T02:04:38.279448] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:38.336571] [INFO ] [MAIN ] NJR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:38.360403] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NJR took 0.9s. Estimated remaining: 4m 19s. Rate: 204.5 symbols/min [2025-09-29T02:04:38.347197] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-29T02:04:38.398184] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-29T02:04:38.439904] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-29T02:04:38.459534] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-29T02:04:38.517530] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-29T02:04:38.684238] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-29T02:04:38.739702] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:38.829754] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-29T02:04:38.905605] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:38.971489] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:38.992724] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-29T02:04:39.013494] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-29T02:04:39.041000] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-29T02:04:39.090733] [DEBUG] [LOCAL ] NKX: Loaded 13801 existing records from primary storage. [2025-09-29T02:04:39.090908] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-29T02:04:39.137246] [INFO ] [MAIN ] NKX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:39.116713] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-29T02:04:39.126233] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:39.169419] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-29T02:04:39.190739] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-29T02:04:39.164016] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NKX took 0.9s. Estimated remaining: 4m 19s. Rate: 204.3 symbols/min [2025-09-29T02:04:39.208051] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:39.230851] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-09-29T02:04:39.278347] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:39.329959] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-29T02:04:39.379454] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-29T02:04:39.441977] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-29T02:04:39.476140] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-29T02:04:39.539223] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NIQ took 2.3s. Estimated remaining: 4m 19s. Rate: 204.2 symbols/min [2025-09-29T02:04:39.542731] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:39.665136] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-29T02:04:39.755614] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.032050] [DEBUG] [LOCAL ] NLOP: Loaded 11997 existing records from primary storage. [2025-09-29T02:04:40.020837] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.037720] [INFO ] [MAIN ] NLOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:40.043384] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NLOP took 0.8s. Estimated remaining: 4m 18s. Rate: 204.1 symbols/min [2025-09-29T02:04:40.133019] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:40.163162] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-29T02:04:40.329149] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.350127] [DEBUG] [LOCAL ] NLY: Loaded 54358 existing records from primary storage. [2025-09-29T02:04:40.350602] [INFO ] [MAIN ] NLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:40.350747] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NLY took 0.8s. Estimated remaining: 4m 18s. Rate: 204.1 symbols/min [2025-09-29T02:04:40.434451] [DEBUG] [LOCAL ] NMAI: Loaded 13181 existing records from primary storage. [2025-09-29T02:04:40.475001] [INFO ] [MAIN ] NMAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:40.524703] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NMAI took 0.5s. Estimated remaining: 4m 18s. Rate: 204.2 symbols/min [2025-09-29T02:04:40.555699] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.556384] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-29T02:04:40.568199] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-29T02:04:40.616993] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-29T02:04:40.617295] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T02:04:40.651731] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-29T02:04:40.664341] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-29T02:04:40.681257] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-29T02:04:40.701874] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-29T02:04:40.828294] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.941327] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T02:04:40.964298] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-29T02:04:41.116979] [DEBUG] [LOCAL ] NMCO: Loaded 16803 existing records from primary storage. [2025-09-29T02:04:41.155811] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T02:04:41.178695] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-29T02:04:41.164427] [INFO ] [MAIN ] NMCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:41.180287] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMCO took 0.6s. Estimated remaining: 4m 18s. Rate: 204.0 symbols/min [2025-09-29T02:04:41.390156] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:41.417140] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-29T02:04:41.473327] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:41.484908] [DEBUG] [LOCAL ] NMG: Loaded 7913 existing records from primary storage. [2025-09-29T02:04:41.485191] [INFO ] [MAIN ] NMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:41.485291] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMG took 0.3s. Estimated remaining: 4m 17s. Rate: 204.0 symbols/min [2025-09-29T02:04:41.599576] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:41.600367] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-29T02:04:41.605994] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:41.621777] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-09-29T02:04:41.627112] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:41.681308] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:41.681486] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-29T02:04:41.682571] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-29T02:04:41.682803] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-29T02:04:41.682914] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-29T02:04:41.683039] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMAX took 1.3s. Estimated remaining: 4m 17s. Rate: 204.0 symbols/min [2025-09-29T02:04:41.799997] [DEBUG] [LOCAL ] NMI: Loaded 4091 existing records from primary storage. [2025-09-29T02:04:41.820621] [INFO ] [MAIN ] NMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:41.821101] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMI took 0.3s. Estimated remaining: 4m 17s. Rate: 204.1 symbols/min [2025-09-29T02:04:41.822016] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T02:04:41.952876] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:41.920458] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-29T02:04:42.084815] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T02:04:42.141118] [DEBUG] [LOCAL ] NMM: Loaded 14470 existing records from primary storage. [2025-09-29T02:04:42.157948] [INFO ] [MAIN ] NMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.162495] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:42.163063] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-29T02:04:42.163235] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMM took 0.5s. Estimated remaining: 4m 16s. Rate: 204.1 symbols/min [2025-09-29T02:04:42.379285] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:42.380798] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-29T02:04:42.383154] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-29T02:04:42.397001] [DEBUG] [LOCAL ] NMR: Loaded 35569 existing records from primary storage. [2025-09-29T02:04:42.398664] [INFO ] [MAIN ] NMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.398820] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMR took 0.6s. Estimated remaining: 4m 16s. Rate: 204.1 symbols/min [2025-09-29T02:04:42.414003] [DEBUG] [LOCAL ] NMS: Loaded 2893 existing records from primary storage. [2025-09-29T02:04:42.425243] [INFO ] [MAIN ] NMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.442555] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMS took 0.3s. Estimated remaining: 4m 16s. Rate: 204.2 symbols/min [2025-09-29T02:04:42.705005] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:42.783672] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:42.790786] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T02:04:42.795348] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-29T02:04:42.799940] [DEBUG] [LOCAL ] NMT: Loaded 2884 existing records from primary storage. [2025-09-29T02:04:42.800332] [INFO ] [MAIN ] NMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.800670] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMT took 0.4s. Estimated remaining: 4m 15s. Rate: 204.2 symbols/min [2025-09-29T02:04:42.944559] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T02:04:42.942827] [DEBUG] [LOCAL ] NMZ: Loaded 21872 existing records from primary storage. [2025-09-29T02:04:42.977343] [INFO ] [MAIN ] NMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.977582] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMZ took 0.5s. Estimated remaining: 4m 15s. Rate: 204.3 symbols/min [2025-09-29T02:04:42.991087] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-29T02:04:43.168969] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T02:04:43.190169] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.214080] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-29T02:04:43.277561] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.290359] [DEBUG] [LOCAL ] NNI: Loaded 10159 existing records from primary storage. [2025-09-29T02:04:43.290702] [INFO ] [MAIN ] NNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:43.290809] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NNI took 0.5s. Estimated remaining: 4m 15s. Rate: 204.3 symbols/min [2025-09-29T02:04:43.494432] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.510729] [DEBUG] [LOCAL ] NNN: Loaded 49151 existing records from primary storage. [2025-09-29T02:04:43.511279] [INFO ] [MAIN ] NNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:43.511388] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNN took 0.5s. Estimated remaining: 4m 14s. Rate: 204.3 symbols/min [2025-09-29T02:04:43.604017] [DEBUG] [LOCAL ] NNY: Loaded 5750 existing records from primary storage. [2025-09-29T02:04:43.631926] [INFO ] [MAIN ] NNY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:43.636794] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NNY took 0.3s. Estimated remaining: 4m 14s. Rate: 204.4 symbols/min [2025-09-29T02:04:43.795224] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T02:04:43.846355] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-29T02:04:43.830873] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.958098] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.973700] [DEBUG] [LOCAL ] NOA: Loaded 16497 existing records from primary storage. [2025-09-29T02:04:43.974448] [INFO ] [MAIN ] NOA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:43.975101] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOA took 0.5s. Estimated remaining: 4m 14s. Rate: 204.3 symbols/min [2025-09-29T02:04:44.129137] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T02:04:44.130185] [DEBUG] [LOCAL ] NOAH: Loaded 20358 existing records from primary storage. [2025-09-29T02:04:44.177253] [INFO ] [MAIN ] NOAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:44.189041] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOAH took 0.6s. Estimated remaining: 4m 13s. Rate: 204.4 symbols/min [2025-09-29T02:04:44.188559] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-29T02:04:44.176973] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-29T02:04:44.282493] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:44.294346] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-29T02:04:44.446127] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:44.477341] [DEBUG] [LOCAL ] NOC: Loaded 43141 existing records from primary storage. [2025-09-29T02:04:44.477867] [INFO ] [MAIN ] NOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:44.477992] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOC took 0.5s. Estimated remaining: 4m 13s. Rate: 204.4 symbols/min [2025-09-29T02:04:44.688612] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:44.706011] [DEBUG] [LOCAL ] NOG: Loaded 51932 existing records from primary storage. [2025-09-29T02:04:44.706451] [INFO ] [MAIN ] NOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:44.706557] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOG took 0.5s. Estimated remaining: 4m 13s. Rate: 204.4 symbols/min [2025-09-29T02:04:44.820750] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-29T02:04:44.828021] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-29T02:04:44.908302] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:44.909044] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-29T02:04:44.909206] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-29T02:04:44.909480] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-29T02:04:44.909574] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-29T02:04:44.909723] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-29T02:04:44.909796] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-29T02:04:45.081968] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-29T02:04:45.135935] [INFO ] [MAIN ] NOK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:45.174882] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOK took 0.7s. Estimated remaining: 4m 13s. Rate: 204.3 symbols/min [2025-09-29T02:04:45.281339] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T02:04:45.356268] [INFO ] [REMOTE ] NL: Full fetch complete (6922 records). [2025-09-29T02:04:45.452804] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-29T02:04:45.576261] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:45.605914] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T02:04:45.645802] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:45.687433] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-29T02:04:45.723571] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-29T02:04:45.811920] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:04:45.812882] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:45.812969] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:45.813056] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-29T02:04:45.813157] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-29T02:04:45.813236] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-29T02:04:45.813328] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-29T02:04:45.813429] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NL took 7.4s. Estimated remaining: 4m 12s. Rate: 204.2 symbols/min [2025-09-29T02:04:46.029411] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:46.030819] [DEBUG] [LOCAL ] NOMD: Loaded 42016 existing records from primary storage. [2025-09-29T02:04:46.031708] [INFO ] [MAIN ] NOMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:46.031964] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOMD took 0.8s. Estimated remaining: 4m 12s. Rate: 204.2 symbols/min [2025-09-29T02:04:46.077285] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T02:04:46.101329] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-29T02:04:46.256791] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:46.271428] [DEBUG] [LOCAL ] NOTE: Loaded 43143 existing records from primary storage. [2025-09-29T02:04:46.271834] [INFO ] [MAIN ] NOTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:46.271940] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOTE took 0.5s. Estimated remaining: 4m 12s. Rate: 204.2 symbols/min [2025-09-29T02:04:46.359606] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T02:04:46.387836] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-29T02:04:46.471804] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:46.517555] [DEBUG] [LOCAL ] NOV: Loaded 53961 existing records from primary storage. [2025-09-29T02:04:46.518097] [INFO ] [MAIN ] NOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:46.518341] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NOV took 0.5s. Estimated remaining: 4m 11s. Rate: 204.3 symbols/min [2025-09-29T02:04:46.670971] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-29T02:04:46.679043] [DEBUG] [LOCAL ] NOW: Loaded 49444 existing records from primary storage. [2025-09-29T02:04:46.680853] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-29T02:04:46.708938] [INFO ] [MAIN ] NOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:46.766464] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:46.766741] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-29T02:04:46.761324] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOW took 0.5s. Estimated remaining: 4m 11s. Rate: 204.3 symbols/min [2025-09-29T02:04:46.778249] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-29T02:04:46.802746] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-29T02:04:46.808237] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-29T02:04:46.816695] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-29T02:04:46.841277] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-29T02:04:46.956332] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T02:04:47.007446] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-29T02:04:47.030131] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T02:04:47.140251] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:47.147081] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-29T02:04:47.355963] [DEBUG] [LOCAL ] NPCT: Loaded 17114 existing records from primary storage. [2025-09-29T02:04:47.362178] [INFO ] [MAIN ] NPCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:47.386387] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NPCT took 0.6s. Estimated remaining: 4m 11s. Rate: 204.1 symbols/min [2025-09-29T02:04:47.386147] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T02:04:47.447246] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:47.448936] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-29T02:04:47.449333] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-29T02:04:47.648248] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T02:04:47.648466] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:47.649837] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-29T02:04:47.650202] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-29T02:04:47.651152] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:47.651266] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-09-29T02:04:47.651339] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:47.651418] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-29T02:04:47.651525] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-29T02:04:47.651602] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-29T02:04:47.651727] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-29T02:04:47.651906] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NPB took 1.1s. Estimated remaining: 4m 11s. Rate: 204.1 symbols/min [2025-09-29T02:04:47.852185] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T02:04:47.853187] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-29T02:04:48.123113] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T02:04:48.124394] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-29T02:04:48.230035] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T02:04:48.242119] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-29T02:04:48.397734] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-29T02:04:48.398918] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-29T02:04:48.595505] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:04:48.596671] [INFO ] [REMOTE ] NOM: Full fetch complete (1626 records). [2025-09-29T02:04:48.596771] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-29T02:04:48.798711] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-29T02:04:48.798962] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:48.799036] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:48.799117] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-29T02:04:48.799215] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-29T02:04:48.799290] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-29T02:04:48.799372] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-29T02:04:48.799471] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NOM took 4.1s. Estimated remaining: 4m 11s. Rate: 203.7 symbols/min [2025-09-29T02:04:49.163890] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T02:04:49.176466] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-29T02:04:49.951346] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T02:04:49.963146] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-29T02:04:50.313756] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T02:04:50.324560] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-29T02:04:50.324795] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-29T02:04:50.555326] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:50.556165] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:50.556246] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:50.556328] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-29T02:04:50.556434] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-29T02:04:50.556531] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-29T02:04:50.556621] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-29T02:04:50.557364] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NKE took 12.8s. Estimated remaining: 4m 11s. Rate: 203.1 symbols/min [2025-09-29T02:04:51.196428] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:51.225417] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:51.346799] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:51.375137] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:51.382821] [DEBUG] [LOCAL ] NPFD: Loaded 9814 existing records from primary storage. [2025-09-29T02:04:51.382994] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-29T02:04:51.383243] [INFO ] [MAIN ] NPFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:51.383528] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPFD took 0.8s. Estimated remaining: 4m 11s. Rate: 202.8 symbols/min [2025-09-29T02:04:51.394321] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-29T02:04:51.433836] [DEBUG] [LOCAL ] NPK: Loaded 8120 existing records from primary storage. [2025-09-29T02:04:51.439129] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-29T02:04:51.502343] [INFO ] [MAIN ] NPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:51.508712] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-29T02:04:51.514102] [DEBUG] [LOCAL ] NPO: Loaded 13019 existing records from primary storage. [2025-09-29T02:04:51.514506] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPK took 1.0s. Estimated remaining: 4m 11s. Rate: 202.9 symbols/min [2025-09-29T02:04:51.532610] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-29T02:04:51.532469] [INFO ] [MAIN ] NPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:51.580706] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-29T02:04:51.602399] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPO took 1.0s. Estimated remaining: 4m 11s. Rate: 203.0 symbols/min [2025-09-29T02:04:51.710471] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:52.128753] [DEBUG] [LOCAL ] NPV: Loaded 5070 existing records from primary storage. [2025-09-29T02:04:52.180742] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:52.186589] [INFO ] [MAIN ] NPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:52.185287] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:52.202701] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPV took 0.8s. Estimated remaining: 4m 10s. Rate: 202.9 symbols/min [2025-09-29T02:04:52.458045] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-09-29T02:04:52.504666] [INFO ] [MAIN ] NQP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:52.592003] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NQP took 1.0s. Estimated remaining: 4m 10s. Rate: 202.8 symbols/min [2025-09-29T02:04:52.637197] [DEBUG] [LOCAL ] NPWR: Loaded 43857 existing records from primary storage. [2025-09-29T02:04:52.685204] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:52.695458] [INFO ] [MAIN ] NPWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:52.711455] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NPWR took 1.2s. Estimated remaining: 4m 10s. Rate: 202.9 symbols/min [2025-09-29T02:04:52.721073] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:52.730304] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-29T02:04:53.099267] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.117110] [DEBUG] [LOCAL ] NRDY: Loaded 33402 existing records from primary storage. [2025-09-29T02:04:53.137591] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.138497] [INFO ] [MAIN ] NRDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.139204] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NRDY took 0.9s. Estimated remaining: 4m 10s. Rate: 202.9 symbols/min [2025-09-29T02:04:53.238374] [DEBUG] [LOCAL ] NREF: Loaded 7957 existing records from primary storage. [2025-09-29T02:04:53.249597] [INFO ] [MAIN ] NREF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.260352] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NREF took 0.6s. Estimated remaining: 4m 9s. Rate: 202.9 symbols/min [2025-09-29T02:04:53.446176] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.485975] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T02:04:53.548940] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-29T02:04:53.579542] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.601489] [DEBUG] [LOCAL ] NRG: Loaded 53697 existing records from primary storage. [2025-09-29T02:04:53.602472] [INFO ] [MAIN ] NRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.602633] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRG took 0.8s. Estimated remaining: 4m 9s. Rate: 202.9 symbols/min [2025-09-29T02:04:53.783849] [DEBUG] [LOCAL ] NRGV: Loaded 43716 existing records from primary storage. [2025-09-29T02:04:53.807412] [DEBUG] [LOCAL ] NRK: Loaded 19991 existing records from primary storage. [2025-09-29T02:04:53.821419] [INFO ] [MAIN ] NRGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.845152] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.845532] [INFO ] [MAIN ] NRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.845820] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRGV took 0.7s. Estimated remaining: 4m 9s. Rate: 202.9 symbols/min [2025-09-29T02:04:53.860628] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRK took 0.6s. Estimated remaining: 4m 8s. Rate: 203.1 symbols/min [2025-09-29T02:04:53.926411] [DEBUG] [LOCAL ] NRP: Loaded 4114 existing records from primary storage. [2025-09-29T02:04:53.957505] [INFO ] [MAIN ] NRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.973233] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRP took 0.4s. Estimated remaining: 4m 8s. Rate: 203.1 symbols/min [2025-09-29T02:04:54.372033] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.431106] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.468958] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.472701] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T02:04:54.477785] [DEBUG] [LOCAL ] NRT: Loaded 4994 existing records from primary storage. [2025-09-29T02:04:54.486535] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-29T02:04:54.487142] [INFO ] [MAIN ] NRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:54.488513] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRT took 0.6s. Estimated remaining: 4m 8s. Rate: 203.0 symbols/min [2025-09-29T02:04:54.496745] [DEBUG] [LOCAL ] NRUC: Loaded 3136 existing records from primary storage. [2025-09-29T02:04:54.505394] [INFO ] [MAIN ] NRUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:54.517360] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRUC took 0.6s. Estimated remaining: 4m 7s. Rate: 203.2 symbols/min [2025-09-29T02:04:54.866403] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.888347] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.905802] [DEBUG] [LOCAL ] NSA: Loaded 45528 existing records from primary storage. [2025-09-29T02:04:54.906485] [INFO ] [MAIN ] NSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:54.906612] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSA took 0.9s. Estimated remaining: 4m 7s. Rate: 203.1 symbols/min [2025-09-29T02:04:55.112697] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:55.127126] [DEBUG] [LOCAL ] NSP: Loaded 35480 existing records from primary storage. [2025-09-29T02:04:55.127949] [INFO ] [MAIN ] NSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:55.128075] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSP took 0.6s. Estimated remaining: 4m 7s. Rate: 203.2 symbols/min [2025-09-29T02:04:55.294765] [DEBUG] [LOCAL ] NSC: Loaded 49879 existing records from primary storage. [2025-09-29T02:04:55.296223] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T02:04:55.296894] [INFO ] [MAIN ] NSC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:55.325853] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-29T02:04:55.326307] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSC took 0.8s. Estimated remaining: 4m 6s. Rate: 203.2 symbols/min [2025-09-29T02:04:55.406211] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:55.411991] [DEBUG] [LOCAL ] NTB: Loaded 20927 existing records from primary storage. [2025-09-29T02:04:55.412202] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-29T02:04:55.438897] [INFO ] [MAIN ] NTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:55.451372] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTB took 0.5s. Estimated remaining: 4m 6s. Rate: 203.3 symbols/min [2025-09-29T02:04:55.433014] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-29T02:04:55.504861] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-29T02:04:55.554822] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-29T02:04:55.582558] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-29T02:04:55.587911] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-29T02:04:55.752584] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:55.907308] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:56.217823] [DEBUG] [LOCAL ] NTR: Loaded 53356 existing records from primary storage. [2025-09-29T02:04:56.230791] [INFO ] [MAIN ] NTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:56.231261] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTR took 0.9s. Estimated remaining: 4m 6s. Rate: 203.1 symbols/min [2025-09-29T02:04:56.277774] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T02:04:56.326137] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:56.337339] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-29T02:04:56.348481] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-29T02:04:56.434363] [DEBUG] [LOCAL ] NTST: Loaded 44211 existing records from primary storage. [2025-09-29T02:04:56.456209] [INFO ] [MAIN ] NTST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:56.490507] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTST took 1.0s. Estimated remaining: 4m 6s. Rate: 203.1 symbols/min [2025-09-29T02:04:56.515068] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:56.588383] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-29T02:04:56.603548] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-29T02:04:56.715927] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:56.716325] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-29T02:04:56.716402] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-29T02:04:56.716505] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-29T02:04:56.716583] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-29T02:04:56.716701] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-29T02:04:56.716775] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-29T02:04:56.906290] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-29T02:04:56.945786] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-29T02:04:56.979011] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-29T02:04:57.024242] [INFO ] [MAIN ] NU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:57.033162] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NU took 0.8s. Estimated remaining: 4m 5s. Rate: 203.0 symbols/min [2025-09-29T02:04:57.244481] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T02:04:57.314086] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:57.296548] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-29T02:04:57.353322] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-29T02:04:57.393152] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:57.397043] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T02:04:57.409029] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-29T02:04:57.446312] [DEBUG] [LOCAL ] NUS: Loaded 37005 existing records from primary storage. [2025-09-29T02:04:57.446765] [INFO ] [MAIN ] NUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:57.447192] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NUS took 0.4s. Estimated remaining: 4m 5s. Rate: 202.9 symbols/min [2025-09-29T02:04:57.557554] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-29T02:04:57.565007] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-29T02:04:57.638724] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:57.664462] [DEBUG] [LOCAL ] NUV: Loaded 23576 existing records from primary storage. [2025-09-29T02:04:57.664803] [INFO ] [MAIN ] NUV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:57.664907] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NUV took 0.2s. Estimated remaining: 4m 5s. Rate: 202.9 symbols/min [2025-09-29T02:04:57.777222] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:04:57.799695] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-29T02:04:57.862982] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:57.923200] [DEBUG] [LOCAL ] NUVB: Loaded 51998 existing records from primary storage. [2025-09-29T02:04:57.923608] [INFO ] [MAIN ] NUVB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:57.923743] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUVB took 0.3s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-29T02:04:58.122685] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:58.152523] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T02:04:58.167026] [DEBUG] [LOCAL ] NUW: Loaded 7512 existing records from primary storage. [2025-09-29T02:04:58.167454] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-29T02:04:58.167905] [INFO ] [MAIN ] NUW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:58.169187] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUW took 0.2s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-29T02:04:58.289394] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-29T02:04:58.342367] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-29T02:04:58.380284] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:58.418759] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T02:04:58.430063] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-29T02:04:58.461314] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-09-29T02:04:58.461682] [INFO ] [MAIN ] NVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:58.461790] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NVG took 0.3s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-29T02:04:58.648368] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:58.687274] [DEBUG] [LOCAL ] NVGS: Loaded 31403 existing records from primary storage. [2025-09-29T02:04:58.687599] [INFO ] [MAIN ] NVGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:58.687746] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NVGS took 0.2s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-29T02:04:58.892667] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T02:04:58.892492] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:58.894609] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-29T02:04:58.921914] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T02:04:58.931458] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-29T02:04:58.990709] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-29T02:04:58.991257] [INFO ] [MAIN ] NVO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:58.991421] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVO took 0.3s. Estimated remaining: 4m 3s. Rate: 203.0 symbols/min [2025-09-29T02:04:59.187690] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:59.218300] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-29T02:04:59.223046] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-29T02:04:59.226706] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T02:04:59.245160] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-29T02:04:59.255989] [DEBUG] [LOCAL ] NVR: Loaded 19323 existing records from primary storage. [2025-09-29T02:04:59.256346] [INFO ] [MAIN ] NVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:59.256900] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVR took 0.3s. Estimated remaining: 4m 3s. Rate: 203.0 symbols/min [2025-09-29T02:04:59.463423] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-29T02:04:59.463040] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:59.465220] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-29T02:04:59.508853] [DEBUG] [LOCAL ] NVRI: Loaded 39367 existing records from primary storage. [2025-09-29T02:04:59.509227] [INFO ] [MAIN ] NVRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:59.509336] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVRI took 0.3s. Estimated remaining: 4m 3s. Rate: 203.0 symbols/min [2025-09-29T02:04:59.705983] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:59.732216] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-29T02:04:59.748846] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-29T02:04:59.805940] [DEBUG] [LOCAL ] NVS: Loaded 52338 existing records from primary storage. [2025-09-29T02:04:59.806446] [INFO ] [MAIN ] NVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:59.806567] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVS took 0.3s. Estimated remaining: 4m 2s. Rate: 203.0 symbols/min [2025-09-29T02:04:59.992416] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:00.001776] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-29T02:05:00.003100] [INFO ] [REMOTE ] NTEST: Full fetch complete (1986 records). [2025-09-29T02:05:00.003542] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-29T02:05:00.333124] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-29T02:05:00.334184] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T02:05:00.337008] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:00.336673] [DEBUG] [LOCAL ] NVST: Loaded 52381 existing records from primary storage. [2025-09-29T02:05:00.348693] [INFO ] [MAIN ] NVST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:00.349378] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVST took 0.5s. Estimated remaining: 4m 2s. Rate: 202.9 symbols/min [2025-09-29T02:05:00.347875] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:00.349876] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-29T02:05:00.350043] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-29T02:05:00.405921] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-29T02:05:00.447686] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-29T02:05:00.458771] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T02:05:00.472548] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-29T02:05:00.485240] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NTEST took 5.4s. Estimated remaining: 4m 2s. Rate: 203.0 symbols/min [2025-09-29T02:05:00.534334] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-29T02:05:00.696926] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:00.795845] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:00.838165] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-29T02:05:00.869314] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-29T02:05:00.895079] [DEBUG] [LOCAL ] NVT: Loaded 52330 existing records from primary storage. [2025-09-29T02:05:00.895667] [INFO ] [MAIN ] NVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:00.896205] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVT took 0.5s. Estimated remaining: 4m 2s. Rate: 203.0 symbols/min [2025-09-29T02:05:01.068989] [DEBUG] [LOCAL ] NWG: Loaded 52318 existing records from primary storage. [2025-09-29T02:05:01.102857] [INFO ] [MAIN ] NWG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:01.103069] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NWG took 0.6s. Estimated remaining: 4m 1s. Rate: 203.0 symbols/min [2025-09-29T02:05:01.123154] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:01.196150] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T02:05:01.270778] [INFO ] [REMOTE ] NPKI: Full fetch complete (53554 records). [2025-09-29T02:05:01.271464] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-29T02:05:01.421758] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:01.439006] [DEBUG] [LOCAL ] NWN: Loaded 27222 existing records from primary storage. [2025-09-29T02:05:01.459049] [INFO ] [MAIN ] NWN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:01.483669] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NWN took 0.6s. Estimated remaining: 4m 1s. Rate: 203.0 symbols/min [2025-09-29T02:05:01.751884] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:05:01.774892] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:01.807879] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:01.807714] [DEBUG] [LOCAL ] NX: Loaded 33894 existing records from primary storage. [2025-09-29T02:05:01.813286] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-29T02:05:01.839932] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-29T02:05:01.845287] [INFO ] [MAIN ] NX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:01.891221] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-29T02:05:01.891775] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NX took 0.8s. Estimated remaining: 4m 1s. Rate: 202.9 symbols/min [2025-09-29T02:05:01.897400] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-29T02:05:01.897046] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:01.898472] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NPKI took 11.3s. Estimated remaining: 4m 0s. Rate: 203.0 symbols/min [2025-09-29T02:05:01.937551] [DEBUG] [LOCAL ] NXC: Loaded 4313 existing records from primary storage. [2025-09-29T02:05:01.940474] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T02:05:01.940756] [INFO ] [MAIN ] NXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:01.946792] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NXC took 0.4s. Estimated remaining: 3m 60s. Rate: 203.1 symbols/min [2025-09-29T02:05:01.956960] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-29T02:05:02.810771] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T02:05:02.822074] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-29T02:05:03.720761] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T02:05:03.732319] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-29T02:05:04.317305] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T02:05:04.329867] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-29T02:05:05.134497] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T02:05:05.146796] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-29T02:05:05.941036] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-29T02:05:05.951074] [INFO ] [REMOTE ] NUE: Full fetch complete (74902 records). [2025-09-29T02:05:05.951298] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-29T02:05:06.176714] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:06.177491] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:06.177569] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:06.177680] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-29T02:05:06.177804] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-29T02:05:06.177886] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-29T02:05:06.177982] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-29T02:05:06.178195] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NUE took 9.7s. Estimated remaining: 4m 2s. Rate: 201.4 symbols/min [2025-09-29T02:05:06.872204] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:06.887355] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:06.957019] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:06.958419] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:06.960113] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-29T02:05:06.960205] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-29T02:05:06.960310] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-29T02:05:06.960381] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-29T02:05:06.960466] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-29T02:05:06.960540] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-29T02:05:07.083465] [DEBUG] [LOCAL ] NXG: Loaded 10647 existing records from primary storage. [2025-09-29T02:05:07.091856] [DEBUG] [LOCAL ] NXDT: Loaded 16531 existing records from primary storage. [2025-09-29T02:05:07.096483] [INFO ] [MAIN ] NXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:07.097358] [INFO ] [MAIN ] NXDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:07.102874] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 0.9s. Estimated remaining: 4m 2s. Rate: 201.2 symbols/min [2025-09-29T02:05:07.136304] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXDT took 0.9s. Estimated remaining: 4m 1s. Rate: 201.3 symbols/min [2025-09-29T02:05:07.564130] [DEBUG] [LOCAL ] NXE: Loaded 53762 existing records from primary storage. [2025-09-29T02:05:07.616342] [INFO ] [MAIN ] NXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:07.724714] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXE took 1.5s. Estimated remaining: 4m 1s. Rate: 201.1 symbols/min [2025-09-29T02:05:07.848075] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:07.820473] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:08.040268] [DEBUG] [LOCAL ] NXN: Loaded 2376 existing records from primary storage. [2025-09-29T02:05:08.044037] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:08.066469] [INFO ] [MAIN ] NXN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:08.071687] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-29T02:05:08.072087] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXN took 0.9s. Estimated remaining: 4m 1s. Rate: 201.1 symbols/min [2025-09-29T02:05:08.167386] [DEBUG] [LOCAL ] NXJ: Loaded 15066 existing records from primary storage. [2025-09-29T02:05:08.274473] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:08.275492] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:05:08.268730] [INFO ] [MAIN ] NXJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:08.277403] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-29T02:05:08.277297] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 0s. Rate: 201.2 symbols/min [2025-09-29T02:05:08.284156] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:05:08.371008] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-09-29T02:05:08.396434] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:05:08.415895] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-29T02:05:08.447226] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:08.447455] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-29T02:05:08.464196] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-09-29T02:05:08.469771] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-29T02:05:08.481634] [INFO ] [MAIN ] NXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:08.502016] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXP took 0.7s. Estimated remaining: 4m 0s. Rate: 201.2 symbols/min [2025-09-29T02:05:08.502326] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-29T02:05:08.583153] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXDR took 2.4s. Estimated remaining: 3m 60s. Rate: 201.3 symbols/min [2025-09-29T02:05:08.687209] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:08.736629] [DEBUG] [LOCAL ] NXRT: Loaded 19307 existing records from primary storage. [2025-09-29T02:05:08.747095] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-29T02:05:08.780334] [INFO ] [MAIN ] NXRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:08.770584] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-29T02:05:08.785872] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-29T02:05:08.785991] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NXRT took 0.7s. Estimated remaining: 3m 59s. Rate: 201.3 symbols/min [2025-09-29T02:05:08.786177] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-29T02:05:08.890437] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-29T02:05:08.930165] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-29T02:05:09.035698] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:09.243837] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:09.370091] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:09.370531] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-29T02:05:09.370607] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-29T02:05:09.370792] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-29T02:05:09.370872] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-29T02:05:09.370980] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-29T02:05:09.371057] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-29T02:05:09.693056] [DEBUG] [LOCAL ] NYT: Loaded 50645 existing records from primary storage. [2025-09-29T02:05:09.744347] [INFO ] [MAIN ] NYT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:09.810087] [DEBUG] [LOCAL ] NZF: Loaded 29361 existing records from primary storage. [2025-09-29T02:05:09.841474] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NYT took 1.3s. Estimated remaining: 3m 59s. Rate: 201.0 symbols/min [2025-09-29T02:05:09.842909] [INFO ] [MAIN ] NZF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:09.874201] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:09.905628] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NZF took 1.3s. Estimated remaining: 3m 59s. Rate: 201.1 symbols/min [2025-09-29T02:05:09.991323] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-29T02:05:10.408685] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:10.480093] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T02:05:10.479782] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:10.481294] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-29T02:05:10.473481] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:10.482404] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-29T02:05:10.504032] [DEBUG] [LOCAL ] OBK: Loaded 16512 existing records from primary storage. [2025-09-29T02:05:10.504410] [INFO ] [MAIN ] OBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:10.504664] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. OBK took 0.5s. Estimated remaining: 3m 59s. Rate: 201.0 symbols/min [2025-09-29T02:05:10.733268] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:10.735401] [DEBUG] [LOCAL ] OBDC: Loaded 52426 existing records from primary storage. [2025-09-29T02:05:10.736194] [INFO ] [MAIN ] OBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:10.736954] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. OBDC took 0.9s. Estimated remaining: 3m 59s. Rate: 201.0 symbols/min [2025-09-29T02:05:10.818331] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T02:05:10.836220] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-29T02:05:10.949625] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:10.976096] [DEBUG] [LOCAL ] OCFT: Loaded 8916 existing records from primary storage. [2025-09-29T02:05:10.988145] [INFO ] [MAIN ] OCFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:10.988453] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OCFT took 0.3s. Estimated remaining: 3m 58s. Rate: 201.0 symbols/min [2025-09-29T02:05:11.066566] [DEBUG] [LOCAL ] OC: Loaded 45369 existing records from primary storage. [2025-09-29T02:05:11.079204] [INFO ] [MAIN ] OC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:11.079505] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OC took 0.6s. Estimated remaining: 3m 58s. Rate: 201.1 symbols/min [2025-09-29T02:05:11.304355] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:11.318474] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T02:05:11.336252] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-29T02:05:11.386123] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:11.395666] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-29T02:05:11.396178] [INFO ] [MAIN ] ODC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:11.396356] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. ODC took 0.4s. Estimated remaining: 3m 57s. Rate: 201.1 symbols/min [2025-09-29T02:05:11.563696] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-29T02:05:11.559813] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T02:05:11.571493] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-29T02:05:11.631689] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-29T02:05:11.670139] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:11.680994] [DEBUG] [LOCAL ] ODV: Loaded 26258 existing records from primary storage. [2025-09-29T02:05:11.681571] [INFO ] [MAIN ] ODV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:11.681716] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. ODV took 0.6s. Estimated remaining: 3m 57s. Rate: 201.1 symbols/min [2025-09-29T02:05:11.933901] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:11.939456] [DEBUG] [LOCAL ] OEC: Loaded 37689 existing records from primary storage. [2025-09-29T02:05:11.939886] [INFO ] [MAIN ] OEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:11.940099] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OEC took 0.5s. Estimated remaining: 3m 57s. Rate: 201.1 symbols/min [2025-09-29T02:05:12.017638] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T02:05:12.047670] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-29T02:05:12.159753] [DEBUG] [LOCAL ] OFG: Loaded 22393 existing records from primary storage. [2025-09-29T02:05:12.158605] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:12.160748] [INFO ] [MAIN ] OFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:12.160932] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. OFG took 0.5s. Estimated remaining: 3m 57s. Rate: 201.2 symbols/min [2025-09-29T02:05:12.326297] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T02:05:12.380441] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:12.411218] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-29T02:05:12.439032] [DEBUG] [LOCAL ] OGE: Loaded 47046 existing records from primary storage. [2025-09-29T02:05:12.440364] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T02:05:12.441274] [INFO ] [MAIN ] OGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:12.452470] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OGE took 0.5s. Estimated remaining: 3m 56s. Rate: 201.2 symbols/min [2025-09-29T02:05:12.586369] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.18 seconds). [2025-09-29T02:05:12.726698] [DEBUG] [LOCAL ] OGN: Loaded 53882 existing records from primary storage. [2025-09-29T02:05:12.728003] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:12.728534] [INFO ] [MAIN ] OGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:12.728753] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGN took 0.6s. Estimated remaining: 3m 56s. Rate: 201.2 symbols/min [2025-09-29T02:05:12.936148] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:12.951273] [DEBUG] [LOCAL ] OGS: Loaded 34591 existing records from primary storage. [2025-09-29T02:05:12.951882] [INFO ] [MAIN ] OGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:12.951990] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGS took 0.5s. Estimated remaining: 3m 56s. Rate: 201.2 symbols/min [2025-09-29T02:05:13.166108] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:13.187595] [DEBUG] [LOCAL ] OHI: Loaded 52824 existing records from primary storage. [2025-09-29T02:05:13.188038] [INFO ] [MAIN ] OHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:13.188181] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OHI took 0.5s. Estimated remaining: 3m 55s. Rate: 201.2 symbols/min [2025-09-29T02:05:13.205254] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-29T02:05:13.421830] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:13.422199] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-29T02:05:13.430016] [DEBUG] [LOCAL ] OI: Loaded 48011 existing records from primary storage. [2025-09-29T02:05:13.430705] [INFO ] [MAIN ] OI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:13.430829] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OI took 0.5s. Estimated remaining: 3m 55s. Rate: 201.3 symbols/min [2025-09-29T02:05:13.582724] [DEBUG] [LOCAL ] OIA: Loaded 14218 existing records from primary storage. [2025-09-29T02:05:13.603709] [INFO ] [MAIN ] OIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:13.627465] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OIA took 0.4s. Estimated remaining: 3m 55s. Rate: 201.3 symbols/min [2025-09-29T02:05:13.682415] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:13.849291] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:13.884462] [DEBUG] [LOCAL ] OII: Loaded 43406 existing records from primary storage. [2025-09-29T02:05:13.884868] [INFO ] [MAIN ] OII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:13.885304] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OII took 0.5s. Estimated remaining: 3m 54s. Rate: 201.3 symbols/min [2025-09-29T02:05:14.001754] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-29T02:05:14.111956] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:14.114410] [DEBUG] [LOCAL ] OIS: Loaded 41135 existing records from primary storage. [2025-09-29T02:05:14.115089] [INFO ] [MAIN ] OIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.115209] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OIS took 0.5s. Estimated remaining: 3m 54s. Rate: 201.3 symbols/min [2025-09-29T02:05:14.313635] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:14.362089] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-29T02:05:14.362755] [INFO ] [MAIN ] OKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.362895] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OKE took 0.5s. Estimated remaining: 3m 54s. Rate: 201.4 symbols/min [2025-09-29T02:05:14.572330] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:14.597490] [DEBUG] [LOCAL ] OKLO: Loaded 54599 existing records from primary storage. [2025-09-29T02:05:14.598026] [INFO ] [MAIN ] OKLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.598134] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OKLO took 0.5s. Estimated remaining: 3m 53s. Rate: 201.4 symbols/min [2025-09-29T02:05:14.805071] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-29T02:05:14.810634] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:14.841004] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T02:05:14.877427] [DEBUG] [LOCAL ] OLN: Loaded 52512 existing records from primary storage. [2025-09-29T02:05:14.883065] [DEBUG] [LOCAL ] OLP: Loaded 9963 existing records from primary storage. [2025-09-29T02:05:14.883396] [INFO ] [MAIN ] OLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.883487] [INFO ] [MAIN ] OLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.884064] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OLN took 0.5s. Estimated remaining: 3m 53s. Rate: 201.4 symbols/min [2025-09-29T02:05:14.890490] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLP took 0.3s. Estimated remaining: 3m 53s. Rate: 201.5 symbols/min [2025-09-29T02:05:15.063460] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-29T02:05:15.273585] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:15.295323] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:15.384512] [DEBUG] [LOCAL ] OMF: Loaded 46898 existing records from primary storage. [2025-09-29T02:05:15.386385] [DEBUG] [LOCAL ] OMC: Loaded 54068 existing records from primary storage. [2025-09-29T02:05:15.386875] [INFO ] [MAIN ] OMF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:15.386999] [INFO ] [MAIN ] OMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:15.387151] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OMF took 0.4s. Estimated remaining: 3m 52s. Rate: 201.4 symbols/min [2025-09-29T02:05:15.413198] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OMC took 0.5s. Estimated remaining: 3m 52s. Rate: 201.5 symbols/min [2025-09-29T02:05:15.603996] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-29T02:05:15.789483] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:15.793367] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:15.805166] [DEBUG] [LOCAL ] ONIT: Loaded 7871 existing records from primary storage. [2025-09-29T02:05:15.805450] [INFO ] [MAIN ] ONIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:15.805868] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. ONIT took 0.4s. Estimated remaining: 3m 52s. Rate: 201.5 symbols/min [2025-09-29T02:05:16.016396] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:16.035783] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T02:05:16.038323] [DEBUG] [LOCAL ] OMI: Loaded 46583 existing records from primary storage. [2025-09-29T02:05:16.039968] [INFO ] [REMOTE ] NYC: Full fetch complete (1919 records). [2025-09-29T02:05:16.040612] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-29T02:05:16.040459] [INFO ] [MAIN ] OMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:16.064244] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMI took 0.7s. Estimated remaining: 3m 51s. Rate: 201.5 symbols/min [2025-09-29T02:05:16.338286] [DEBUG] [LOCAL ] ONL: Loaded 31806 existing records from primary storage. [2025-09-29T02:05:16.416408] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-29T02:05:16.392875] [INFO ] [MAIN ] ONL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:16.462937] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:16.477905] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONL took 0.7s. Estimated remaining: 3m 51s. Rate: 201.5 symbols/min [2025-09-29T02:05:16.485660] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-29T02:05:16.510120] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:16.547961] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:16.592543] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-29T02:05:16.606415] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-29T02:05:16.622666] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-29T02:05:16.633259] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-29T02:05:16.663064] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. NYC took 8.4s. Estimated remaining: 3m 51s. Rate: 201.5 symbols/min [2025-09-29T02:05:16.687537] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:16.854519] [DEBUG] [LOCAL ] ONON: Loaded 54392 existing records from primary storage. [2025-09-29T02:05:16.865859] [INFO ] [MAIN ] ONON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:16.881590] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONON took 0.8s. Estimated remaining: 3m 50s. Rate: 201.6 symbols/min [2025-09-29T02:05:16.950451] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:16.959487] [DEBUG] [LOCAL ] ONTF: Loaded 23187 existing records from primary storage. [2025-09-29T02:05:16.959954] [INFO ] [MAIN ] ONTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:16.960063] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTF took 0.5s. Estimated remaining: 3m 50s. Rate: 201.7 symbols/min [2025-09-29T02:05:17.012808] [DEBUG] [LOCAL ] ONTO: Loaded 47339 existing records from primary storage. [2025-09-29T02:05:17.013184] [INFO ] [MAIN ] ONTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:17.013289] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONTO took 0.3s. Estimated remaining: 3m 50s. Rate: 201.8 symbols/min [2025-09-29T02:05:17.304077] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-29T02:05:17.315615] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-29T02:05:18.197456] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T02:05:18.217138] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-29T02:05:18.812366] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T02:05:18.825445] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-29T02:05:19.559350] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T02:05:19.600142] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-29T02:05:20.260753] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-29T02:05:20.400074] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-29T02:05:21.227534] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T02:05:21.239861] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-29T02:05:22.030531] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-29T02:05:22.041178] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-09-29T02:05:22.041377] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-29T02:05:22.266480] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:22.267288] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:22.267367] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:22.267453] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-29T02:05:22.267592] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-29T02:05:22.267692] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-29T02:05:22.267793] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-29T02:05:22.268204] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. O took 13.5s. Estimated remaining: 3m 52s. Rate: 199.7 symbols/min [2025-09-29T02:05:22.952354] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.097743] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.096422] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.118849] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.152934] [DEBUG] [LOCAL ] OPP: Loaded 11678 existing records from primary storage. [2025-09-29T02:05:23.153350] [INFO ] [MAIN ] OPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:23.153515] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPP took 0.9s. Estimated remaining: 3m 52s. Rate: 199.4 symbols/min [2025-09-29T02:05:23.248931] [DEBUG] [LOCAL ] OPAD: Loaded 20793 existing records from primary storage. [2025-09-29T02:05:23.270161] [INFO ] [MAIN ] OPAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:23.276793] [DEBUG] [LOCAL ] OOMA: Loaded 19260 existing records from primary storage. [2025-09-29T02:05:23.305897] [INFO ] [MAIN ] OOMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:23.305721] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPAD took 1.0s. Estimated remaining: 3m 51s. Rate: 199.5 symbols/min [2025-09-29T02:05:23.312205] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OOMA took 1.0s. Estimated remaining: 3m 51s. Rate: 199.6 symbols/min [2025-09-29T02:05:23.529955] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.618454] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-29T02:05:23.595150] [DEBUG] [LOCAL ] OPFI: Loaded 47258 existing records from primary storage. [2025-09-29T02:05:23.649758] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-29T02:05:23.671450] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-29T02:05:23.670739] [INFO ] [MAIN ] OPFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:23.676941] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-29T02:05:23.720321] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 1.4s. Estimated remaining: 3m 51s. Rate: 199.6 symbols/min [2025-09-29T02:05:23.738999] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-29T02:05:23.771291] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-29T02:05:23.851712] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.882273] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:24.165158] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:24.366804] [DEBUG] [LOCAL ] ORA: Loaded 33001 existing records from primary storage. [2025-09-29T02:05:24.405626] [INFO ] [MAIN ] ORA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:24.407933] [DEBUG] [LOCAL ] OR: Loaded 46786 existing records from primary storage. [2025-09-29T02:05:24.419088] [INFO ] [MAIN ] OR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:24.418856] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. ORA took 1.1s. Estimated remaining: 3m 50s. Rate: 199.4 symbols/min [2025-09-29T02:05:24.500846] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. OR took 1.2s. Estimated remaining: 3m 50s. Rate: 199.5 symbols/min [2025-09-29T02:05:24.556994] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:24.585928] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-29T02:05:24.761332] [DEBUG] [LOCAL ] ORC: Loaded 53083 existing records from primary storage. [2025-09-29T02:05:24.803067] [INFO ] [MAIN ] ORC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:24.809051] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 1.1s. Estimated remaining: 3m 50s. Rate: 199.5 symbols/min [2025-09-29T02:05:24.950314] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:25.021476] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-29T02:05:25.049330] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:25.056873] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-29T02:05:25.056698] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-29T02:05:25.062089] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-29T02:05:25.064792] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-29T02:05:25.076273] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-29T02:05:25.076509] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-29T02:05:25.076546] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-29T02:05:25.089529] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-29T02:05:25.089810] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-29T02:05:25.090228] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-29T02:05:25.122679] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-29T02:05:25.275371] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:25.345205] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T02:05:25.392870] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-29T02:05:25.651009] [DEBUG] [LOCAL ] ORN: Loaded 31979 existing records from primary storage. [2025-09-29T02:05:25.713381] [INFO ] [MAIN ] ORN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:25.783873] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORN took 1.0s. Estimated remaining: 3m 50s. Rate: 199.2 symbols/min [2025-09-29T02:05:25.894330] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T02:05:26.021298] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-29T02:05:26.113098] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:26.143619] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-29T02:05:26.180825] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:26.203518] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-29T02:05:26.263261] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:26.325934] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-09-29T02:05:26.326330] [INFO ] [MAIN ] OSCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:26.326437] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. OSCR took 0.5s. Estimated remaining: 3m 50s. Rate: 199.1 symbols/min [2025-09-29T02:05:26.514380] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:26.515142] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-29T02:05:26.515240] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-29T02:05:26.515355] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-29T02:05:26.515430] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-29T02:05:26.515515] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-29T02:05:26.515587] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-29T02:05:26.623142] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T02:05:26.637865] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-29T02:05:26.844911] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-09-29T02:05:26.857607] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-29T02:05:26.937389] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:26.982588] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T02:05:27.077820] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-29T02:05:27.112103] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T02:05:27.600131] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-29T02:05:28.057239] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T02:05:28.400077] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-29T02:05:29.175099] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T02:05:29.200087] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-29T02:05:29.667297] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-29T02:05:30.000068] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-29T02:05:30.300862] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-29T02:05:30.800072] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-29T02:05:31.524861] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T02:05:31.600080] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-29T02:05:32.069126] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T02:05:32.400069] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-29T02:05:33.100408] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T02:05:33.200045] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-29T02:05:33.562491] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T02:05:34.000080] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-29T02:05:34.750678] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T02:05:34.800064] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-29T02:05:35.508432] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T02:05:35.600057] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-29T02:05:36.330463] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T02:05:36.400041] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-29T02:05:37.160063] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T02:05:37.200058] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-29T02:05:37.997563] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T02:05:38.007014] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-29T02:05:38.800065] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-29T02:05:38.871514] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T02:05:39.542896] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T02:05:39.600063] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-29T02:05:40.352575] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T02:05:40.400034] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-29T02:05:41.126802] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T02:05:41.200068] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-29T02:05:42.000043] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-29T02:05:42.093424] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T02:05:42.103751] [INFO ] [REMOTE ] ORI: Full fetch complete (70200 records). [2025-09-29T02:05:42.103962] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-29T02:05:42.331945] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:42.332793] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:42.332871] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:42.332951] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-29T02:05:42.333056] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-29T02:05:42.333131] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-29T02:05:42.333218] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-29T02:05:42.334132] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORI took 17.8s. Estimated remaining: 3m 57s. Rate: 192.9 symbols/min [2025-09-29T02:05:42.534372] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:42.534792] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-29T02:05:42.535048] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-29T02:05:42.535221] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-29T02:05:42.535310] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-29T02:05:42.535427] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-29T02:05:42.535518] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-29T02:05:42.804068] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-29T02:05:42.948238] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:42.968142] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T02:05:43.006426] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:05:43.600065] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-29T02:05:44.394518] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T02:05:44.403066] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-29T02:05:44.852678] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T02:05:44.855202] [INFO ] [REMOTE ] OPY: Full fetch complete (10014 records). [2025-09-29T02:05:44.855314] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-29T02:05:45.062158] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:45.062435] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:45.062510] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:45.062589] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-29T02:05:45.062717] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-29T02:05:45.062794] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-29T02:05:45.062878] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-29T02:05:45.062980] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. OPY took 21.9s. Estimated remaining: 3m 58s. Rate: 191.9 symbols/min [2025-09-29T02:05:45.205246] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-29T02:05:45.255731] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:45.320039] [DEBUG] [LOCAL ] OTIS: Loaded 53481 existing records from primary storage. [2025-09-29T02:05:45.320446] [INFO ] [MAIN ] OTIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:45.320814] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OTIS took 0.3s. Estimated remaining: 3m 57s. Rate: 192.0 symbols/min [2025-09-29T02:05:45.512277] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:45.570178] [DEBUG] [LOCAL ] OUT: Loaded 48630 existing records from primary storage. [2025-09-29T02:05:45.570579] [INFO ] [MAIN ] OUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:45.570723] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OUT took 0.2s. Estimated remaining: 3m 57s. Rate: 192.0 symbols/min [2025-09-29T02:05:45.759865] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:45.813112] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-09-29T02:05:45.813536] [INFO ] [MAIN ] OVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:45.814011] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OVV took 0.2s. Estimated remaining: 3m 57s. Rate: 192.0 symbols/min [2025-09-29T02:05:46.002397] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-29T02:05:46.007251] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:46.042778] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-29T02:05:46.107703] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-09-29T02:05:46.108106] [INFO ] [MAIN ] OWL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:46.108211] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OWL took 0.3s. Estimated remaining: 3m 56s. Rate: 192.0 symbols/min [2025-09-29T02:05:46.156591] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:05:46.195369] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-29T02:05:46.208692] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:05:46.229786] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-09-29T02:05:46.246701] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:05:46.258687] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-29T02:05:46.264755] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-29T02:05:46.283745] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-29T02:05:46.283836] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-29T02:05:46.283900] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OTF took 3.9s. Estimated remaining: 3m 56s. Rate: 192.1 symbols/min [2025-09-29T02:05:46.414982] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:46.522311] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:46.522777] [DEBUG] [LOCAL ] OWLT: Loaded 9099 existing records from primary storage. [2025-09-29T02:05:46.523297] [INFO ] [MAIN ] OWLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:46.523830] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OWLT took 0.4s. Estimated remaining: 3m 55s. Rate: 192.1 symbols/min [2025-09-29T02:05:46.743742] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:46.754919] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-29T02:05:46.755223] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-29T02:05:46.755555] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-29T02:05:46.755789] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-29T02:05:46.756009] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-29T02:05:46.756238] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-29T02:05:46.801725] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-29T02:05:46.792090] [DEBUG] [LOCAL ] OXM: Loaded 33928 existing records from primary storage. [2025-09-29T02:05:46.823779] [INFO ] [MAIN ] OXM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:46.824118] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OXM took 0.5s. Estimated remaining: 3m 55s. Rate: 192.1 symbols/min [2025-09-29T02:05:47.211370] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:47.442492] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:47.484620] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-29T02:05:47.485165] [INFO ] [MAIN ] PAAS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:47.485274] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. PAAS took 0.7s. Estimated remaining: 3m 55s. Rate: 192.0 symbols/min [2025-09-29T02:05:47.609222] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-29T02:05:47.676911] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:47.706192] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T02:05:47.724729] [DEBUG] [LOCAL ] PAC: Loaded 11725 existing records from primary storage. [2025-09-29T02:05:47.725013] [INFO ] [MAIN ] PAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:47.725410] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. PAC took 0.2s. Estimated remaining: 3m 55s. Rate: 192.0 symbols/min [2025-09-29T02:05:47.906093] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:47.940389] [DEBUG] [LOCAL ] PACK: Loaded 32471 existing records from primary storage. [2025-09-29T02:05:47.940743] [INFO ] [MAIN ] PACK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:47.940845] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. PACK took 0.2s. Estimated remaining: 3m 54s. Rate: 192.0 symbols/min [2025-09-29T02:05:48.127223] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:48.167944] [DEBUG] [LOCAL ] PACS: Loaded 34761 existing records from primary storage. [2025-09-29T02:05:48.168400] [INFO ] [MAIN ] PACS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:48.168544] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PACS took 0.2s. Estimated remaining: 3m 54s. Rate: 192.1 symbols/min [2025-09-29T02:05:48.396555] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:48.400034] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-29T02:05:48.435093] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T02:05:48.465292] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-29T02:05:48.465698] [INFO ] [MAIN ] PAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:48.465900] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PAG took 0.3s. Estimated remaining: 3m 54s. Rate: 192.1 symbols/min [2025-09-29T02:05:48.667449] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:48.724274] [DEBUG] [LOCAL ] PAGS: Loaded 53447 existing records from primary storage. [2025-09-29T02:05:48.724753] [INFO ] [MAIN ] PAGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:48.724858] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PAGS took 0.3s. Estimated remaining: 3m 53s. Rate: 192.1 symbols/min [2025-09-29T02:05:48.916289] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:48.921305] [DEBUG] [LOCAL ] PAI: Loaded 2758 existing records from primary storage. [2025-09-29T02:05:48.921500] [INFO ] [MAIN ] PAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:48.921906] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAI took 0.2s. Estimated remaining: 3m 53s. Rate: 192.1 symbols/min [2025-09-29T02:05:49.114599] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:49.115115] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-29T02:05:49.115194] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-29T02:05:49.115441] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-29T02:05:49.115517] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-29T02:05:49.115602] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-29T02:05:49.115699] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-29T02:05:49.200978] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-29T02:05:49.312925] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T02:05:49.561301] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:50.000102] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-29T02:05:50.041116] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T02:05:50.800063] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-29T02:05:50.848254] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T02:05:51.558473] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T02:05:51.568682] [INFO ] [REMOTE ] OSK: Full fetch complete (61451 records). [2025-09-29T02:05:51.568897] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-29T02:05:51.605210] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-29T02:05:51.802101] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:51.802860] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:51.802949] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:51.803044] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-29T02:05:51.803160] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-29T02:05:51.803251] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-29T02:05:51.803351] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-29T02:05:51.803517] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. OSK took 25.5s. Estimated remaining: 3m 54s. Rate: 191.2 symbols/min [2025-09-29T02:05:51.989243] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:52.022156] [DEBUG] [LOCAL ] PAM: Loaded 28420 existing records from primary storage. [2025-09-29T02:05:52.022543] [INFO ] [MAIN ] PAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:52.022692] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAM took 0.2s. Estimated remaining: 3m 53s. Rate: 191.2 symbols/min [2025-09-29T02:05:52.226580] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:52.275970] [DEBUG] [LOCAL ] PAR: Loaded 33188 existing records from primary storage. [2025-09-29T02:05:52.276453] [INFO ] [MAIN ] PAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:52.276582] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAR took 0.3s. Estimated remaining: 3m 53s. Rate: 191.2 symbols/min [2025-09-29T02:05:52.404026] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-29T02:05:52.476095] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:52.508705] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T02:05:52.563332] [DEBUG] [LOCAL ] PARR: Loaded 49062 existing records from primary storage. [2025-09-29T02:05:52.563740] [INFO ] [MAIN ] PARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:52.563845] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PARR took 0.3s. Estimated remaining: 3m 53s. Rate: 191.2 symbols/min [2025-09-29T02:05:52.741459] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:52.801341] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-09-29T02:05:52.801800] [INFO ] [MAIN ] PATH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:52.801933] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PATH took 0.2s. Estimated remaining: 3m 52s. Rate: 191.3 symbols/min [2025-09-29T02:05:52.988794] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.014282] [DEBUG] [LOCAL ] PAXS: Loaded 21210 existing records from primary storage. [2025-09-29T02:05:53.014587] [INFO ] [MAIN ] PAXS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:53.014714] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PAXS took 0.2s. Estimated remaining: 3m 52s. Rate: 191.3 symbols/min [2025-09-29T02:05:53.215536] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-29T02:05:53.224580] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.265945] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T02:05:53.314307] [DEBUG] [LOCAL ] PAY: Loaded 38892 existing records from primary storage. [2025-09-29T02:05:53.314741] [INFO ] [MAIN ] PAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:53.314856] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAY took 0.3s. Estimated remaining: 3m 52s. Rate: 191.3 symbols/min [2025-09-29T02:05:53.378915] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:05:53.409473] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-29T02:05:53.419271] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:05:53.440817] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-09-29T02:05:53.446737] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:05:53.446892] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-29T02:05:53.472803] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-29T02:05:53.501983] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-29T02:05:53.525896] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.526560] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-29T02:05:53.526770] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PAII took 4.6s. Estimated remaining: 3m 51s. Rate: 191.4 symbols/min [2025-09-29T02:05:53.732506] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.748830] [DEBUG] [LOCAL ] PAYC: Loaded 36903 existing records from primary storage. [2025-09-29T02:05:53.749352] [INFO ] [MAIN ] PAYC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:53.749459] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PAYC took 0.4s. Estimated remaining: 3m 51s. Rate: 191.4 symbols/min [2025-09-29T02:05:53.971021] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.986603] [DEBUG] [LOCAL ] PB: Loaded 42025 existing records from primary storage. [2025-09-29T02:05:53.987091] [INFO ] [MAIN ] PB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:53.987305] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PB took 0.5s. Estimated remaining: 3m 51s. Rate: 191.4 symbols/min [2025-09-29T02:05:54.009011] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-29T02:05:54.220639] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:54.240698] [DEBUG] [LOCAL ] PBA: Loaded 49665 existing records from primary storage. [2025-09-29T02:05:54.241157] [INFO ] [MAIN ] PBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:54.241264] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PBA took 0.5s. Estimated remaining: 3m 50s. Rate: 191.4 symbols/min [2025-09-29T02:05:54.455499] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:54.488388] [DEBUG] [LOCAL ] PBF: Loaded 53866 existing records from primary storage. [2025-09-29T02:05:54.489035] [INFO ] [MAIN ] PBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:54.489183] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBF took 0.5s. Estimated remaining: 3m 50s. Rate: 191.5 symbols/min [2025-09-29T02:05:54.517544] [DEBUG] [LOCAL ] PBH: Loaded 32156 existing records from primary storage. [2025-09-29T02:05:54.517922] [INFO ] [MAIN ] PBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:54.518025] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBH took 0.3s. Estimated remaining: 3m 50s. Rate: 191.6 symbols/min [2025-09-29T02:05:54.800089] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-29T02:05:55.068201] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T02:05:55.570997] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T02:05:55.600030] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-29T02:05:56.362043] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T02:05:56.400028] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-29T02:05:57.206128] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-29T02:05:57.209048] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T02:05:58.009254] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-29T02:05:58.030152] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T02:05:58.793705] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T02:05:58.804119] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-29T02:05:59.218070] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-29T02:05:59.600070] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-29T02:06:00.004093] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-29T02:06:00.400069] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-29T02:06:01.200088] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-29T02:06:01.288140] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T02:06:01.914337] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T02:06:02.000161] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-29T02:06:02.447592] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T02:06:02.458705] [INFO ] [REMOTE ] ORCL: Full fetch complete (77532 records). [2025-09-29T02:06:02.458917] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-29T02:06:02.673082] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:06:02.673919] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:02.674018] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:02.674127] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-29T02:06:02.674251] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-29T02:06:02.674346] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-29T02:06:02.674456] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-29T02:06:02.674949] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. ORCL took 38.2s. Estimated remaining: 3m 53s. Rate: 188.7 symbols/min [2025-09-29T02:06:02.800087] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-29T02:06:03.572469] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T02:06:03.582718] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-29T02:06:03.582925] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-29T02:06:03.802078] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:06:03.802950] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:03.803048] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:03.803145] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-29T02:06:03.803263] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-29T02:06:03.803353] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-29T02:06:03.803450] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-29T02:06:03.803756] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. OXY took 17.3s. Estimated remaining: 3m 53s. Rate: 188.4 symbols/min [2025-09-29T02:06:04.566067] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:04.571903] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:04.573504] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:04.645849] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:04.663940] [DEBUG] [LOCAL ] PCF: Loaded 8720 existing records from primary storage. [2025-09-29T02:06:04.664458] [INFO ] [MAIN ] PCF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:04.664598] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 0.9s. Estimated remaining: 3m 53s. Rate: 188.2 symbols/min [2025-09-29T02:06:04.728875] [DEBUG] [LOCAL ] PBT: Loaded 17533 existing records from primary storage. [2025-09-29T02:06:04.782439] [INFO ] [MAIN ] PBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:04.824051] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PBT took 1.0s. Estimated remaining: 3m 52s. Rate: 188.3 symbols/min [2025-09-29T02:06:04.843122] [DEBUG] [LOCAL ] PBI: Loaded 50788 existing records from primary storage. [2025-09-29T02:06:04.904802] [INFO ] [MAIN ] PBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:04.925807] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBI took 1.1s. Estimated remaining: 3m 52s. Rate: 188.3 symbols/min [2025-09-29T02:06:05.065879] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:05.304730] [DEBUG] [LOCAL ] PBR: Loaded 54492 existing records from primary storage. [2025-09-29T02:06:05.314313] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:05.334992] [INFO ] [MAIN ] PBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:05.334518] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:05.336038] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBR took 1.5s. Estimated remaining: 3m 52s. Rate: 188.3 symbols/min [2025-09-29T02:06:05.463831] [DEBUG] [LOCAL ] PCM: Loaded 6857 existing records from primary storage. [2025-09-29T02:06:05.470801] [INFO ] [MAIN ] PCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:05.475361] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCM took 0.6s. Estimated remaining: 3m 51s. Rate: 188.4 symbols/min [2025-09-29T02:06:05.687781] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:05.693917] [DEBUG] [LOCAL ] PCN: Loaded 24709 existing records from primary storage. [2025-09-29T02:06:05.659178] [DEBUG] [LOCAL ] PCG: Loaded 54498 existing records from primary storage. [2025-09-29T02:06:05.717179] [INFO ] [MAIN ] PCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:05.717352] [INFO ] [MAIN ] PCG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:05.724547] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCG took 1.1s. Estimated remaining: 3m 51s. Rate: 188.4 symbols/min [2025-09-29T02:06:05.778158] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCN took 0.8s. Estimated remaining: 3m 50s. Rate: 188.5 symbols/min [2025-09-29T02:06:05.887864] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.173721] [DEBUG] [LOCAL ] PCQ: Loaded 12298 existing records from primary storage. [2025-09-29T02:06:06.240279] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.220276] [INFO ] [MAIN ] PCQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:06.242050] [DEBUG] [LOCAL ] PCOR: Loaded 48849 existing records from primary storage. [2025-09-29T02:06:06.257822] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-29T02:06:06.263480] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.258013] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCQ took 0.8s. Estimated remaining: 3m 50s. Rate: 188.4 symbols/min [2025-09-29T02:06:06.263909] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-29T02:06:06.264564] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-29T02:06:06.276357] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-29T02:06:06.286763] [INFO ] [MAIN ] PCOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:06.307612] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-29T02:06:06.332262] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PCOR took 1.0s. Estimated remaining: 3m 50s. Rate: 188.5 symbols/min [2025-09-29T02:06:06.350850] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-29T02:06:06.756454] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.826269] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.873097] [DEBUG] [LOCAL ] PD: Loaded 48580 existing records from primary storage. [2025-09-29T02:06:06.902299] [INFO ] [MAIN ] PD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:06.921779] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PD took 1.2s. Estimated remaining: 3m 50s. Rate: 188.4 symbols/min [2025-09-29T02:06:07.278814] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:07.380936] [DEBUG] [LOCAL ] PDI: Loaded 50909 existing records from primary storage. [2025-09-29T02:06:07.352053] [DEBUG] [LOCAL ] PDM: Loaded 40354 existing records from primary storage. [2025-09-29T02:06:07.379758] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:07.346475] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-29T02:06:07.383167] [INFO ] [MAIN ] PDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:07.383297] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDI took 1.1s. Estimated remaining: 3m 49s. Rate: 188.4 symbols/min [2025-09-29T02:06:07.389103] [INFO ] [MAIN ] PDM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:07.401926] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDM took 1.0s. Estimated remaining: 3m 49s. Rate: 188.5 symbols/min [2025-09-29T02:06:07.593155] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-29T02:06:07.707583] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-29T02:06:07.714188] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:07.747221] [DEBUG] [LOCAL ] PDO: Loaded 32146 existing records from primary storage. [2025-09-29T02:06:07.763720] [INFO ] [MAIN ] PDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:07.798266] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDO took 0.9s. Estimated remaining: 3m 49s. Rate: 188.4 symbols/min [2025-09-29T02:06:07.820023] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:07.981539] [DEBUG] [LOCAL ] PDS: Loaded 18297 existing records from primary storage. [2025-09-29T02:06:08.039983] [DEBUG] [LOCAL ] PDT: Loaded 17549 existing records from primary storage. [2025-09-29T02:06:08.040429] [INFO ] [MAIN ] PDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.060994] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDS took 0.7s. Estimated remaining: 3m 48s. Rate: 188.5 symbols/min [2025-09-29T02:06:08.060104] [INFO ] [MAIN ] PDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.059683] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:08.067011] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDT took 0.6s. Estimated remaining: 3m 48s. Rate: 188.6 symbols/min [2025-09-29T02:06:08.191607] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T02:06:08.271228] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-29T02:06:08.282455] [DEBUG] [LOCAL ] PDX: Loaded 14514 existing records from primary storage. [2025-09-29T02:06:08.319709] [INFO ] [MAIN ] PDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.330492] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDX took 0.5s. Estimated remaining: 3m 47s. Rate: 188.6 symbols/min [2025-09-29T02:06:08.505909] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:08.519082] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:08.684981] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T02:06:08.684837] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:08.686759] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-29T02:06:08.779783] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-09-29T02:06:08.781179] [DEBUG] [LOCAL ] PEG: Loaded 53893 existing records from primary storage. [2025-09-29T02:06:08.781618] [INFO ] [MAIN ] PEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.781807] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEG took 0.7s. Estimated remaining: 3m 47s. Rate: 188.5 symbols/min [2025-09-29T02:06:08.781956] [INFO ] [MAIN ] PEB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.795878] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEB took 0.7s. Estimated remaining: 3m 47s. Rate: 188.7 symbols/min [2025-09-29T02:06:08.873085] [DEBUG] [LOCAL ] PEN: Loaded 30842 existing records from primary storage. [2025-09-29T02:06:08.944432] [INFO ] [MAIN ] PEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.983806] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEN took 0.6s. Estimated remaining: 3m 46s. Rate: 188.7 symbols/min [2025-09-29T02:06:08.994602] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T02:06:09.017100] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-29T02:06:09.189231] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:09.331051] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:09.428547] [DEBUG] [LOCAL ] PEO: Loaded 10999 existing records from primary storage. [2025-09-29T02:06:09.423948] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:09.429186] [INFO ] [MAIN ] PEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:09.429020] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-29T02:06:09.429758] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEO took 0.6s. Estimated remaining: 3m 46s. Rate: 188.7 symbols/min [2025-09-29T02:06:09.429899] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-29T02:06:09.479229] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-29T02:06:09.479512] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-29T02:06:09.495877] [DEBUG] [LOCAL ] PERF: Loaded 14231 existing records from primary storage. [2025-09-29T02:06:09.514089] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-29T02:06:09.519460] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T02:06:09.546745] [INFO ] [MAIN ] PERF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:09.546904] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-29T02:06:09.578241] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-29T02:06:09.588751] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PERF took 0.7s. Estimated remaining: 3m 46s. Rate: 188.7 symbols/min [2025-09-29T02:06:09.681208] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:09.938060] [DEBUG] [LOCAL ] PFD: Loaded 5199 existing records from primary storage. [2025-09-29T02:06:09.954857] [INFO ] [MAIN ] PFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:09.955517] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PFD took 0.5s. Estimated remaining: 3m 45s. Rate: 188.7 symbols/min [2025-09-29T02:06:10.007075] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-29T02:06:10.112574] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-29T02:06:10.297734] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:10.440209] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:10.455044] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-29T02:06:10.494968] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-29T02:06:10.496425] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-29T02:06:10.519892] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:10.568228] [DEBUG] [LOCAL ] PFE: Loaded 54593 existing records from primary storage. [2025-09-29T02:06:10.568776] [INFO ] [MAIN ] PFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:10.569630] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PFE took 0.9s. Estimated remaining: 3m 45s. Rate: 188.6 symbols/min [2025-09-29T02:06:10.644195] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:10.672460] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-29T02:06:10.707942] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:10.714716] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-09-29T02:06:10.714851] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:10.714975] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-29T02:06:10.721039] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-29T02:06:10.738738] [DEBUG] [LOCAL ] PFGC: Loaded 47650 existing records from primary storage. [2025-09-29T02:06:10.721165] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-29T02:06:10.749833] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-29T02:06:10.784248] [INFO ] [MAIN ] PFGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:10.777020] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PEW took 1.7s. Estimated remaining: 3m 45s. Rate: 188.6 symbols/min [2025-09-29T02:06:10.777340] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T02:06:10.804774] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:10.812350] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-29T02:06:10.805825] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFGC took 0.8s. Estimated remaining: 3m 44s. Rate: 188.7 symbols/min [2025-09-29T02:06:11.047789] [DEBUG] [LOCAL ] PFH: Loaded 6911 existing records from primary storage. [2025-09-29T02:06:11.083822] [INFO ] [MAIN ] PFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.056239] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-29T02:06:11.133538] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFH took 0.6s. Estimated remaining: 3m 44s. Rate: 188.7 symbols/min [2025-09-29T02:06:11.196080] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:11.334319] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:11.459689] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:11.460715] [DEBUG] [LOCAL ] PFL: Loaded 13959 existing records from primary storage. [2025-09-29T02:06:11.462703] [INFO ] [MAIN ] PFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.463272] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFL took 0.7s. Estimated remaining: 3m 44s. Rate: 188.7 symbols/min [2025-09-29T02:06:11.602901] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-29T02:06:11.637053] [DEBUG] [LOCAL ] PFLT: Loaded 44333 existing records from primary storage. [2025-09-29T02:06:11.664591] [INFO ] [MAIN ] PFLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.711435] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:11.712538] [DEBUG] [LOCAL ] PFN: Loaded 21992 existing records from primary storage. [2025-09-29T02:06:11.711634] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFLT took 0.9s. Estimated remaining: 3m 43s. Rate: 188.7 symbols/min [2025-09-29T02:06:11.713089] [INFO ] [MAIN ] PFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.726617] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFN took 0.5s. Estimated remaining: 3m 43s. Rate: 188.9 symbols/min [2025-09-29T02:06:11.899814] [DEBUG] [LOCAL ] PFO: Loaded 5948 existing records from primary storage. [2025-09-29T02:06:11.945553] [INFO ] [MAIN ] PFO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.939714] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-29T02:06:11.999744] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-09-29T02:06:11.993216] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFO took 0.5s. Estimated remaining: 3m 43s. Rate: 188.9 symbols/min [2025-09-29T02:06:12.009387] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-29T02:06:12.205800] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:12.363047] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:12.547415] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T02:06:12.551183] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:12.552336] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:12.552409] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:12.552457] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-29T02:06:12.552543] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-29T02:06:12.552598] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-29T02:06:12.552691] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-29T02:06:12.552791] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PDCC took 6.7s. Estimated remaining: 3m 42s. Rate: 188.8 symbols/min [2025-09-29T02:06:12.733171] [DEBUG] [LOCAL ] PFSI: Loaded 29259 existing records from primary storage. [2025-09-29T02:06:12.778913] [DEBUG] [LOCAL ] PFS: Loaded 36188 existing records from primary storage. [2025-09-29T02:06:12.801548] [INFO ] [MAIN ] PFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:12.801833] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFS took 1.1s. Estimated remaining: 3m 42s. Rate: 188.8 symbols/min [2025-09-29T02:06:12.801133] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:12.801740] [INFO ] [MAIN ] PFSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:12.824365] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PFSI took 1.1s. Estimated remaining: 3m 42s. Rate: 188.9 symbols/min [2025-09-29T02:06:13.028406] [DEBUG] [LOCAL ] PGP: Loaded 5515 existing records from primary storage. [2025-09-29T02:06:13.078917] [INFO ] [MAIN ] PGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.121487] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PGP took 0.6s. Estimated remaining: 3m 41s. Rate: 188.9 symbols/min [2025-09-29T02:06:13.095974] [DEBUG] [LOCAL ] PG: Loaded 54532 existing records from primary storage. [2025-09-29T02:06:13.269861] [INFO ] [MAIN ] PG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.360132] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:13.360298] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PG took 1.3s. Estimated remaining: 3m 41s. Rate: 189.0 symbols/min [2025-09-29T02:06:13.382780] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:13.573670] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:13.725883] [DEBUG] [LOCAL ] PGZ: Loaded 5440 existing records from primary storage. [2025-09-29T02:06:13.730261] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:13.745553] [INFO ] [MAIN ] PGZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.746090] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 0.6s. Estimated remaining: 3m 41s. Rate: 188.9 symbols/min [2025-09-29T02:06:13.900967] [DEBUG] [LOCAL ] PGRE: Loaded 47177 existing records from primary storage. [2025-09-29T02:06:13.902046] [DEBUG] [LOCAL ] PGR: Loaded 53757 existing records from primary storage. [2025-09-29T02:06:13.907555] [INFO ] [MAIN ] PGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.907764] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGR took 1.1s. Estimated remaining: 3m 40s. Rate: 189.0 symbols/min [2025-09-29T02:06:13.907338] [INFO ] [MAIN ] PGRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.908188] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PGRE took 1.0s. Estimated remaining: 3m 40s. Rate: 189.1 symbols/min [2025-09-29T02:06:13.998884] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.014803] [DEBUG] [LOCAL ] PH: Loaded 39166 existing records from primary storage. [2025-09-29T02:06:14.015199] [INFO ] [MAIN ] PH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:14.015306] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PH took 0.6s. Estimated remaining: 3m 39s. Rate: 189.2 symbols/min [2025-09-29T02:06:14.025505] [DEBUG] [LOCAL ] PHD: Loaded 10098 existing records from primary storage. [2025-09-29T02:06:14.025854] [INFO ] [MAIN ] PHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:14.025993] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHD took 0.3s. Estimated remaining: 3m 39s. Rate: 189.3 symbols/min [2025-09-29T02:06:14.780377] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.769736] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.830856] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.853610] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.873864] [DEBUG] [LOCAL ] PHI: Loaded 15230 existing records from primary storage. [2025-09-29T02:06:14.874366] [INFO ] [MAIN ] PHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:14.874581] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHI took 0.8s. Estimated remaining: 3m 39s. Rate: 189.1 symbols/min [2025-09-29T02:06:15.036631] [DEBUG] [LOCAL ] PHIN: Loaded 33541 existing records from primary storage. [2025-09-29T02:06:15.049717] [DEBUG] [LOCAL ] PHK: Loaded 26792 existing records from primary storage. [2025-09-29T02:06:15.060825] [INFO ] [MAIN ] PHIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.061253] [INFO ] [MAIN ] PHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.083234] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHIN took 1.1s. Estimated remaining: 3m 39s. Rate: 189.1 symbols/min [2025-09-29T02:06:15.105767] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHK took 1.1s. Estimated remaining: 3m 38s. Rate: 189.2 symbols/min [2025-09-29T02:06:15.223569] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:15.251123] [DEBUG] [LOCAL ] PHG: Loaded 46835 existing records from primary storage. [2025-09-29T02:06:15.269572] [INFO ] [MAIN ] PHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.342690] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHG took 1.3s. Estimated remaining: 3m 38s. Rate: 189.3 symbols/min [2025-09-29T02:06:15.600792] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:15.696086] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:15.783390] [DEBUG] [LOCAL ] PHM: Loaded 52386 existing records from primary storage. [2025-09-29T02:06:15.804360] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:15.814802] [INFO ] [MAIN ] PHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.815081] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PHM took 0.9s. Estimated remaining: 3m 38s. Rate: 189.2 symbols/min [2025-09-29T02:06:15.889837] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-09-29T02:06:15.917900] [INFO ] [MAIN ] PIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.924261] [DEBUG] [LOCAL ] PHR: Loaded 38045 existing records from primary storage. [2025-09-29T02:06:15.940083] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PIM took 0.5s. Estimated remaining: 3m 37s. Rate: 189.3 symbols/min [2025-09-29T02:06:15.960782] [INFO ] [MAIN ] PHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.978405] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PHR took 0.9s. Estimated remaining: 3m 37s. Rate: 189.4 symbols/min [2025-09-29T02:06:16.253033] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:16.279577] [DEBUG] [LOCAL ] PII: Loaded 49815 existing records from primary storage. [2025-09-29T02:06:16.346946] [INFO ] [MAIN ] PII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:16.415753] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:16.415920] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PII took 1.3s. Estimated remaining: 3m 36s. Rate: 189.3 symbols/min [2025-09-29T02:06:16.469587] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:16.535291] [DEBUG] [LOCAL ] PINE: Loaded 14365 existing records from primary storage. [2025-09-29T02:06:16.593591] [INFO ] [MAIN ] PINE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:16.609930] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PINE took 0.8s. Estimated remaining: 3m 36s. Rate: 189.4 symbols/min [2025-09-29T02:06:16.610540] [DEBUG] [LOCAL ] PIPR: Loaded 15331 existing records from primary storage. [2025-09-29T02:06:16.638283] [INFO ] [MAIN ] PIPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:16.726745] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PIPR took 0.7s. Estimated remaining: 3m 36s. Rate: 189.4 symbols/min [2025-09-29T02:06:16.749953] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.065067] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-29T02:06:17.093292] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.119872] [DEBUG] [LOCAL ] PJT: Loaded 22579 existing records from primary storage. [2025-09-29T02:06:17.136287] [INFO ] [MAIN ] PINS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.141226] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.142919] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PINS took 1.2s. Estimated remaining: 3m 35s. Rate: 189.4 symbols/min [2025-09-29T02:06:17.141950] [INFO ] [MAIN ] PJT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.150489] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PJT took 0.7s. Estimated remaining: 3m 35s. Rate: 189.5 symbols/min [2025-09-29T02:06:17.403286] [DEBUG] [LOCAL ] PKE: Loaded 12775 existing records from primary storage. [2025-09-29T02:06:17.454441] [INFO ] [MAIN ] PKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.554722] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKE took 0.8s. Estimated remaining: 3m 35s. Rate: 189.5 symbols/min [2025-09-29T02:06:17.609618] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.586297] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.676957] [DEBUG] [LOCAL ] PK: Loaded 53626 existing records from primary storage. [2025-09-29T02:06:17.705250] [INFO ] [MAIN ] PK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.725002] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PK took 1.1s. Estimated remaining: 3m 34s. Rate: 189.5 symbols/min [2025-09-29T02:06:17.817423] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.935489] [DEBUG] [LOCAL ] PKST: Loaded 19461 existing records from primary storage. [2025-09-29T02:06:17.961200] [INFO ] [MAIN ] PKST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.982592] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKST took 0.8s. Estimated remaining: 3m 34s. Rate: 189.6 symbols/min [2025-09-29T02:06:18.050057] [DEBUG] [LOCAL ] PKG: Loaded 39785 existing records from primary storage. [2025-09-29T02:06:18.078192] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.078329] [INFO ] [MAIN ] PKG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:18.151764] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKG took 1.0s. Estimated remaining: 3m 34s. Rate: 189.6 symbols/min [2025-09-29T02:06:18.181220] [DEBUG] [LOCAL ] PKX: Loaded 25141 existing records from primary storage. [2025-09-29T02:06:18.214309] [INFO ] [MAIN ] PKX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:18.256606] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PKX took 0.7s. Estimated remaining: 3m 33s. Rate: 189.7 symbols/min [2025-09-29T02:06:18.362769] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.614518] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.671026] [DEBUG] [LOCAL ] PL: Loaded 53894 existing records from primary storage. [2025-09-29T02:06:18.707707] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.709856] [INFO ] [MAIN ] PL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:18.712994] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PL took 0.9s. Estimated remaining: 3m 33s. Rate: 189.6 symbols/min [2025-09-29T02:06:18.886490] [DEBUG] [LOCAL ] PLOW: Loaded 20792 existing records from primary storage. [2025-09-29T02:06:18.955862] [INFO ] [MAIN ] PLOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:18.968139] [DEBUG] [LOCAL ] PLD: Loaded 54226 existing records from primary storage. [2025-09-29T02:06:18.984796] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLOW took 0.6s. Estimated remaining: 3m 33s. Rate: 189.7 symbols/min [2025-09-29T02:06:18.990618] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.991432] [INFO ] [MAIN ] PLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:19.017251] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLD took 1.0s. Estimated remaining: 3m 32s. Rate: 189.8 symbols/min [2025-09-29T02:06:19.164414] [DEBUG] [LOCAL ] PLNT: Loaded 49144 existing records from primary storage. [2025-09-29T02:06:19.197528] [INFO ] [MAIN ] PLNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:19.208054] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLNT took 1.0s. Estimated remaining: 3m 32s. Rate: 189.8 symbols/min [2025-09-29T02:06:19.455592] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:19.533611] [DEBUG] [LOCAL ] PLYM: Loaded 33884 existing records from primary storage. [2025-09-29T02:06:19.597167] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:19.598474] [INFO ] [MAIN ] PLYM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:19.620491] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PLYM took 0.9s. Estimated remaining: 3m 32s. Rate: 189.8 symbols/min [2025-09-29T02:06:19.691736] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:19.809114] [DEBUG] [LOCAL ] PML: Loaded 20999 existing records from primary storage. [2025-09-29T02:06:19.820435] [INFO ] [MAIN ] PML: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:19.821154] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PML took 0.8s. Estimated remaining: 3m 31s. Rate: 189.8 symbols/min [2025-09-29T02:06:19.966201] [DEBUG] [LOCAL ] PMM: Loaded 10760 existing records from primary storage. [2025-09-29T02:06:20.028637] [INFO ] [MAIN ] PMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:20.011964] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.063204] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PMM took 0.8s. Estimated remaining: 3m 31s. Rate: 189.8 symbols/min [2025-09-29T02:06:20.109384] [DEBUG] [LOCAL ] PM: Loaded 54445 existing records from primary storage. [2025-09-29T02:06:20.144455] [INFO ] [MAIN ] PM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:20.194083] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PM took 1.2s. Estimated remaining: 3m 30s. Rate: 189.9 symbols/min [2025-09-29T02:06:20.290397] [DEBUG] [LOCAL ] PMO: Loaded 10547 existing records from primary storage. [2025-09-29T02:06:20.284310] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.297143] [INFO ] [MAIN ] PMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:20.310126] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMO took 0.6s. Estimated remaining: 3m 30s. Rate: 190.0 symbols/min [2025-09-29T02:06:20.614203] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.743737] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-29T02:06:20.778533] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-29T02:06:20.809674] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.809898] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-29T02:06:20.807794] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-29T02:06:20.811776] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.826155] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-29T02:06:20.826682] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-29T02:06:20.826289] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-29T02:06:20.827084] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-29T02:06:20.826923] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-29T02:06:20.827398] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-29T02:06:20.827359] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-29T02:06:20.829470] [DEBUG] [LOCAL ] PMT: Loaded 40798 existing records from primary storage. [2025-09-29T02:06:20.829571] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-29T02:06:20.830337] [INFO ] [MAIN ] PMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:20.829814] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-29T02:06:20.830546] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-29T02:06:20.842235] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMT took 1.0s. Estimated remaining: 3m 30s. Rate: 189.9 symbols/min [2025-09-29T02:06:20.842716] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-29T02:06:20.842455] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-29T02:06:20.937456] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-29T02:06:20.996142] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-29T02:06:21.635915] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:22.195043] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:22.201102] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:22.254603] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-29T02:06:22.284469] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-29T02:06:22.292922] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:22.295294] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-29T02:06:22.312680] [DEBUG] [LOCAL ] PNC: Loaded 53000 existing records from primary storage. [2025-09-29T02:06:22.313902] [INFO ] [MAIN ] PNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:22.314007] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PNC took 1.5s. Estimated remaining: 3m 30s. Rate: 189.5 symbols/min [2025-09-29T02:06:22.454081] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:22.477938] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-29T02:06:22.508236] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:22.510179] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-09-29T02:06:22.508117] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:22.510392] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:22.509776] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:22.513573] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-29T02:06:22.513740] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-29T02:06:22.515973] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-29T02:06:22.514049] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-29T02:06:22.517515] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-29T02:06:22.517790] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-29T02:06:22.517899] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-29T02:06:22.518006] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMTW took 2.2s. Estimated remaining: 3m 30s. Rate: 189.5 symbols/min [2025-09-29T02:06:22.516257] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:22.536976] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-09-29T02:06:22.564974] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:22.590704] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-29T02:06:22.604828] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-09-29T02:06:22.610179] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-29T02:06:22.628316] [INFO ] [MAIN ] PNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:22.643907] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNI took 0.3s. Estimated remaining: 3m 29s. Rate: 189.6 symbols/min [2025-09-29T02:06:22.647855] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-29T02:06:22.711187] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-29T02:06:22.730909] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PMTV took 2.5s. Estimated remaining: 3m 29s. Rate: 189.7 symbols/min [2025-09-29T02:06:22.781905] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T02:06:22.854736] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:22.842887] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-29T02:06:23.053180] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.134897] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.151380] [DEBUG] [LOCAL ] PNNT: Loaded 33337 existing records from primary storage. [2025-09-29T02:06:23.152061] [INFO ] [MAIN ] PNNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:23.152176] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNNT took 0.6s. Estimated remaining: 3m 29s. Rate: 189.6 symbols/min [2025-09-29T02:06:23.228038] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-29T02:06:23.263200] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-29T02:06:23.384359] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.405701] [DEBUG] [LOCAL ] PNR: Loaded 48589 existing records from primary storage. [2025-09-29T02:06:23.420262] [INFO ] [MAIN ] PNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:23.420469] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNR took 0.8s. Estimated remaining: 3m 28s. Rate: 189.7 symbols/min [2025-09-29T02:06:23.421709] [DEBUG] [LOCAL ] PNW: Loaded 46531 existing records from primary storage. [2025-09-29T02:06:23.458254] [INFO ] [MAIN ] PNW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:23.486971] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNW took 0.7s. Estimated remaining: 3m 28s. Rate: 189.7 symbols/min [2025-09-29T02:06:23.507258] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-29T02:06:23.531209] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-29T02:06:23.785094] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.871872] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.875825] [DEBUG] [LOCAL ] POR: Loaded 47706 existing records from primary storage. [2025-09-29T02:06:23.877530] [INFO ] [MAIN ] POR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:23.878054] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. POR took 0.7s. Estimated remaining: 3m 27s. Rate: 189.7 symbols/min [2025-09-29T02:06:23.963989] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T02:06:23.982380] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-29T02:06:24.138661] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:24.141233] [DEBUG] [LOCAL ] POST: Loaded 39494 existing records from primary storage. [2025-09-29T02:06:24.157380] [DEBUG] [LOCAL ] PPG: Loaded 51455 existing records from primary storage. [2025-09-29T02:06:24.157777] [INFO ] [MAIN ] POST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:24.158280] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POST took 0.7s. Estimated remaining: 3m 27s. Rate: 189.7 symbols/min [2025-09-29T02:06:24.158504] [INFO ] [MAIN ] PPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:24.173617] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPG took 0.7s. Estimated remaining: 3m 27s. Rate: 189.8 symbols/min [2025-09-29T02:06:24.280733] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T02:06:24.291362] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-29T02:06:24.400434] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:24.425493] [DEBUG] [LOCAL ] PPL: Loaded 54285 existing records from primary storage. [2025-09-29T02:06:24.426120] [INFO ] [MAIN ] PPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:24.426239] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPL took 0.5s. Estimated remaining: 3m 26s. Rate: 189.9 symbols/min [2025-09-29T02:06:24.442876] [DEBUG] [LOCAL ] PPT: Loaded 20342 existing records from primary storage. [2025-09-29T02:06:24.443202] [INFO ] [MAIN ] PPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:24.443305] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPT took 0.3s. Estimated remaining: 3m 26s. Rate: 190.0 symbols/min [2025-09-29T02:06:24.512665] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-29T02:06:24.513745] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-29T02:06:24.708071] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.19 seconds). [2025-09-29T02:06:24.709194] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-29T02:06:24.832048] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.12 seconds). [2025-09-29T02:06:24.833229] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-29T02:06:25.031040] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:06:25.031927] [INFO ] [REMOTE ] PMTU: Full fetch complete (1236 records). [2025-09-29T02:06:25.032024] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-29T02:06:25.222010] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:06:25.222270] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:25.222358] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:25.222465] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-29T02:06:25.222574] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-29T02:06:25.222672] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-29T02:06:25.222771] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-29T02:06:25.222869] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PMTU took 5.2s. Estimated remaining: 3m 26s. Rate: 189.8 symbols/min [2025-09-29T02:06:25.928322] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:25.899038] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:25.982960] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:25.984496] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:25.981992] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-29T02:06:25.985165] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-29T02:06:25.985471] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-29T02:06:25.985880] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-29T02:06:25.986071] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-29T02:06:25.986192] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-29T02:06:26.228495] [DEBUG] [LOCAL ] PRG: Loaded 30420 existing records from primary storage. [2025-09-29T02:06:26.288119] [INFO ] [MAIN ] PRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:26.331692] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRG took 1.1s. Estimated remaining: 3m 26s. Rate: 189.5 symbols/min [2025-09-29T02:06:26.360548] [DEBUG] [LOCAL ] PRA: Loaded 35243 existing records from primary storage. [2025-09-29T02:06:26.396718] [INFO ] [MAIN ] PRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:26.495425] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRA took 1.3s. Estimated remaining: 3m 25s. Rate: 189.6 symbols/min [2025-09-29T02:06:26.547089] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:26.510448] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-29T02:06:26.602883] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-29T02:06:26.620490] [INFO ] [MAIN ] PR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:26.664062] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PR took 1.4s. Estimated remaining: 3m 25s. Rate: 189.6 symbols/min [2025-09-29T02:06:26.772867] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.002889] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:06:27.002689] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.056221] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-29T02:06:27.090558] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.107974] [DEBUG] [LOCAL ] PRH: Loaded 4908 existing records from primary storage. [2025-09-29T02:06:27.108524] [INFO ] [MAIN ] PRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.108707] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRH took 0.5s. Estimated remaining: 3m 25s. Rate: 189.6 symbols/min [2025-09-29T02:06:27.249858] [DEBUG] [LOCAL ] PRI: Loaded 18636 existing records from primary storage. [2025-09-29T02:06:27.251560] [DEBUG] [LOCAL ] PRGO: Loaded 47634 existing records from primary storage. [2025-09-29T02:06:27.252196] [INFO ] [MAIN ] PRGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.263317] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRGO took 0.9s. Estimated remaining: 3m 24s. Rate: 189.6 symbols/min [2025-09-29T02:06:27.252291] [INFO ] [MAIN ] PRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.279110] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRI took 0.5s. Estimated remaining: 3m 24s. Rate: 189.7 symbols/min [2025-09-29T02:06:27.409738] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.487923] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T02:06:27.516043] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-29T02:06:27.758005] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.760112] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.804586] [DEBUG] [LOCAL ] PRIM: Loaded 45072 existing records from primary storage. [2025-09-29T02:06:27.805192] [INFO ] [MAIN ] PRIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.805370] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRIM took 0.7s. Estimated remaining: 3m 24s. Rate: 189.7 symbols/min [2025-09-29T02:06:27.853525] [DEBUG] [LOCAL ] PRLB: Loaded 20919 existing records from primary storage. [2025-09-29T02:06:27.889064] [INFO ] [MAIN ] PRLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.889734] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRLB took 0.6s. Estimated remaining: 3m 23s. Rate: 189.7 symbols/min [2025-09-29T02:06:27.923375] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T02:06:27.937953] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-29T02:06:28.053554] [DEBUG] [LOCAL ] PRKS: Loaded 43308 existing records from primary storage. [2025-09-29T02:06:28.074344] [INFO ] [MAIN ] PRKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:28.103867] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRKS took 0.8s. Estimated remaining: 3m 23s. Rate: 189.8 symbols/min [2025-09-29T02:06:28.299399] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:28.358831] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-29T02:06:28.361237] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-29T02:06:28.512276] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:28.656901] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:28.678364] [DEBUG] [LOCAL ] PRM: Loaded 45298 existing records from primary storage. [2025-09-29T02:06:28.679109] [INFO ] [MAIN ] PRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:28.679496] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRM took 0.9s. Estimated remaining: 3m 23s. Rate: 189.7 symbols/min [2025-09-29T02:06:28.885179] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T02:06:28.887142] [DEBUG] [LOCAL ] PRMB: Loaded 53928 existing records from primary storage. [2025-09-29T02:06:28.935993] [INFO ] [MAIN ] PRMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:28.925821] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-29T02:06:28.945169] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRMB took 1.0s. Estimated remaining: 3m 22s. Rate: 189.7 symbols/min [2025-09-29T02:06:28.975451] [DEBUG] [LOCAL ] PRO: Loaded 38444 existing records from primary storage. [2025-09-29T02:06:29.011678] [INFO ] [MAIN ] PRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:28.990508] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:29.032400] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRO took 0.9s. Estimated remaining: 3m 22s. Rate: 189.8 symbols/min [2025-09-29T02:06:29.061553] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-29T02:06:29.095285] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-29T02:06:29.157591] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-29T02:06:29.208494] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-29T02:06:29.265768] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-29T02:06:29.295766] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:29.320768] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T02:06:29.320430] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-29T02:06:29.327893] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-29T02:06:29.427109] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:29.503373] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-29T02:06:29.507878] [INFO ] [MAIN ] PRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:29.508563] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRT took 0.6s. Estimated remaining: 3m 22s. Rate: 189.7 symbols/min [2025-09-29T02:06:29.829715] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T02:06:29.848310] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-29T02:06:29.980767] [DEBUG] [LOCAL ] PRU: Loaded 52204 existing records from primary storage. [2025-09-29T02:06:30.010354] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:30.021333] [INFO ] [MAIN ] PRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:30.037238] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-29T02:06:30.049711] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-29T02:06:30.037516] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRU took 1.0s. Estimated remaining: 3m 22s. Rate: 189.7 symbols/min [2025-09-29T02:06:30.070764] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-29T02:06:30.145311] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-29T02:06:30.166535] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:30.177806] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-29T02:06:30.192111] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-29T02:06:30.216511] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-29T02:06:30.216905] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T02:06:30.240914] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-29T02:06:30.428815] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:30.453386] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:30.497703] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-29T02:06:30.545445] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:30.579400] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-09-29T02:06:30.621748] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:30.653111] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-29T02:06:30.682808] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-29T02:06:30.698218] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-29T02:06:30.672186] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-29T02:06:30.703864] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-29T02:06:30.710155] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRSU took 2.0s. Estimated remaining: 3m 21s. Rate: 189.5 symbols/min [2025-09-29T02:06:30.711876] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-29T02:06:30.796226] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:30.863742] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-29T02:06:30.891403] [DEBUG] [LOCAL ] PSA: Loaded 42474 existing records from primary storage. [2025-09-29T02:06:30.897356] [INFO ] [MAIN ] PSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:30.946551] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PSA took 0.9s. Estimated remaining: 3m 21s. Rate: 189.6 symbols/min [2025-09-29T02:06:31.012240] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:31.058915] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T02:06:31.079123] [INFO ] [REMOTE ] PRCS: Full fetch complete (3804 records). [2025-09-29T02:06:31.098930] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-29T02:06:31.189742] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T02:06:31.223476] [DEBUG] [LOCAL ] PSBD: Loaded 7130 existing records from primary storage. [2025-09-29T02:06:31.284355] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:31.284584] [INFO ] [MAIN ] PSBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:31.306741] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSBD took 0.6s. Estimated remaining: 3m 21s. Rate: 189.6 symbols/min [2025-09-29T02:06:31.467391] [DEBUG] [LOCAL ] PSF: Loaded 6990 existing records from primary storage. [2025-09-29T02:06:31.486145] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:06:31.486724] [INFO ] [MAIN ] PSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:31.497387] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSF took 0.5s. Estimated remaining: 3m 20s. Rate: 189.6 symbols/min [2025-09-29T02:06:31.505921] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:31.518251] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:31.572208] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-29T02:06:31.610335] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-29T02:06:31.694571] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:31.705987] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-29T02:06:31.723882] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-29T02:06:31.728950] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-29T02:06:31.729114] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PRCS took 6.5s. Estimated remaining: 3m 20s. Rate: 189.6 symbols/min [2025-09-29T02:06:31.925124] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.012065] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.024555] [DEBUG] [LOCAL ] PSFE: Loaded 30702 existing records from primary storage. [2025-09-29T02:06:32.025397] [INFO ] [MAIN ] PSFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.025507] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSFE took 0.7s. Estimated remaining: 3m 20s. Rate: 189.6 symbols/min [2025-09-29T02:06:32.103780] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T02:06:32.240280] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.266386] [DEBUG] [LOCAL ] PSN: Loaded 46808 existing records from primary storage. [2025-09-29T02:06:32.267072] [INFO ] [MAIN ] PSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.267246] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSN took 0.7s. Estimated remaining: 3m 19s. Rate: 189.7 symbols/min [2025-09-29T02:06:32.399505] [DEBUG] [LOCAL ] PSO: Loaded 37751 existing records from primary storage. [2025-09-29T02:06:32.400276] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-29T02:06:32.416347] [INFO ] [MAIN ] PSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.460394] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSO took 0.7s. Estimated remaining: 3m 19s. Rate: 189.7 symbols/min [2025-09-29T02:06:32.519265] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.664854] [DEBUG] [LOCAL ] PSQH: Loaded 35426 existing records from primary storage. [2025-09-29T02:06:32.676000] [INFO ] [MAIN ] PSQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.686546] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSQH took 0.7s. Estimated remaining: 3m 19s. Rate: 189.7 symbols/min [2025-09-29T02:06:32.748702] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T02:06:32.839442] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.932568] [DEBUG] [LOCAL ] PSTG: Loaded 53626 existing records from primary storage. [2025-09-29T02:06:32.957042] [INFO ] [MAIN ] PSTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.995965] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.996205] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSTG took 0.7s. Estimated remaining: 3m 18s. Rate: 189.7 symbols/min [2025-09-29T02:06:33.065056] [DEBUG] [LOCAL ] PSTL: Loaded 20585 existing records from primary storage. [2025-09-29T02:06:33.104614] [INFO ] [MAIN ] PSTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:33.116421] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTL took 0.6s. Estimated remaining: 3m 18s. Rate: 189.8 symbols/min [2025-09-29T02:06:33.238407] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:33.210224] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-29T02:06:33.416583] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:33.439906] [DEBUG] [LOCAL ] PTA: Loaded 15299 existing records from primary storage. [2025-09-29T02:06:33.440387] [INFO ] [MAIN ] PTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:33.440816] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PTA took 0.4s. Estimated remaining: 3m 18s. Rate: 189.8 symbols/min [2025-09-29T02:06:33.465400] [DEBUG] [LOCAL ] PSX: Loaded 53912 existing records from primary storage. [2025-09-29T02:06:33.503139] [INFO ] [MAIN ] PSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:33.512607] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PSX took 0.8s. Estimated remaining: 3m 17s. Rate: 189.9 symbols/min [2025-09-29T02:06:33.575358] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-29T02:06:33.701616] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:33.804793] [DEBUG] [LOCAL ] PTY: Loaded 37902 existing records from primary storage. [2025-09-29T02:06:33.841130] [INFO ] [MAIN ] PTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:33.871473] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:33.871805] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTY took 0.8s. Estimated remaining: 3m 17s. Rate: 189.9 symbols/min [2025-09-29T02:06:34.002232] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-29T02:06:34.068711] [DEBUG] [LOCAL ] PUK: Loaded 45565 existing records from primary storage. [2025-09-29T02:06:34.115827] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:34.116390] [INFO ] [MAIN ] PUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:34.117094] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PUK took 0.7s. Estimated remaining: 3m 17s. Rate: 189.9 symbols/min [2025-09-29T02:06:34.256287] [DEBUG] [LOCAL ] PUMP: Loaded 50160 existing records from primary storage. [2025-09-29T02:06:34.273251] [INFO ] [MAIN ] PUMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:34.289454] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUMP took 0.7s. Estimated remaining: 3m 16s. Rate: 189.9 symbols/min [2025-09-29T02:06:34.369901] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:34.370213] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T02:06:34.518469] [DEBUG] [LOCAL ] PVL: Loaded 4819 existing records from primary storage. [2025-09-29T02:06:34.530692] [DEBUG] [LOCAL ] PVH: Loaded 51137 existing records from primary storage. [2025-09-29T02:06:34.531038] [INFO ] [MAIN ] PVL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:34.566322] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVL took 0.4s. Estimated remaining: 3m 16s. Rate: 190.0 symbols/min [2025-09-29T02:06:34.583106] [INFO ] [MAIN ] PVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:34.606439] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:34.625096] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PVH took 0.8s. Estimated remaining: 3m 15s. Rate: 190.0 symbols/min [2025-09-29T02:06:34.809788] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-29T02:06:34.968345] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.062338] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.082530] [DEBUG] [LOCAL ] PWR: Loaded 48047 existing records from primary storage. [2025-09-29T02:06:35.083275] [INFO ] [MAIN ] PWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:35.083593] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PWR took 0.8s. Estimated remaining: 3m 15s. Rate: 190.0 symbols/min [2025-09-29T02:06:35.109913] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T02:06:35.233445] [DEBUG] [LOCAL ] PX: Loaded 35085 existing records from primary storage. [2025-09-29T02:06:35.239981] [INFO ] [MAIN ] PX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:35.240163] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PX took 0.6s. Estimated remaining: 3m 15s. Rate: 190.0 symbols/min [2025-09-29T02:06:35.384692] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.494511] [DEBUG] [LOCAL ] QBTS: Loaded 54526 existing records from primary storage. [2025-09-29T02:06:35.537044] [INFO ] [MAIN ] QBTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:35.548072] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. QBTS took 0.9s. Estimated remaining: 3m 14s. Rate: 190.0 symbols/min [2025-09-29T02:06:35.589877] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.605466] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-29T02:06:35.662075] [DEBUG] [LOCAL ] QD: Loaded 28475 existing records from primary storage. [2025-09-29T02:06:35.700839] [INFO ] [MAIN ] QD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:35.701304] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QD took 0.6s. Estimated remaining: 3m 14s. Rate: 190.1 symbols/min [2025-09-29T02:06:35.927484] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.927758] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-29T02:06:36.013907] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:36.033784] [DEBUG] [LOCAL ] QGEN: Loaded 49874 existing records from primary storage. [2025-09-29T02:06:36.034913] [INFO ] [MAIN ] QGEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:36.035093] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QGEN took 0.8s. Estimated remaining: 3m 14s. Rate: 190.1 symbols/min [2025-09-29T02:06:36.119792] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-29T02:06:36.121564] [INFO ] [MAIN ] QS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:36.122510] [DEBUG] [LOCAL ] QSR: Loaded 53178 existing records from primary storage. [2025-09-29T02:06:36.123285] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QS took 0.6s. Estimated remaining: 3m 13s. Rate: 190.2 symbols/min [2025-09-29T02:06:36.123679] [INFO ] [MAIN ] QSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:36.123890] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QSR took 0.4s. Estimated remaining: 3m 13s. Rate: 190.3 symbols/min [2025-09-29T02:06:36.400060] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-29T02:06:36.603251] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:06:37.200066] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-29T02:06:37.404188] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:06:38.000060] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-29T02:06:38.202394] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:06:38.203463] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-09-29T02:06:38.203596] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-29T02:06:38.398741] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-29T02:06:38.399028] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:38.399105] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:38.399187] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-29T02:06:38.399294] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-29T02:06:38.399372] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-29T02:06:38.399432] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-29T02:06:38.399534] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. PRVS took 8.9s. Estimated remaining: 3m 13s. Rate: 189.6 symbols/min [2025-09-29T02:06:39.233861] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.186892] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.232071] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.191502] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.249048] [DEBUG] [LOCAL ] QVCD: Loaded 4542 existing records from primary storage. [2025-09-29T02:06:39.249585] [INFO ] [MAIN ] QVCD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:39.249817] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 0.8s. Estimated remaining: 3m 13s. Rate: 189.4 symbols/min [2025-09-29T02:06:39.337969] [DEBUG] [LOCAL ] QVCC: Loaded 9018 existing records from primary storage. [2025-09-29T02:06:39.392074] [INFO ] [MAIN ] QVCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:39.460009] [DEBUG] [LOCAL ] QUAD: Loaded 23938 existing records from primary storage. [2025-09-29T02:06:39.440364] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCC took 1.0s. Estimated remaining: 3m 13s. Rate: 189.5 symbols/min [2025-09-29T02:06:39.514492] [INFO ] [MAIN ] QUAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:39.521390] [DEBUG] [LOCAL ] QTWO: Loaded 39754 existing records from primary storage. [2025-09-29T02:06:39.502271] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.531249] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 12s. Rate: 189.6 symbols/min [2025-09-29T02:06:39.551218] [INFO ] [MAIN ] QTWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:39.588691] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 12s. Rate: 189.6 symbols/min [2025-09-29T02:06:39.943364] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.105801] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.127462] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.155361] [DEBUG] [LOCAL ] QXO: Loaded 53964 existing records from primary storage. [2025-09-29T02:06:40.156343] [INFO ] [MAIN ] QXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:40.156490] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. QXO took 0.9s. Estimated remaining: 3m 12s. Rate: 189.6 symbols/min [2025-09-29T02:06:40.250867] [DEBUG] [LOCAL ] R: Loaded 29775 existing records from primary storage. [2025-09-29T02:06:40.293896] [INFO ] [MAIN ] R: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:40.304563] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. R took 0.8s. Estimated remaining: 3m 11s. Rate: 189.6 symbols/min [2025-09-29T02:06:40.398535] [DEBUG] [LOCAL ] RA: Loaded 22045 existing records from primary storage. [2025-09-29T02:06:40.453439] [DEBUG] [LOCAL ] RACE: Loaded 33300 existing records from primary storage. [2025-09-29T02:06:40.461935] [INFO ] [MAIN ] RA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:40.452230] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.476625] [INFO ] [MAIN ] RACE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:40.487501] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RACE took 0.9s. Estimated remaining: 3m 11s. Rate: 189.7 symbols/min [2025-09-29T02:06:40.504936] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RA took 1.0s. Estimated remaining: 3m 11s. Rate: 189.8 symbols/min [2025-09-29T02:06:40.832277] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.941110] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:41.021917] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:41.023968] [DEBUG] [LOCAL ] RAMP: Loaded 38208 existing records from primary storage. [2025-09-29T02:06:41.024600] [INFO ] [MAIN ] RAMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.025168] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RAMP took 0.9s. Estimated remaining: 3m 10s. Rate: 189.7 symbols/min [2025-09-29T02:06:41.184186] [DEBUG] [LOCAL ] RBC: Loaded 15326 existing records from primary storage. [2025-09-29T02:06:41.217196] [INFO ] [MAIN ] RBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.267619] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 0.8s. Estimated remaining: 3m 10s. Rate: 189.7 symbols/min [2025-09-29T02:06:41.300174] [DEBUG] [LOCAL ] RBA: Loaded 46598 existing records from primary storage. [2025-09-29T02:06:41.334588] [INFO ] [MAIN ] RBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.335185] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBA took 1.0s. Estimated remaining: 3m 10s. Rate: 189.8 symbols/min [2025-09-29T02:06:41.323536] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:41.468450] [DEBUG] [LOCAL ] RBLX: Loaded 54496 existing records from primary storage. [2025-09-29T02:06:41.490214] [INFO ] [MAIN ] RBLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.517110] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBLX took 1.0s. Estimated remaining: 3m 9s. Rate: 189.8 symbols/min [2025-09-29T02:06:41.530982] [DEBUG] [LOCAL ] RBOT: Loaded 5223 existing records from primary storage. [2025-09-29T02:06:41.600212] [INFO ] [MAIN ] RBOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.673273] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBOT took 0.6s. Estimated remaining: 3m 9s. Rate: 189.9 symbols/min [2025-09-29T02:06:41.987883] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:41.998919] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:42.166423] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:42.234690] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:42.234963] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-29T02:06:42.235373] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-29T02:06:42.235707] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-29T02:06:42.235594] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-29T02:06:42.236054] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-29T02:06:42.236171] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-29T02:06:42.236471] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-29T02:06:42.236705] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-29T02:06:42.236789] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-29T02:06:42.236982] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-29T02:06:42.242425] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-29T02:06:42.274104] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-29T02:06:42.574555] [DEBUG] [LOCAL ] RBRK: Loaded 53892 existing records from primary storage. [2025-09-29T02:06:42.658268] [DEBUG] [LOCAL ] RC: Loaded 49676 existing records from primary storage. [2025-09-29T02:06:42.658496] [INFO ] [MAIN ] RBRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:42.706956] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RBRK took 1.4s. Estimated remaining: 3m 9s. Rate: 189.7 symbols/min [2025-09-29T02:06:42.716611] [INFO ] [MAIN ] RC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:42.799888] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RC took 1.5s. Estimated remaining: 3m 8s. Rate: 189.7 symbols/min [2025-09-29T02:06:43.342544] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:43.462726] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-29T02:06:43.472999] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:43.459253] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:43.490899] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-29T02:06:43.559508] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:43.625084] [DEBUG] [LOCAL ] RCL: Loaded 52876 existing records from primary storage. [2025-09-29T02:06:43.638119] [INFO ] [MAIN ] RCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:43.639398] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RCL took 0.8s. Estimated remaining: 3m 8s. Rate: 189.6 symbols/min [2025-09-29T02:06:43.645542] [DEBUG] [LOCAL ] RCI: Loaded 49383 existing records from primary storage. [2025-09-29T02:06:43.673751] [INFO ] [MAIN ] RCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:43.719418] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCI took 0.9s. Estimated remaining: 3m 8s. Rate: 189.6 symbols/min [2025-09-29T02:06:43.806513] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-29T02:06:43.891433] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-29T02:06:43.964533] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:43.999776] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-29T02:06:44.028765] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-29T02:06:44.071203] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:44.078279] [DEBUG] [LOCAL ] RCS: Loaded 11593 existing records from primary storage. [2025-09-29T02:06:44.078634] [INFO ] [MAIN ] RCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:44.078760] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 0.4s. Estimated remaining: 3m 8s. Rate: 189.6 symbols/min [2025-09-29T02:06:44.302692] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:44.308074] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-29T02:06:44.309915] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-29T02:06:44.336927] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-29T02:06:44.339759] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-29T02:06:44.342768] [DEBUG] [LOCAL ] RCUS: Loaded 43206 existing records from primary storage. [2025-09-29T02:06:44.343485] [INFO ] [MAIN ] RCUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:44.343678] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCUS took 0.6s. Estimated remaining: 3m 7s. Rate: 189.6 symbols/min [2025-09-29T02:06:44.564356] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:44.598199] [DEBUG] [LOCAL ] RDDT: Loaded 54563 existing records from primary storage. [2025-09-29T02:06:44.598780] [INFO ] [MAIN ] RDDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:44.599945] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RDDT took 0.5s. Estimated remaining: 3m 7s. Rate: 189.7 symbols/min [2025-09-29T02:06:44.726334] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T02:06:44.744846] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-29T02:06:44.829129] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:44.829363] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T02:06:44.832703] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-29T02:06:44.859283] [DEBUG] [LOCAL ] RDN: Loaded 45976 existing records from primary storage. [2025-09-29T02:06:44.859908] [INFO ] [MAIN ] RDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:44.860030] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RDN took 0.5s. Estimated remaining: 3m 7s. Rate: 189.7 symbols/min [2025-09-29T02:06:45.081501] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:45.088356] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T02:06:45.112275] [DEBUG] [LOCAL ] RDW: Loaded 52794 existing records from primary storage. [2025-09-29T02:06:45.112842] [INFO ] [MAIN ] RDW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:45.113022] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDW took 0.5s. Estimated remaining: 3m 6s. Rate: 189.7 symbols/min [2025-09-29T02:06:45.200994] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-29T02:06:45.370696] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T02:06:45.376569] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:45.381670] [DEBUG] [LOCAL ] RDY: Loaded 47418 existing records from primary storage. [2025-09-29T02:06:45.382527] [INFO ] [MAIN ] RDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:45.382667] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDY took 0.5s. Estimated remaining: 3m 6s. Rate: 189.7 symbols/min [2025-09-29T02:06:45.573254] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:45.608396] [DEBUG] [LOCAL ] RELX: Loaded 48567 existing records from primary storage. [2025-09-29T02:06:45.608873] [INFO ] [MAIN ] RELX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:45.609341] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RELX took 0.5s. Estimated remaining: 3m 6s. Rate: 189.7 symbols/min [2025-09-29T02:06:45.718963] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T02:06:45.808144] [DEBUG] [LOCAL ] RERE: Loaded 41690 existing records from primary storage. [2025-09-29T02:06:45.845211] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:45.845699] [INFO ] [MAIN ] RERE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:45.846276] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RERE took 0.5s. Estimated remaining: 3m 5s. Rate: 189.8 symbols/min [2025-09-29T02:06:46.007409] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-29T02:06:46.058890] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.080697] [DEBUG] [LOCAL ] RES: Loaded 48190 existing records from primary storage. [2025-09-29T02:06:46.081168] [INFO ] [MAIN ] RES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.081292] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RES took 0.5s. Estimated remaining: 3m 5s. Rate: 189.8 symbols/min [2025-09-29T02:06:46.299807] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.302414] [DEBUG] [LOCAL ] REVG: Loaded 41461 existing records from primary storage. [2025-09-29T02:06:46.302855] [INFO ] [MAIN ] REVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.303017] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. REVG took 0.5s. Estimated remaining: 3m 5s. Rate: 189.8 symbols/min [2025-09-29T02:06:46.436459] [DEBUG] [LOCAL ] REX: Loaded 14221 existing records from primary storage. [2025-09-29T02:06:46.473296] [INFO ] [MAIN ] REX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.482693] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. REX took 0.4s. Estimated remaining: 3m 4s. Rate: 189.9 symbols/min [2025-09-29T02:06:46.482346] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T02:06:46.529316] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.695267] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.739729] [DEBUG] [LOCAL ] REXR: Loaded 52852 existing records from primary storage. [2025-09-29T02:06:46.740249] [INFO ] [MAIN ] REXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.740354] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REXR took 0.4s. Estimated remaining: 3m 4s. Rate: 189.9 symbols/min [2025-09-29T02:06:46.802460] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-29T02:06:46.933750] [DEBUG] [LOCAL ] REZI: Loaded 47576 existing records from primary storage. [2025-09-29T02:06:46.962083] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.962329] [INFO ] [MAIN ] REZI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.962713] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REZI took 0.5s. Estimated remaining: 3m 4s. Rate: 189.9 symbols/min [2025-09-29T02:06:47.158915] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:47.200455] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-29T02:06:47.205751] [DEBUG] [LOCAL ] RFI: Loaded 10550 existing records from primary storage. [2025-09-29T02:06:47.206024] [INFO ] [MAIN ] RF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:47.206332] [INFO ] [MAIN ] RFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:47.206592] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. RF took 0.5s. Estimated remaining: 3m 3s. Rate: 190.0 symbols/min [2025-09-29T02:06:47.207270] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. RFI took 0.2s. Estimated remaining: 3m 3s. Rate: 190.1 symbols/min [2025-09-29T02:06:47.248044] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T02:06:47.593195] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:47.597255] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:47.600045] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-29T02:06:47.606175] [DEBUG] [LOCAL ] RFM: Loaded 4196 existing records from primary storage. [2025-09-29T02:06:47.606632] [INFO ] [MAIN ] RFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:47.607096] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RFM took 0.4s. Estimated remaining: 3m 2s. Rate: 190.0 symbols/min [2025-09-29T02:06:47.721483] [DEBUG] [LOCAL ] RFL: Loaded 11051 existing records from primary storage. [2025-09-29T02:06:47.733703] [INFO ] [MAIN ] RFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:47.733903] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFL took 0.5s. Estimated remaining: 3m 2s. Rate: 190.1 symbols/min [2025-09-29T02:06:47.912188] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:47.981991] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-29T02:06:48.023302] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:48.027987] [DEBUG] [LOCAL ] RFMZ: Loaded 8822 existing records from primary storage. [2025-09-29T02:06:48.028785] [INFO ] [MAIN ] RFMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:48.028896] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFMZ took 0.4s. Estimated remaining: 3m 2s. Rate: 190.1 symbols/min [2025-09-29T02:06:48.250239] [DEBUG] [LOCAL ] RGA: Loaded 30535 existing records from primary storage. [2025-09-29T02:06:48.249264] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:48.251074] [INFO ] [MAIN ] RGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:48.251520] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RGA took 0.5s. Estimated remaining: 3m 1s. Rate: 190.1 symbols/min [2025-09-29T02:06:48.418747] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-29T02:06:48.434558] [DEBUG] [LOCAL ] RGR: Loaded 20706 existing records from primary storage. [2025-09-29T02:06:48.460181] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:48.460695] [INFO ] [MAIN ] RGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:48.461397] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RGR took 0.4s. Estimated remaining: 3m 1s. Rate: 190.2 symbols/min [2025-09-29T02:06:48.467496] [DEBUG] [LOCAL ] RGT: Loaded 2885 existing records from primary storage. [2025-09-29T02:06:48.467828] [INFO ] [MAIN ] RGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:48.468127] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGT took 0.2s. Estimated remaining: 3m 1s. Rate: 190.3 symbols/min [2025-09-29T02:06:48.810300] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T02:06:49.200078] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-29T02:06:49.480037] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T02:06:50.000070] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-29T02:06:50.205557] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:06:50.800105] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-29T02:06:51.160772] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T02:06:51.600070] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-29T02:06:51.959689] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T02:06:52.400086] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-29T02:06:52.759151] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T02:06:52.760770] [INFO ] [REMOTE ] RCD: Full fetch complete (6867 records). [2025-09-29T02:06:52.760988] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-29T02:06:52.959718] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:06:52.959978] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:52.960053] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:52.960213] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-29T02:06:52.960310] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-29T02:06:52.960406] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-29T02:06:52.960545] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-29T02:06:52.960668] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RCD took 11.2s. Estimated remaining: 3m 2s. Rate: 188.9 symbols/min [2025-09-29T02:06:53.200120] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-29T02:06:53.407297] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-29T02:06:54.000089] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-29T02:06:54.215909] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-29T02:06:54.222041] [INFO ] [REMOTE ] RCB: Full fetch complete (3747 records). [2025-09-29T02:06:54.222187] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-29T02:06:54.421944] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:06:54.422185] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:54.422264] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:54.422339] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-29T02:06:54.422434] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-29T02:06:54.422508] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-29T02:06:54.422627] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-29T02:06:54.422824] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RCB took 12.9s. Estimated remaining: 3m 2s. Rate: 188.5 symbols/min [2025-09-29T02:06:55.033784] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:55.199774] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:55.178424] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-29T02:06:55.163629] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:55.229355] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:55.227136] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-29T02:06:55.229965] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-29T02:06:55.230957] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-29T02:06:55.231164] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-29T02:06:55.231233] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-29T02:06:55.628534] [DEBUG] [LOCAL ] RH: Loaded 48340 existing records from primary storage. [2025-09-29T02:06:55.629911] [DEBUG] [LOCAL ] RHI: Loaded 49995 existing records from primary storage. [2025-09-29T02:06:55.631766] [DEBUG] [LOCAL ] RHP: Loaded 42305 existing records from primary storage. [2025-09-29T02:06:55.637465] [INFO ] [MAIN ] RHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:55.637369] [INFO ] [MAIN ] RH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:55.674462] [INFO ] [MAIN ] RHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:55.731396] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RH took 1.3s. Estimated remaining: 3m 2s. Rate: 188.2 symbols/min [2025-09-29T02:06:55.761169] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:55.771813] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHI took 1.3s. Estimated remaining: 3m 1s. Rate: 188.3 symbols/min [2025-09-29T02:06:55.815478] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-29T02:06:55.843672] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RHP took 1.3s. Estimated remaining: 3m 1s. Rate: 188.3 symbols/min [2025-09-29T02:06:56.068049] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:56.152995] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-29T02:06:56.183977] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:56.200960] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-09-29T02:06:56.178718] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:56.223134] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:56.229981] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-29T02:06:56.235310] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-29T02:06:56.235437] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-29T02:06:56.335377] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:56.335562] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-29T02:06:56.346904] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHLD took 1.9s. Estimated remaining: 3m 1s. Rate: 188.3 symbols/min [2025-09-29T02:06:56.399714] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:56.637144] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:56.656571] [DEBUG] [LOCAL ] RIG: Loaded 54449 existing records from primary storage. [2025-09-29T02:06:56.657733] [INFO ] [MAIN ] RIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:56.658795] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIG took 0.9s. Estimated remaining: 3m 0s. Rate: 188.3 symbols/min [2025-09-29T02:06:56.828110] [DEBUG] [LOCAL ] RIO: Loaded 54173 existing records from primary storage. [2025-09-29T02:06:56.826791] [DEBUG] [LOCAL ] RIV: Loaded 12193 existing records from primary storage. [2025-09-29T02:06:56.850877] [INFO ] [MAIN ] RIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:56.851304] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RIO took 1.0s. Estimated remaining: 3m 0s. Rate: 188.3 symbols/min [2025-09-29T02:06:56.867867] [INFO ] [MAIN ] RIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:56.873437] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RIV took 0.5s. Estimated remaining: 2m 60s. Rate: 188.4 symbols/min [2025-09-29T02:06:56.976490] [DEBUG] [LOCAL ] RITM: Loaded 53589 existing records from primary storage. [2025-09-29T02:06:57.005297] [INFO ] [MAIN ] RITM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.074297] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:57.053807] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RITM took 1.2s. Estimated remaining: 2m 59s. Rate: 188.5 symbols/min [2025-09-29T02:06:57.493921] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:57.469117] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:57.616869] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:57.639578] [DEBUG] [LOCAL ] RJF: Loaded 47804 existing records from primary storage. [2025-09-29T02:06:57.640482] [INFO ] [MAIN ] RJF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.640630] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RJF took 1.0s. Estimated remaining: 2m 59s. Rate: 188.4 symbols/min [2025-09-29T02:06:57.880742] [DEBUG] [LOCAL ] RL: Loaded 41998 existing records from primary storage. [2025-09-29T02:06:57.886571] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-29T02:06:57.897778] [INFO ] [MAIN ] RLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.911979] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RLI took 0.8s. Estimated remaining: 2m 59s. Rate: 188.4 symbols/min [2025-09-29T02:06:57.897977] [INFO ] [MAIN ] RL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.911507] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-09-29T02:06:57.980526] [INFO ] [MAIN ] RKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.958207] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RL took 1.1s. Estimated remaining: 2m 58s. Rate: 188.5 symbols/min [2025-09-29T02:06:58.006374] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RKT took 1.1s. Estimated remaining: 2m 58s. Rate: 188.6 symbols/min [2025-09-29T02:06:57.984793] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:58.473893] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:58.453901] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:58.551040] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:58.575506] [DEBUG] [LOCAL ] RLJ: Loaded 48922 existing records from primary storage. [2025-09-29T02:06:58.576230] [INFO ] [MAIN ] RLJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:58.581695] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 0.9s. Estimated remaining: 2m 58s. Rate: 188.5 symbols/min [2025-09-29T02:06:58.584495] [DEBUG] [LOCAL ] RLTY: Loaded 11255 existing records from primary storage. [2025-09-29T02:06:58.629194] [INFO ] [MAIN ] RLTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:58.629854] [DEBUG] [LOCAL ] RM: Loaded 7734 existing records from primary storage. [2025-09-29T02:06:58.651723] [INFO ] [MAIN ] RM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:58.666183] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RM took 0.7s. Estimated remaining: 2m 57s. Rate: 188.6 symbols/min [2025-09-29T02:06:58.699845] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RLTY took 0.8s. Estimated remaining: 2m 57s. Rate: 188.7 symbols/min [2025-09-29T02:06:59.050591] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.039058] [DEBUG] [LOCAL ] RLX: Loaded 48987 existing records from primary storage. [2025-09-29T02:06:59.109593] [INFO ] [MAIN ] RLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.125516] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RLX took 1.1s. Estimated remaining: 2m 57s. Rate: 188.6 symbols/min [2025-09-29T02:06:59.166536] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.260425] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.356969] [DEBUG] [LOCAL ] RMI: Loaded 4716 existing records from primary storage. [2025-09-29T02:06:59.384278] [DEBUG] [LOCAL ] RMAX: Loaded 22121 existing records from primary storage. [2025-09-29T02:06:59.400974] [INFO ] [MAIN ] RMAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.378170] [INFO ] [MAIN ] RMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.407693] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMI took 0.7s. Estimated remaining: 2m 56s. Rate: 188.6 symbols/min [2025-09-29T02:06:59.434772] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMAX took 0.9s. Estimated remaining: 2m 56s. Rate: 188.7 symbols/min [2025-09-29T02:06:59.451218] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.770255] [DEBUG] [LOCAL ] RMM: Loaded 10624 existing records from primary storage. [2025-09-29T02:06:59.766067] [DEBUG] [LOCAL ] RMD: Loaded 42855 existing records from primary storage. [2025-09-29T02:06:59.801578] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.802007] [INFO ] [MAIN ] RMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.831416] [INFO ] [MAIN ] RMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.831798] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMM took 0.7s. Estimated remaining: 2m 56s. Rate: 188.7 symbols/min [2025-09-29T02:06:59.862758] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.868582] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMD took 1.2s. Estimated remaining: 2m 55s. Rate: 188.8 symbols/min [2025-09-29T02:06:59.944008] [DEBUG] [LOCAL ] RMMZ: Loaded 4875 existing records from primary storage. [2025-09-29T02:06:59.986873] [INFO ] [MAIN ] RMMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:00.063596] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMMZ took 0.6s. Estimated remaining: 2m 55s. Rate: 188.8 symbols/min [2025-09-29T02:07:00.137885] [DEBUG] [LOCAL ] RMT: Loaded 17682 existing records from primary storage. [2025-09-29T02:07:00.216667] [INFO ] [MAIN ] RMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:00.363881] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.395013] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.373536] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 0.9s. Estimated remaining: 2m 54s. Rate: 188.8 symbols/min [2025-09-29T02:07:00.611922] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.636241] [DEBUG] [LOCAL ] RNGR: Loaded 20653 existing records from primary storage. [2025-09-29T02:07:00.664876] [INFO ] [MAIN ] RNGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:00.665153] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNGR took 0.8s. Estimated remaining: 2m 54s. Rate: 188.9 symbols/min [2025-09-29T02:07:00.724930] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.839970] [DEBUG] [LOCAL ] RNP: Loaded 15940 existing records from primary storage. [2025-09-29T02:07:00.851873] [INFO ] [MAIN ] RNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:00.883630] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNP took 0.8s. Estimated remaining: 2m 54s. Rate: 188.9 symbols/min [2025-09-29T02:07:00.928985] [DEBUG] [LOCAL ] RNG: Loaded 48830 existing records from primary storage. [2025-09-29T02:07:00.954392] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.997577] [INFO ] [MAIN ] RNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:01.003193] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNG took 1.1s. Estimated remaining: 2m 53s. Rate: 188.9 symbols/min [2025-09-29T02:07:01.218078] [DEBUG] [LOCAL ] RNR: Loaded 34623 existing records from primary storage. [2025-09-29T02:07:01.288304] [INFO ] [MAIN ] RNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:01.288137] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:01.292530] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNR took 0.9s. Estimated remaining: 2m 53s. Rate: 189.0 symbols/min [2025-09-29T02:07:01.470252] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:01.580091] [DEBUG] [LOCAL ] RNST: Loaded 37619 existing records from primary storage. [2025-09-29T02:07:01.592504] [DEBUG] [LOCAL ] ROG: Loaded 23367 existing records from primary storage. [2025-09-29T02:07:01.621494] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:01.621900] [INFO ] [MAIN ] ROG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:01.622421] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 0.7s. Estimated remaining: 2m 53s. Rate: 189.0 symbols/min [2025-09-29T02:07:01.598242] [INFO ] [MAIN ] RNST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:01.634569] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. RNST took 1.0s. Estimated remaining: 2m 52s. Rate: 189.1 symbols/min [2025-09-29T02:07:02.056881] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.073098] [DEBUG] [LOCAL ] ROK: Loaded 44522 existing records from primary storage. [2025-09-29T02:07:02.071384] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.089476] [DEBUG] [LOCAL ] ROL: Loaded 51031 existing records from primary storage. [2025-09-29T02:07:02.088312] [INFO ] [MAIN ] ROK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:02.090883] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROK took 1.1s. Estimated remaining: 2m 52s. Rate: 189.0 symbols/min [2025-09-29T02:07:02.096482] [INFO ] [MAIN ] ROL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:02.134702] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. ROL took 0.8s. Estimated remaining: 2m 52s. Rate: 189.1 symbols/min [2025-09-29T02:07:02.297443] [DEBUG] [LOCAL ] RPT: Loaded 19767 existing records from primary storage. [2025-09-29T02:07:02.407544] [INFO ] [MAIN ] RPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:02.422361] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.433930] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPT took 0.8s. Estimated remaining: 2m 51s. Rate: 189.1 symbols/min [2025-09-29T02:07:02.457519] [DEBUG] [LOCAL ] RPM: Loaded 41763 existing records from primary storage. [2025-09-29T02:07:02.547860] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.489042] [INFO ] [MAIN ] RPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:02.565715] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RPM took 0.9s. Estimated remaining: 2m 51s. Rate: 189.2 symbols/min [2025-09-29T02:07:02.975612] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.979975] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.981228] [DEBUG] [LOCAL ] RQI: Loaded 29573 existing records from primary storage. [2025-09-29T02:07:03.003681] [INFO ] [MAIN ] RQI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.006004] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RQI took 0.9s. Estimated remaining: 2m 51s. Rate: 189.1 symbols/min [2025-09-29T02:07:03.007333] [DEBUG] [LOCAL ] RRC: Loaded 53554 existing records from primary storage. [2025-09-29T02:07:03.037194] [INFO ] [MAIN ] RRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.055383] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRC took 0.9s. Estimated remaining: 2m 50s. Rate: 189.2 symbols/min [2025-09-29T02:07:03.161983] [DEBUG] [LOCAL ] RS: Loaded 25864 existing records from primary storage. [2025-09-29T02:07:03.191868] [INFO ] [MAIN ] RS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.246609] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RS took 0.7s. Estimated remaining: 2m 50s. Rate: 189.3 symbols/min [2025-09-29T02:07:03.393816] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:03.418427] [DEBUG] [LOCAL ] RRX: Loaded 41752 existing records from primary storage. [2025-09-29T02:07:03.468637] [INFO ] [MAIN ] RRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.551987] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRX took 1.1s. Estimated remaining: 2m 50s. Rate: 189.3 symbols/min [2025-09-29T02:07:03.555605] [DEBUG] [LOCAL ] RSF: Loaded 4192 existing records from primary storage. [2025-09-29T02:07:03.615563] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:03.651983] [INFO ] [MAIN ] RSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.688503] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:03.701062] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSF took 0.7s. Estimated remaining: 2m 49s. Rate: 189.3 symbols/min [2025-09-29T02:07:03.863718] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:03.925299] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-29T02:07:03.934538] [DEBUG] [LOCAL ] RSI: Loaded 47695 existing records from primary storage. [2025-09-29T02:07:03.935054] [INFO ] [MAIN ] RSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.935329] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSG took 0.8s. Estimated remaining: 2m 49s. Rate: 189.3 symbols/min [2025-09-29T02:07:03.936042] [INFO ] [MAIN ] RSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.936234] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSI took 0.6s. Estimated remaining: 2m 48s. Rate: 189.4 symbols/min [2025-09-29T02:07:03.949608] [DEBUG] [LOCAL ] RSKD: Loaded 34254 existing records from primary storage. [2025-09-29T02:07:03.949972] [INFO ] [MAIN ] RSKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.950074] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSKD took 0.4s. Estimated remaining: 2m 48s. Rate: 189.5 symbols/min [2025-09-29T02:07:04.644704] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:04.690465] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:04.744699] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:04.766531] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:04.812372] [DEBUG] [LOCAL ] RVT: Loaded 27362 existing records from primary storage. [2025-09-29T02:07:04.813151] [INFO ] [MAIN ] RVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:04.813560] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVT took 0.9s. Estimated remaining: 2m 48s. Rate: 189.4 symbols/min [2025-09-29T02:07:04.964168] [DEBUG] [LOCAL ] RTO: Loaded 40847 existing records from primary storage. [2025-09-29T02:07:05.006907] [INFO ] [MAIN ] RTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:05.008479] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RTO took 1.1s. Estimated remaining: 2m 48s. Rate: 189.4 symbols/min [2025-09-29T02:07:05.009597] [DEBUG] [LOCAL ] RTX: Loaded 54488 existing records from primary storage. [2025-09-29T02:07:05.038554] [DEBUG] [LOCAL ] RVLV: Loaded 48453 existing records from primary storage. [2025-09-29T02:07:05.038733] [INFO ] [MAIN ] RTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:05.156113] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:05.130049] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTX took 1.2s. Estimated remaining: 2m 47s. Rate: 189.5 symbols/min [2025-09-29T02:07:05.085735] [INFO ] [MAIN ] RVLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:05.204994] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RVLV took 1.2s. Estimated remaining: 2m 47s. Rate: 189.5 symbols/min [2025-09-29T02:07:05.522988] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:05.677603] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:05.695789] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-29T02:07:05.699479] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:05.700136] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-29T02:07:05.700223] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-29T02:07:05.699693] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-29T02:07:05.700466] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-29T02:07:05.700706] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-29T02:07:05.700792] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-29T02:07:05.700897] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-29T02:07:05.700988] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-29T02:07:05.700569] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-29T02:07:05.720901] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-29T02:07:05.731896] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-29T02:07:05.818033] [DEBUG] [LOCAL ] RVTY: Loaded 48199 existing records from primary storage. [2025-09-29T02:07:05.900975] [INFO ] [MAIN ] RVTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:05.931431] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RVTY took 1.1s. Estimated remaining: 2m 47s. Rate: 189.4 symbols/min [2025-09-29T02:07:06.032972] [DEBUG] [LOCAL ] RWT: Loaded 41352 existing records from primary storage. [2025-09-29T02:07:06.112345] [INFO ] [MAIN ] RWT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:06.154125] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWT took 1.1s. Estimated remaining: 2m 46s. Rate: 189.4 symbols/min [2025-09-29T02:07:06.684871] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:06.751440] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-29T02:07:06.764094] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-29T02:07:06.803798] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-29T02:07:06.838922] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-29T02:07:06.878989] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-29T02:07:06.979156] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:06.960596] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-29T02:07:06.960460] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:06.980020] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-29T02:07:07.095605] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:07.133530] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-29T02:07:07.403442] [DEBUG] [LOCAL ] RXO: Loaded 48520 existing records from primary storage. [2025-09-29T02:07:07.397833] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T02:07:07.421407] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-29T02:07:07.452799] [INFO ] [MAIN ] RXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:07.460178] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RXO took 1.2s. Estimated remaining: 2m 46s. Rate: 189.1 symbols/min [2025-09-29T02:07:07.475465] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T02:07:07.531129] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:07.548242] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-29T02:07:07.524317] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-29T02:07:07.705557] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:07.739060] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:07:07.739759] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-29T02:07:07.740002] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:07:07.740150] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-09-29T02:07:07.740224] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:07:07.740301] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-29T02:07:07.740452] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-29T02:07:07.740533] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-29T02:07:07.740675] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-29T02:07:07.740778] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWTP took 1.8s. Estimated remaining: 2m 46s. Rate: 189.1 symbols/min [2025-09-29T02:07:07.855473] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T02:07:07.875401] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-29T02:07:07.904285] [DEBUG] [LOCAL ] RY: Loaded 48606 existing records from primary storage. [2025-09-29T02:07:07.938005] [INFO ] [MAIN ] RY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:07.940590] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RY took 0.5s. Estimated remaining: 2m 46s. Rate: 189.2 symbols/min [2025-09-29T02:07:07.961185] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.054500] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T02:07:08.083771] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-29T02:07:08.171280] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.185808] [DEBUG] [LOCAL ] RYAM: Loaded 35709 existing records from primary storage. [2025-09-29T02:07:08.186263] [INFO ] [MAIN ] RYAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.186371] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RYAM took 0.4s. Estimated remaining: 2m 45s. Rate: 189.2 symbols/min [2025-09-29T02:07:08.296205] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T02:07:08.311082] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-29T02:07:08.344008] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-29T02:07:08.390297] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-29T02:07:08.411844] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.430584] [DEBUG] [LOCAL ] RYAN: Loaded 44960 existing records from primary storage. [2025-09-29T02:07:08.431141] [INFO ] [MAIN ] RYAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.431920] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RYAN took 0.5s. Estimated remaining: 2m 45s. Rate: 189.2 symbols/min [2025-09-29T02:07:08.579882] [DEBUG] [LOCAL ] RYI: Loaded 21835 existing records from primary storage. [2025-09-29T02:07:08.619077] [INFO ] [MAIN ] RYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.639444] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.639542] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYI took 0.5s. Estimated remaining: 2m 45s. Rate: 189.3 symbols/min [2025-09-29T02:07:08.697208] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-29T02:07:08.720195] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-29T02:07:08.773445] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-29T02:07:08.781980] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-29T02:07:08.856275] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.877818] [DEBUG] [LOCAL ] RZB: Loaded 6291 existing records from primary storage. [2025-09-29T02:07:08.879384] [INFO ] [MAIN ] RZB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.893129] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RZB took 0.3s. Estimated remaining: 2m 44s. Rate: 189.3 symbols/min [2025-09-29T02:07:08.894846] [DEBUG] [LOCAL ] RYN: Loaded 46335 existing records from primary storage. [2025-09-29T02:07:08.959909] [INFO ] [MAIN ] RYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.988242] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYN took 0.6s. Estimated remaining: 2m 44s. Rate: 189.3 symbols/min [2025-09-29T02:07:09.080377] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T02:07:09.186032] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T02:07:09.185850] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-29T02:07:09.217138] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-29T02:07:09.220511] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:09.306424] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:09.310756] [DEBUG] [LOCAL ] RZC: Loaded 6838 existing records from primary storage. [2025-09-29T02:07:09.311004] [INFO ] [MAIN ] RZC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:09.311107] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZC took 0.4s. Estimated remaining: 2m 44s. Rate: 189.3 symbols/min [2025-09-29T02:07:09.512842] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:09.536707] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-29T02:07:09.538509] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-29T02:07:09.539317] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T02:07:09.542282] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-29T02:07:09.566902] [DEBUG] [LOCAL ] S: Loaded 54315 existing records from primary storage. [2025-09-29T02:07:09.567373] [INFO ] [MAIN ] S: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:09.567561] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. S took 0.6s. Estimated remaining: 2m 43s. Rate: 189.4 symbols/min [2025-09-29T02:07:09.773924] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-29T02:07:09.773736] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:09.788415] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-29T02:07:09.790537] [DEBUG] [LOCAL ] SA: Loaded 43820 existing records from primary storage. [2025-09-29T02:07:09.791232] [INFO ] [MAIN ] SA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:09.791377] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. SA took 0.5s. Estimated remaining: 2m 43s. Rate: 189.4 symbols/min [2025-09-29T02:07:09.879790] [DEBUG] [LOCAL ] SABA: Loaded 9306 existing records from primary storage. [2025-09-29T02:07:09.901090] [INFO ] [MAIN ] SABA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:09.906440] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SABA took 0.3s. Estimated remaining: 2m 42s. Rate: 189.5 symbols/min [2025-09-29T02:07:09.885245] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T02:07:09.922782] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-29T02:07:10.089895] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T02:07:10.110380] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:10.117067] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-29T02:07:10.218280] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:10.246238] [DEBUG] [LOCAL ] SAFE: Loaded 30819 existing records from primary storage. [2025-09-29T02:07:10.246578] [INFO ] [MAIN ] SAFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:10.246713] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SAFE took 0.5s. Estimated remaining: 2m 42s. Rate: 189.4 symbols/min [2025-09-29T02:07:10.419033] [DEBUG] [LOCAL ] SAH: Loaded 22368 existing records from primary storage. [2025-09-29T02:07:10.455335] [INFO ] [MAIN ] SAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:10.455064] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:10.455918] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-29T02:07:10.456018] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SAH took 0.5s. Estimated remaining: 2m 42s. Rate: 189.5 symbols/min [2025-09-29T02:07:10.456205] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-29T02:07:10.473957] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-29T02:07:10.497116] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T02:07:10.502354] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-29T02:07:10.534769] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-29T02:07:10.540272] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-29T02:07:10.562110] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-29T02:07:10.575425] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-29T02:07:10.790839] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:10.801273] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-29T02:07:10.881545] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T02:07:10.925867] [INFO ] [REMOTE ] RWTN: Full fetch complete (3130 records). [2025-09-29T02:07:10.939135] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-29T02:07:11.077952] [DEBUG] [LOCAL ] SAM: Loaded 21766 existing records from primary storage. [2025-09-29T02:07:11.088205] [INFO ] [MAIN ] SAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:11.088389] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAM took 0.6s. Estimated remaining: 2m 42s. Rate: 189.4 symbols/min [2025-09-29T02:07:11.267460] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T02:07:11.362632] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:11.525946] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:11.523796] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:07:11.526358] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:11.526543] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:11.527016] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-29T02:07:11.527123] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-29T02:07:11.527200] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-29T02:07:11.527287] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-29T02:07:11.527394] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. RWTN took 6.3s. Estimated remaining: 2m 41s. Rate: 189.3 symbols/min [2025-09-29T02:07:11.603110] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-29T02:07:11.737304] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:11.777374] [DEBUG] [LOCAL ] SAN: Loaded 53774 existing records from primary storage. [2025-09-29T02:07:11.778113] [INFO ] [MAIN ] SAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:11.778297] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAN took 0.7s. Estimated remaining: 2m 41s. Rate: 189.4 symbols/min [2025-09-29T02:07:11.983526] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:12.002956] [DEBUG] [LOCAL ] SAND: Loaded 52527 existing records from primary storage. [2025-09-29T02:07:12.003477] [INFO ] [MAIN ] SAND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:12.005744] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAND took 0.5s. Estimated remaining: 2m 41s. Rate: 189.4 symbols/min [2025-09-29T02:07:12.073815] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-29T02:07:12.100280] [INFO ] [REMOTE ] RWTO: Full fetch complete (4801 records). [2025-09-29T02:07:12.130932] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-29T02:07:12.299244] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:12.403768] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-29T02:07:12.436169] [DEBUG] [LOCAL ] SAP: Loaded 50800 existing records from primary storage. [2025-09-29T02:07:12.521013] [INFO ] [MAIN ] SAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:12.515465] [DEBUG] [LOCAL ] SAR: Loaded 16382 existing records from primary storage. [2025-09-29T02:07:12.520426] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:07:12.521261] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAP took 0.7s. Estimated remaining: 2m 40s. Rate: 189.3 symbols/min [2025-09-29T02:07:12.527400] [INFO ] [MAIN ] SAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:12.527071] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:12.545159] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAR took 0.5s. Estimated remaining: 2m 40s. Rate: 189.4 symbols/min [2025-09-29T02:07:12.545006] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:12.578111] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-29T02:07:12.650718] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-29T02:07:12.686320] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-29T02:07:12.747177] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-29T02:07:12.747915] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T02:07:12.784633] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. RWTO took 7.5s. Estimated remaining: 2m 40s. Rate: 189.4 symbols/min [2025-09-29T02:07:12.976044] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:12.971529] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:13.005449] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-29T02:07:13.024751] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-29T02:07:13.048833] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-29T02:07:13.080272] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-29T02:07:13.086211] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-29T02:07:13.086411] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-29T02:07:13.222790] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:13.242230] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-29T02:07:13.242352] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-29T02:07:13.242018] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-29T02:07:13.247715] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-29T02:07:13.288427] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-29T02:07:13.294731] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-29T02:07:13.294993] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-29T02:07:13.515260] [DEBUG] [LOCAL ] SARO: Loaded 49425 existing records from primary storage. [2025-09-29T02:07:13.562262] [INFO ] [MAIN ] SARO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:13.581169] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T02:07:13.598073] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SARO took 1.1s. Estimated remaining: 2m 39s. Rate: 189.3 symbols/min [2025-09-29T02:07:14.034262] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-29T02:07:14.150386] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:14.311410] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-29T02:07:14.317601] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:14.324733] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:14.325395] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-29T02:07:14.325491] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-29T02:07:14.325617] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-29T02:07:14.325729] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-29T02:07:14.325847] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-29T02:07:14.325920] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-29T02:07:14.720239] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:14.800059] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-29T02:07:15.087247] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-29T02:07:15.600062] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-29T02:07:15.874873] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-29T02:07:16.400064] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-29T02:07:16.604691] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.20 seconds). [2025-09-29T02:07:17.200063] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-29T02:07:17.406859] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.21 seconds). [2025-09-29T02:07:18.000079] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-29T02:07:18.203913] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-09-29T02:07:18.800051] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-29T02:07:19.008469] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-29T02:07:19.600060] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-29T02:07:19.801757] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:07:20.400089] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-29T02:07:20.610099] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:07:21.200123] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-29T02:07:21.409718] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:07:22.000092] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-29T02:07:22.201373] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-09-29T02:07:22.800075] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-29T02:07:23.005582] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-29T02:07:23.600082] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-29T02:07:23.885254] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-29T02:07:24.400061] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-29T02:07:24.689173] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-29T02:07:25.200064] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-29T02:07:25.402361] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T02:07:26.000067] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-29T02:07:26.277686] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-29T02:07:26.800072] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-29T02:07:27.078098] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-29T02:07:27.600066] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-29T02:07:27.801025] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:07:28.400070] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-29T02:07:28.685445] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-29T02:07:29.200077] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-29T02:07:29.406931] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-09-29T02:07:30.000091] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-29T02:07:30.206779] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:07:30.800063] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-29T02:07:31.002926] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T02:07:31.600084] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-29T02:07:31.806962] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:07:32.400075] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-29T02:07:32.595421] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:07:33.200058] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-29T02:07:33.405251] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-29T02:07:34.000063] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-29T02:07:34.200938] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:07:34.201898] [INFO ] [REMOTE ] SAZ: Full fetch complete (1809 records). [2025-09-29T02:07:34.201993] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-29T02:07:34.405306] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:07:34.405593] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:34.405710] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:34.405832] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-29T02:07:34.405935] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-29T02:07:34.406031] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-29T02:07:34.406142] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-29T02:07:34.406253] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAZ took 20.7s. Estimated remaining: 2m 45s. Rate: 183.0 symbols/min [2025-09-29T02:07:34.588292] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:34.626472] [DEBUG] [LOCAL ] SB: Loaded 33735 existing records from primary storage. [2025-09-29T02:07:34.626902] [INFO ] [MAIN ] SB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:34.627014] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SB took 0.2s. Estimated remaining: 2m 44s. Rate: 183.0 symbols/min [2025-09-29T02:07:34.809270] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-29T02:07:34.814694] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:34.815837] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-29T02:07:34.815978] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-29T02:07:34.816132] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-29T02:07:34.816208] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-29T02:07:34.816296] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-29T02:07:34.816375] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-29T02:07:35.116460] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T02:07:35.201584] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:35.600065] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-29T02:07:35.808222] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:07:36.400063] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-29T02:07:36.605708] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:07:37.200087] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-29T02:07:37.404546] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T02:07:38.000058] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-29T02:07:38.116352] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:07:38.116706] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-29T02:07:38.116805] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:07:38.116912] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-09-29T02:07:38.116983] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:07:38.117062] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-29T02:07:38.117216] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-29T02:07:38.117311] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-29T02:07:38.117398] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-29T02:07:38.117501] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SBDS took 3.5s. Estimated remaining: 2m 45s. Rate: 182.1 symbols/min [2025-09-29T02:07:38.318051] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:38.371459] [DEBUG] [LOCAL ] SBH: Loaded 50565 existing records from primary storage. [2025-09-29T02:07:38.371899] [INFO ] [MAIN ] SBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:38.372002] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SBH took 0.3s. Estimated remaining: 2m 44s. Rate: 182.1 symbols/min [2025-09-29T02:07:38.557143] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:38.567503] [DEBUG] [LOCAL ] SBI: Loaded 7848 existing records from primary storage. [2025-09-29T02:07:38.567828] [INFO ] [MAIN ] SBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:38.568117] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SBI took 0.2s. Estimated remaining: 2m 44s. Rate: 182.1 symbols/min [2025-09-29T02:07:38.763552] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:38.775193] [DEBUG] [LOCAL ] SBR: Loaded 7350 existing records from primary storage. [2025-09-29T02:07:38.775524] [INFO ] [MAIN ] SBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:38.775628] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBR took 0.2s. Estimated remaining: 2m 44s. Rate: 182.2 symbols/min [2025-09-29T02:07:38.805215] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-29T02:07:38.979102] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:39.031494] [DEBUG] [LOCAL ] SBS: Loaded 50166 existing records from primary storage. [2025-09-29T02:07:39.031940] [INFO ] [MAIN ] SBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:39.032044] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBS took 0.3s. Estimated remaining: 2m 43s. Rate: 182.2 symbols/min [2025-09-29T02:07:39.099436] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-29T02:07:39.230629] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:39.249027] [DEBUG] [LOCAL ] SBSI: Loaded 14974 existing records from primary storage. [2025-09-29T02:07:39.249361] [INFO ] [MAIN ] SBSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:39.249604] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBSI took 0.2s. Estimated remaining: 2m 43s. Rate: 182.2 symbols/min [2025-09-29T02:07:39.441142] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:39.499566] [DEBUG] [LOCAL ] SBSW: Loaded 53745 existing records from primary storage. [2025-09-29T02:07:39.500086] [INFO ] [MAIN ] SBSW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:39.500203] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBSW took 0.3s. Estimated remaining: 2m 43s. Rate: 182.2 symbols/min [2025-09-29T02:07:39.600059] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-29T02:07:39.806844] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-29T02:07:40.400083] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-29T02:07:40.597953] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:07:40.598851] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-09-29T02:07:40.598975] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-29T02:07:40.599423] [FATAL] [VALIDATOR ] SAJ: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:07:40.599509] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:40.599597] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:40.599701] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-29T02:07:40.599851] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-29T02:07:40.599943] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-29T02:07:40.600057] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-29T02:07:40.600157] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SAJ took 30.4s. Estimated remaining: 2m 43s. Rate: 182.0 symbols/min [2025-09-29T02:07:41.200069] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-29T02:07:41.402884] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:07:42.000071] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-29T02:07:42.200850] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:07:42.201874] [INFO ] [REMOTE ] SAT: Full fetch complete (1599 records). [2025-09-29T02:07:42.201976] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-29T02:07:42.411412] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T02:07:42.411629] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:42.411724] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:42.411812] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-29T02:07:42.411957] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-29T02:07:42.412035] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-29T02:07:42.412141] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-29T02:07:42.412258] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SAT took 29.9s. Estimated remaining: 2m 43s. Rate: 181.6 symbols/min [2025-09-29T02:07:42.800088] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-29T02:07:42.996471] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:07:43.600072] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-29T02:07:43.824289] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-29T02:07:44.400071] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-29T02:07:44.611487] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-29T02:07:44.612368] [INFO ] [REMOTE ] SAY: Full fetch complete (1412 records). [2025-09-29T02:07:44.612475] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-29T02:07:44.816983] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-29T02:07:44.817221] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:44.817311] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:44.817403] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-29T02:07:44.817520] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-29T02:07:44.817606] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-29T02:07:44.817744] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-29T02:07:44.817893] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SAY took 32.0s. Estimated remaining: 2m 43s. Rate: 181.0 symbols/min [2025-09-29T02:07:45.530407] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:45.560297] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:45.597483] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:45.597878] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-29T02:07:45.626137] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:45.628606] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-29T02:07:45.629188] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-29T02:07:45.629588] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-29T02:07:45.629956] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-29T02:07:45.630157] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-29T02:07:45.721828] [DEBUG] [LOCAL ] SCD: Loaded 12749 existing records from primary storage. [2025-09-29T02:07:45.727953] [INFO ] [MAIN ] SCD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:45.744984] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 0.9s. Estimated remaining: 2m 43s. Rate: 180.8 symbols/min [2025-09-29T02:07:46.182518] [DEBUG] [LOCAL ] SCCO: Loaded 50148 existing records from primary storage. [2025-09-29T02:07:46.241943] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-29T02:07:46.242166] [INFO ] [MAIN ] SCCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.258349] [INFO ] [MAIN ] SCHW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.240089] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:46.269059] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCCO took 1.5s. Estimated remaining: 2m 42s. Rate: 180.7 symbols/min [2025-09-29T02:07:46.290691] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCHW took 1.5s. Estimated remaining: 2m 42s. Rate: 180.8 symbols/min [2025-09-29T02:07:46.371482] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:46.430456] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-29T02:07:46.686083] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:46.726513] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:46.725339] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-29T02:07:46.728355] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-29T02:07:46.748287] [DEBUG] [LOCAL ] SCI: Loaded 47257 existing records from primary storage. [2025-09-29T02:07:46.748989] [INFO ] [MAIN ] SCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.752672] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCI took 1.0s. Estimated remaining: 2m 42s. Rate: 180.8 symbols/min [2025-09-29T02:07:46.841029] [DEBUG] [LOCAL ] SCL: Loaded 15113 existing records from primary storage. [2025-09-29T02:07:46.886719] [DEBUG] [LOCAL ] SCM: Loaded 20163 existing records from primary storage. [2025-09-29T02:07:46.873203] [INFO ] [MAIN ] SCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.892237] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 0.6s. Estimated remaining: 2m 41s. Rate: 180.8 symbols/min [2025-09-29T02:07:46.892002] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.16 seconds). [2025-09-29T02:07:46.915921] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-29T02:07:46.898230] [INFO ] [MAIN ] SCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.966474] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCM took 0.6s. Estimated remaining: 2m 41s. Rate: 180.9 symbols/min [2025-09-29T02:07:47.015045] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:47.223900] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T02:07:47.313524] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:47.387305] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:47.419688] [DEBUG] [LOCAL ] SCS: Loaded 43834 existing records from primary storage. [2025-09-29T02:07:47.420239] [INFO ] [MAIN ] SCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:47.420463] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCS took 0.7s. Estimated remaining: 2m 41s. Rate: 180.9 symbols/min [2025-09-29T02:07:47.499119] [DEBUG] [LOCAL ] SDHC: Loaded 10686 existing records from primary storage. [2025-09-29T02:07:47.541838] [INFO ] [MAIN ] SDHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:47.556564] [DEBUG] [LOCAL ] SD: Loaded 29368 existing records from primary storage. [2025-09-29T02:07:47.567558] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 0.5s. Estimated remaining: 2m 40s. Rate: 180.9 symbols/min [2025-09-29T02:07:47.572973] [INFO ] [MAIN ] SD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:47.604973] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-29T02:07:47.675088] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:47.685773] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SD took 0.8s. Estimated remaining: 2m 40s. Rate: 181.0 symbols/min [2025-09-29T02:07:47.859351] [DEBUG] [LOCAL ] SDHY: Loaded 10710 existing records from primary storage. [2025-09-29T02:07:47.907072] [INFO ] [MAIN ] SDHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:47.918690] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHY took 0.5s. Estimated remaining: 2m 39s. Rate: 181.0 symbols/min [2025-09-29T02:07:47.974934] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-29T02:07:48.012277] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:48.112427] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:48.238787] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:48.272545] [DEBUG] [LOCAL ] SDRL: Loaded 42459 existing records from primary storage. [2025-09-29T02:07:48.272976] [INFO ] [MAIN ] SDRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:48.273094] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SDRL took 0.7s. Estimated remaining: 2m 39s. Rate: 181.0 symbols/min [2025-09-29T02:07:48.415433] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-29T02:07:48.489608] [DEBUG] [LOCAL ] SE: Loaded 54140 existing records from primary storage. [2025-09-29T02:07:48.506259] [INFO ] [MAIN ] SE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:48.506629] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SE took 0.8s. Estimated remaining: 2m 39s. Rate: 181.0 symbols/min [2025-09-29T02:07:48.554044] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:48.590116] [DEBUG] [LOCAL ] SEE: Loaded 49069 existing records from primary storage. [2025-09-29T02:07:48.620889] [INFO ] [MAIN ] SEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:48.621023] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:07:48.660778] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SEE took 0.7s. Estimated remaining: 2m 38s. Rate: 181.1 symbols/min [2025-09-29T02:07:48.707538] [DEBUG] [LOCAL ] SEG: Loaded 13887 existing records from primary storage. [2025-09-29T02:07:48.758321] [INFO ] [MAIN ] SEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:48.813851] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEG took 0.5s. Estimated remaining: 2m 38s. Rate: 181.1 symbols/min [2025-09-29T02:07:48.803501] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.049848] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.146454] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.191293] [DEBUG] [LOCAL ] SEI: Loaded 50411 existing records from primary storage. [2025-09-29T02:07:49.191949] [INFO ] [MAIN ] SEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:49.192090] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEI took 0.7s. Estimated remaining: 2m 38s. Rate: 181.1 symbols/min [2025-09-29T02:07:49.203839] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-29T02:07:49.336857] [DEBUG] [LOCAL ] SEM: Loaded 43533 existing records from primary storage. [2025-09-29T02:07:49.343400] [INFO ] [MAIN ] SEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:49.358323] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEM took 0.7s. Estimated remaining: 2m 37s. Rate: 181.2 symbols/min [2025-09-29T02:07:49.412789] [DEBUG] [LOCAL ] SEMR: Loaded 42184 existing records from primary storage. [2025-09-29T02:07:49.452380] [INFO ] [MAIN ] SEMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:49.460292] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-29T02:07:49.490358] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 0.7s. Estimated remaining: 2m 37s. Rate: 181.2 symbols/min [2025-09-29T02:07:49.508134] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.765915] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.851007] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.873834] [DEBUG] [LOCAL ] SFB: Loaded 4046 existing records from primary storage. [2025-09-29T02:07:49.874484] [INFO ] [MAIN ] SFB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:49.874679] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SFB took 0.4s. Estimated remaining: 2m 37s. Rate: 181.2 symbols/min [2025-09-29T02:07:50.006533] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-29T02:07:50.018725] [DEBUG] [LOCAL ] SES: Loaded 52331 existing records from primary storage. [2025-09-29T02:07:50.070799] [INFO ] [MAIN ] SES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:50.081461] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SES took 0.9s. Estimated remaining: 2m 36s. Rate: 181.3 symbols/min [2025-09-29T02:07:50.138558] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:50.178717] [DEBUG] [LOCAL ] SF: Loaded 42360 existing records from primary storage. [2025-09-29T02:07:50.206877] [INFO ] [MAIN ] SF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:50.218412] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SF took 0.8s. Estimated remaining: 2m 36s. Rate: 181.3 symbols/min [2025-09-29T02:07:50.441964] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:50.437345] [DEBUG] [LOCAL ] SFBS: Loaded 21483 existing records from primary storage. [2025-09-29T02:07:50.443089] [INFO ] [MAIN ] SFBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:50.454222] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 0.6s. Estimated remaining: 2m 36s. Rate: 181.3 symbols/min [2025-09-29T02:07:50.593802] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:50.659726] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T02:07:50.760363] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:50.778191] [DEBUG] [LOCAL ] SFL: Loaded 46026 existing records from primary storage. [2025-09-29T02:07:50.778840] [INFO ] [MAIN ] SFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:50.779086] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SFL took 0.7s. Estimated remaining: 2m 35s. Rate: 181.3 symbols/min [2025-09-29T02:07:50.802095] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-29T02:07:50.991565] [DEBUG] [LOCAL ] SG: Loaded 54227 existing records from primary storage. [2025-09-29T02:07:51.030526] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:51.045138] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-29T02:07:51.045430] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-29T02:07:51.030813] [INFO ] [MAIN ] SG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:51.045917] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-29T02:07:51.045704] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SG took 0.8s. Estimated remaining: 2m 35s. Rate: 181.4 symbols/min [2025-09-29T02:07:51.046835] [DEBUG] [LOCAL ] SGHC: Loaded 46435 existing records from primary storage. [2025-09-29T02:07:51.064984] [INFO ] [MAIN ] SGHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:51.082968] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-29T02:07:51.088469] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGHC took 0.6s. Estimated remaining: 2m 34s. Rate: 181.4 symbols/min [2025-09-29T02:07:51.097121] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-29T02:07:51.152375] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-29T02:07:51.429601] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-29T02:07:51.507911] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:51.601687] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-29T02:07:51.601592] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:51.710117] [DEBUG] [LOCAL ] SGU: Loaded 6765 existing records from primary storage. [2025-09-29T02:07:51.710784] [INFO ] [MAIN ] SGU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:51.729080] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGU took 0.7s. Estimated remaining: 2m 34s. Rate: 181.4 symbols/min [2025-09-29T02:07:52.041125] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T02:07:52.090899] [DEBUG] [LOCAL ] SHAK: Loaded 49831 existing records from primary storage. [2025-09-29T02:07:52.132192] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:52.134894] [INFO ] [MAIN ] SHAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:52.136933] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:52.137730] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SHAK took 1.0s. Estimated remaining: 2m 34s. Rate: 181.3 symbols/min [2025-09-29T02:07:52.343724] [DEBUG] [LOCAL ] SHCO: Loaded 26427 existing records from primary storage. [2025-09-29T02:07:52.347860] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:52.348345] [INFO ] [MAIN ] SHCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:52.349159] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SHCO took 0.6s. Estimated remaining: 2m 33s. Rate: 181.4 symbols/min [2025-09-29T02:07:52.405227] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-29T02:07:52.538509] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:52.587184] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-09-29T02:07:52.587677] [INFO ] [MAIN ] SHEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:52.588349] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHEL took 0.5s. Estimated remaining: 2m 33s. Rate: 181.4 symbols/min [2025-09-29T02:07:52.622946] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:07:52.643407] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-29T02:07:52.649105] [DEBUG] [LOCAL ] SHG: Loaded 27307 existing records from primary storage. [2025-09-29T02:07:52.680596] [INFO ] [MAIN ] SHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:52.680735] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:07:52.691299] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-09-29T02:07:52.686048] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHG took 0.3s. Estimated remaining: 2m 33s. Rate: 181.5 symbols/min [2025-09-29T02:07:52.698987] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:07:52.745171] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-29T02:07:52.803202] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-29T02:07:52.876546] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:52.888922] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-29T02:07:52.889809] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-29T02:07:52.895376] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SGI took 2.1s. Estimated remaining: 2m 32s. Rate: 181.5 symbols/min [2025-09-29T02:07:53.116137] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:53.220465] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:53.214900] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-29T02:07:53.243776] [DEBUG] [LOCAL ] SHO: Loaded 50552 existing records from primary storage. [2025-09-29T02:07:53.247315] [DEBUG] [LOCAL ] SHOC: Loaded 3747 existing records from primary storage. [2025-09-29T02:07:53.247742] [INFO ] [MAIN ] SHOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:53.247834] [INFO ] [MAIN ] SHO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:53.248503] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHOC took 0.5s. Estimated remaining: 2m 32s. Rate: 181.5 symbols/min [2025-09-29T02:07:53.249166] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHO took 0.7s. Estimated remaining: 2m 32s. Rate: 181.6 symbols/min [2025-09-29T02:07:53.630904] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:53.541086] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-29T02:07:53.652604] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-29T02:07:53.653933] [INFO ] [REMOTE ] SBXD: Full fetch complete (3078 records). [2025-09-29T02:07:53.655452] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:53.657624] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-29T02:07:53.655584] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-29T02:07:53.659009] [FATAL] [VALIDATOR ] SBXD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:07:53.659309] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-29T02:07:53.674593] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-29T02:07:53.673288] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:53.675242] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:53.675325] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-29T02:07:53.675559] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-29T02:07:53.675195] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-29T02:07:53.675794] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-29T02:07:53.682827] [DEBUG] [LOCAL ] SHW: Loaded 51174 existing records from primary storage. [2025-09-29T02:07:53.675852] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-29T02:07:53.700931] [INFO ] [MAIN ] SHW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:53.701723] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHW took 0.8s. Estimated remaining: 2m 31s. Rate: 181.6 symbols/min [2025-09-29T02:07:53.708439] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-29T02:07:53.744302] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SBXD took 8.9s. Estimated remaining: 2m 31s. Rate: 181.6 symbols/min [2025-09-29T02:07:54.112823] [DEBUG] [LOCAL ] SID: Loaded 42834 existing records from primary storage. [2025-09-29T02:07:54.156373] [INFO ] [MAIN ] SID: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:54.230292] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SID took 0.9s. Estimated remaining: 2m 31s. Rate: 181.6 symbols/min [2025-09-29T02:07:54.281044] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:54.530637] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:54.837034] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:54.842228] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:54.861495] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-29T02:07:54.862563] [DEBUG] [LOCAL ] SII: Loaded 23644 existing records from primary storage. [2025-09-29T02:07:54.864622] [INFO ] [MAIN ] SII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:54.866339] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 1.1s. Estimated remaining: 2m 30s. Rate: 181.5 symbols/min [2025-09-29T02:07:54.998729] [DEBUG] [LOCAL ] SIG: Loaded 47111 existing records from primary storage. [2025-09-29T02:07:55.021589] [INFO ] [MAIN ] SIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:55.039400] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SIG took 1.3s. Estimated remaining: 2m 30s. Rate: 181.5 symbols/min [2025-09-29T02:07:55.111291] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:07:55.116508] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:55.117593] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-29T02:07:55.119856] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:07:55.120003] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-09-29T02:07:55.119358] [DEBUG] [LOCAL ] SILA: Loaded 31635 existing records from primary storage. [2025-09-29T02:07:55.120105] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:07:55.120459] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-29T02:07:55.120622] [INFO ] [MAIN ] SILA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:55.121174] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 0.8s. Estimated remaining: 2m 30s. Rate: 181.6 symbols/min [2025-09-29T02:07:55.121059] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-29T02:07:55.121385] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-29T02:07:55.121667] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-29T02:07:55.121758] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SI took 1.9s. Estimated remaining: 2m 29s. Rate: 181.7 symbols/min [2025-09-29T02:07:55.162890] [DEBUG] [LOCAL ] SITC: Loaded 42233 existing records from primary storage. [2025-09-29T02:07:55.163326] [INFO ] [MAIN ] SITC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:55.163436] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 0.3s. Estimated remaining: 2m 29s. Rate: 181.8 symbols/min [2025-09-29T02:07:55.885541] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:55.887269] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:55.980638] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.000954] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.049962] [DEBUG] [LOCAL ] SJT: Loaded 22419 existing records from primary storage. [2025-09-29T02:07:56.050278] [INFO ] [MAIN ] SJT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.050366] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SJT took 0.9s. Estimated remaining: 2m 29s. Rate: 181.6 symbols/min [2025-09-29T02:07:56.167594] [DEBUG] [LOCAL ] SKE: Loaded 36252 existing records from primary storage. [2025-09-29T02:07:56.178721] [INFO ] [MAIN ] SKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.186915] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SKE took 1.0s. Estimated remaining: 2m 28s. Rate: 181.7 symbols/min [2025-09-29T02:07:56.212409] [DEBUG] [LOCAL ] SITE: Loaded 35513 existing records from primary storage. [2025-09-29T02:07:56.231005] [INFO ] [MAIN ] SITE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.267215] [DEBUG] [LOCAL ] SJM: Loaded 50877 existing records from primary storage. [2025-09-29T02:07:56.272527] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SITE took 1.1s. Estimated remaining: 2m 28s. Rate: 181.8 symbols/min [2025-09-29T02:07:56.314990] [INFO ] [MAIN ] SJM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.345768] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SJM took 1.2s. Estimated remaining: 2m 27s. Rate: 181.8 symbols/min [2025-09-29T02:07:56.615579] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.904321] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.908783] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.915930] [DEBUG] [LOCAL ] SKIL: Loaded 6395 existing records from primary storage. [2025-09-29T02:07:56.935893] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.936208] [INFO ] [MAIN ] SKIL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.937209] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKIL took 0.9s. Estimated remaining: 2m 27s. Rate: 181.8 symbols/min [2025-09-29T02:07:57.043062] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-29T02:07:57.061092] [INFO ] [MAIN ] SKLZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.087887] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKLZ took 0.9s. Estimated remaining: 2m 27s. Rate: 181.8 symbols/min [2025-09-29T02:07:57.282474] [DEBUG] [LOCAL ] SKM: Loaded 35557 existing records from primary storage. [2025-09-29T02:07:57.270535] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:57.304675] [INFO ] [MAIN ] SKM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.316254] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKM took 1.0s. Estimated remaining: 2m 27s. Rate: 181.8 symbols/min [2025-09-29T02:07:57.384277] [DEBUG] [LOCAL ] SKT: Loaded 43227 existing records from primary storage. [2025-09-29T02:07:57.448859] [INFO ] [MAIN ] SKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.503743] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKT took 1.1s. Estimated remaining: 2m 26s. Rate: 181.9 symbols/min [2025-09-29T02:07:57.552951] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:57.706637] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:57.818361] [DEBUG] [LOCAL ] SKYH: Loaded 16851 existing records from primary storage. [2025-09-29T02:07:57.819768] [DEBUG] [LOCAL ] SKY: Loaded 38305 existing records from primary storage. [2025-09-29T02:07:57.827473] [INFO ] [MAIN ] SKY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.830230] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKY took 0.9s. Estimated remaining: 2m 26s. Rate: 181.9 symbols/min [2025-09-29T02:07:57.836085] [INFO ] [MAIN ] SKYH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.836499] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKYH took 0.7s. Estimated remaining: 2m 25s. Rate: 182.0 symbols/min [2025-09-29T02:07:57.913178] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.260474] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.239056] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.296107] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-29T02:07:58.310046] [INFO ] [MAIN ] SLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:58.310355] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLB took 1.0s. Estimated remaining: 2m 25s. Rate: 181.9 symbols/min [2025-09-29T02:07:58.311367] [DEBUG] [LOCAL ] SLF: Loaded 39426 existing records from primary storage. [2025-09-29T02:07:58.346533] [INFO ] [MAIN ] SLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:58.374671] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLF took 0.8s. Estimated remaining: 2m 25s. Rate: 182.0 symbols/min [2025-09-29T02:07:58.665783] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.691271] [DEBUG] [LOCAL ] SLGN: Loaded 41039 existing records from primary storage. [2025-09-29T02:07:58.691392] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-29T02:07:58.692352] [DEBUG] [LOCAL ] SLG: Loaded 46130 existing records from primary storage. [2025-09-29T02:07:58.713793] [INFO ] [MAIN ] SLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:58.725713] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLG took 0.9s. Estimated remaining: 2m 24s. Rate: 182.0 symbols/min [2025-09-29T02:07:58.697802] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-29T02:07:58.708393] [INFO ] [MAIN ] SLGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:58.735845] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-29T02:07:58.741252] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-29T02:07:58.746605] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLGN took 0.9s. Estimated remaining: 2m 24s. Rate: 182.1 symbols/min [2025-09-29T02:07:58.749279] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-29T02:07:58.801850] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.840936] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-29T02:07:59.352472] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:59.394151] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:59.456100] [DEBUG] [LOCAL ] SLQT: Loaded 44370 existing records from primary storage. [2025-09-29T02:07:59.479541] [INFO ] [MAIN ] SLQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:59.511148] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLQT took 1.1s. Estimated remaining: 2m 24s. Rate: 182.0 symbols/min [2025-09-29T02:07:59.682583] [DEBUG] [LOCAL ] SLVM: Loaded 28332 existing records from primary storage. [2025-09-29T02:07:59.746006] [INFO ] [MAIN ] SLVM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:59.810496] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:59.821505] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 23s. Rate: 182.0 symbols/min [2025-09-29T02:07:59.822169] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-29T02:07:59.982435] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:00.003576] [DEBUG] [LOCAL ] SM: Loaded 53080 existing records from primary storage. [2025-09-29T02:08:00.024380] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-29T02:08:00.024744] [INFO ] [MAIN ] SM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:00.025206] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SM took 1.3s. Estimated remaining: 2m 23s. Rate: 182.0 symbols/min [2025-09-29T02:08:00.025767] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-29T02:08:00.121903] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-29T02:08:00.159728] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-29T02:08:00.190969] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:00.196435] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-29T02:08:00.209247] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-29T02:08:00.209509] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T02:08:00.288354] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-29T02:08:00.439793] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:00.440267] [DEBUG] [LOCAL ] SMBK: Loaded 8332 existing records from primary storage. [2025-09-29T02:08:00.468052] [INFO ] [MAIN ] SMBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:00.497764] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SMBK took 0.7s. Estimated remaining: 2m 23s. Rate: 182.0 symbols/min [2025-09-29T02:08:00.670907] [DEBUG] [LOCAL ] SMC: Loaded 11630 existing records from primary storage. [2025-09-29T02:08:00.664612] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T02:08:00.694184] [INFO ] [MAIN ] SMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:00.727350] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-29T02:08:00.732801] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SMC took 0.7s. Estimated remaining: 2m 22s. Rate: 182.0 symbols/min [2025-09-29T02:08:01.019939] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T02:08:01.050151] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-29T02:08:01.091001] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:01.078507] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:01.106781] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-29T02:08:01.189425] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:01.234713] [DEBUG] [LOCAL ] SMFG: Loaded 48771 existing records from primary storage. [2025-09-29T02:08:01.249956] [INFO ] [MAIN ] SMFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:01.250097] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMFG took 0.7s. Estimated remaining: 2m 22s. Rate: 181.9 symbols/min [2025-09-29T02:08:01.286809] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:01.316313] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-29T02:08:01.341323] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:01.358661] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-09-29T02:08:01.383004] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:01.389297] [DEBUG] [LOCAL ] SMG: Loaded 44546 existing records from primary storage. [2025-09-29T02:08:01.387467] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-29T02:08:01.403776] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T02:08:01.427462] [INFO ] [MAIN ] SMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:01.429288] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-29T02:08:01.421871] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-29T02:08:01.434745] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMG took 0.6s. Estimated remaining: 2m 22s. Rate: 182.0 symbols/min [2025-09-29T02:08:01.463895] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-29T02:08:01.580428] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-29T02:08:01.519054] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:01.597831] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMA took 2.1s. Estimated remaining: 2m 21s. Rate: 182.0 symbols/min [2025-09-29T02:08:01.826248] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T02:08:01.821540] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:01.826043] [DEBUG] [LOCAL ] SMHI: Loaded 13885 existing records from primary storage. [2025-09-29T02:08:01.843304] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-29T02:08:01.873243] [INFO ] [MAIN ] SMHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:01.913971] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMHI took 0.7s. Estimated remaining: 2m 21s. Rate: 182.0 symbols/min [2025-09-29T02:08:01.952816] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:02.080915] [DEBUG] [LOCAL ] SMP: Loaded 19999 existing records from primary storage. [2025-09-29T02:08:02.086621] [INFO ] [MAIN ] SMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:02.092280] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMP took 0.6s. Estimated remaining: 2m 21s. Rate: 182.1 symbols/min [2025-09-29T02:08:02.151255] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T02:08:02.177227] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:02.179180] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-29T02:08:02.405432] [DEBUG] [LOCAL ] SMR: Loaded 54577 existing records from primary storage. [2025-09-29T02:08:02.449575] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:02.450032] [INFO ] [MAIN ] SMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:02.450161] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMR took 0.8s. Estimated remaining: 2m 20s. Rate: 182.1 symbols/min [2025-09-29T02:08:02.495738] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-29T02:08:02.503245] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-29T02:08:02.593576] [DEBUG] [LOCAL ] SMRT: Loaded 44707 existing records from primary storage. [2025-09-29T02:08:02.609116] [INFO ] [MAIN ] SMRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:02.614938] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMRT took 0.7s. Estimated remaining: 2m 20s. Rate: 182.1 symbols/min [2025-09-29T02:08:02.705036] [DEBUG] [LOCAL ] SMWB: Loaded 33137 existing records from primary storage. [2025-09-29T02:08:02.719606] [INFO ] [MAIN ] SMWB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:02.771253] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T02:08:02.792011] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMWB took 0.6s. Estimated remaining: 2m 20s. Rate: 182.2 symbols/min [2025-09-29T02:08:02.776141] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:02.793726] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-29T02:08:03.006119] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:03.126278] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:03.128505] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T02:08:03.129764] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-29T02:08:03.172286] [DEBUG] [LOCAL ] SNA: Loaded 26608 existing records from primary storage. [2025-09-29T02:08:03.173875] [DEBUG] [LOCAL ] SN: Loaded 50487 existing records from primary storage. [2025-09-29T02:08:03.174413] [INFO ] [MAIN ] SNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:03.174883] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SNA took 0.6s. Estimated remaining: 2m 19s. Rate: 182.1 symbols/min [2025-09-29T02:08:03.175051] [INFO ] [MAIN ] SN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:03.180906] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SN took 0.7s. Estimated remaining: 2m 19s. Rate: 182.2 symbols/min [2025-09-29T02:08:03.429138] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-29T02:08:03.480676] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1060 records). [2025-09-29T02:08:03.514186] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-29T02:08:03.549136] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-29T02:08:03.592504] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:03.632891] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:03.639041] [INFO ] [MAIN ] SNAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:03.667237] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNAP took 0.9s. Estimated remaining: 2m 19s. Rate: 182.2 symbols/min [2025-09-29T02:08:03.827066] [DEBUG] [LOCAL ] SNDA: Loaded 4732 existing records from primary storage. [2025-09-29T02:08:03.833160] [INFO ] [MAIN ] SNDA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:03.885994] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNDA took 0.7s. Estimated remaining: 2m 18s. Rate: 182.2 symbols/min [2025-09-29T02:08:03.998447] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:08:04.039408] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:04.080580] [DEBUG] [LOCAL ] SNDR: Loaded 41368 existing records from primary storage. [2025-09-29T02:08:04.123894] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:04.141201] [INFO ] [MAIN ] SNDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:04.168022] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-29T02:08:04.195453] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNDR took 1.0s. Estimated remaining: 2m 18s. Rate: 182.2 symbols/min [2025-09-29T02:08:04.200266] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-29T02:08:04.200189] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:04.206060] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-29T02:08:04.212765] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-29T02:08:04.218277] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SLNZ took 5.9s. Estimated remaining: 2m 18s. Rate: 182.3 symbols/min [2025-09-29T02:08:04.378503] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:04.699482] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:04.756193] [DEBUG] [LOCAL ] SNN: Loaded 45037 existing records from primary storage. [2025-09-29T02:08:04.802620] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:04.803157] [INFO ] [MAIN ] SNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:04.804128] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNN took 1.1s. Estimated remaining: 2m 17s. Rate: 182.2 symbols/min [2025-09-29T02:08:04.937320] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-09-29T02:08:04.951702] [INFO ] [MAIN ] SNOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:04.967876] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 17s. Rate: 182.3 symbols/min [2025-09-29T02:08:05.067947] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:05.182294] [DEBUG] [LOCAL ] SNX: Loaded 40540 existing records from primary storage. [2025-09-29T02:08:05.207734] [INFO ] [MAIN ] SNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.219798] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNX took 0.9s. Estimated remaining: 2m 17s. Rate: 182.3 symbols/min [2025-09-29T02:08:05.214168] [DEBUG] [LOCAL ] SNV: Loaded 49633 existing records from primary storage. [2025-09-29T02:08:05.318702] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:05.303567] [INFO ] [MAIN ] SNV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.334704] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SNV took 1.1s. Estimated remaining: 2m 16s. Rate: 182.4 symbols/min [2025-09-29T02:08:05.501552] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:05.522286] [DEBUG] [LOCAL ] SO: Loaded 54383 existing records from primary storage. [2025-09-29T02:08:05.523170] [INFO ] [MAIN ] SO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.523312] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SO took 0.7s. Estimated remaining: 2m 16s. Rate: 182.4 symbols/min [2025-09-29T02:08:05.552730] [DEBUG] [LOCAL ] SOBO: Loaded 40211 existing records from primary storage. [2025-09-29T02:08:05.553193] [INFO ] [MAIN ] SOBO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.553909] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOBO took 0.5s. Estimated remaining: 2m 15s. Rate: 182.5 symbols/min [2025-09-29T02:08:05.596519] [DEBUG] [LOCAL ] SOC: Loaded 51041 existing records from primary storage. [2025-09-29T02:08:05.597011] [INFO ] [MAIN ] SOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.597118] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 0.4s. Estimated remaining: 2m 15s. Rate: 182.6 symbols/min [2025-09-29T02:08:06.244137] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:06.324837] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:06.387887] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:06.395567] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:06.395968] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-29T02:08:06.396321] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-29T02:08:06.396448] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-29T02:08:06.396521] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-29T02:08:06.396694] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-29T02:08:06.396858] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-29T02:08:06.423835] [DEBUG] [LOCAL ] SOJC: Loaded 5120 existing records from primary storage. [2025-09-29T02:08:06.449772] [INFO ] [MAIN ] SOJC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:06.494423] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJC took 0.9s. Estimated remaining: 2m 15s. Rate: 182.4 symbols/min [2025-09-29T02:08:06.506083] [DEBUG] [LOCAL ] SOJD: Loaded 13180 existing records from primary storage. [2025-09-29T02:08:06.534060] [DEBUG] [LOCAL ] SOJE: Loaded 9408 existing records from primary storage. [2025-09-29T02:08:06.552125] [INFO ] [MAIN ] SOJE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:06.546676] [INFO ] [MAIN ] SOJD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:06.578295] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJD took 1.0s. Estimated remaining: 2m 14s. Rate: 182.5 symbols/min [2025-09-29T02:08:06.615750] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJE took 1.0s. Estimated remaining: 2m 14s. Rate: 182.6 symbols/min [2025-09-29T02:08:07.200340] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:07.261779] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:07.407893] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:07.414226] [DEBUG] [LOCAL ] SOL: Loaded 13694 existing records from primary storage. [2025-09-29T02:08:07.439811] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-29T02:08:07.439176] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:07.441417] [INFO ] [MAIN ] SOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:07.441513] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOL took 0.9s. Estimated remaining: 2m 14s. Rate: 182.4 symbols/min [2025-09-29T02:08:07.621591] [DEBUG] [LOCAL ] SOLV: Loaded 44791 existing records from primary storage. [2025-09-29T02:08:07.627700] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:07.633761] [INFO ] [MAIN ] SOLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:07.657105] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-29T02:08:07.673027] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 14s. Rate: 182.5 symbols/min [2025-09-29T02:08:07.673145] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:07.676429] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-09-29T02:08:07.676722] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:07.680456] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-29T02:08:07.715894] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-29T02:08:07.706379] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:07.768422] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-29T02:08:07.770194] [DEBUG] [LOCAL ] SON: Loaded 43596 existing records from primary storage. [2025-09-29T02:08:07.816734] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-29T02:08:07.811309] [INFO ] [MAIN ] SON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:07.838844] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOJF took 2.2s. Estimated remaining: 2m 13s. Rate: 182.5 symbols/min [2025-09-29T02:08:07.916084] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SON took 1.2s. Estimated remaining: 2m 13s. Rate: 182.6 symbols/min [2025-09-29T02:08:07.931233] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.122485] [DEBUG] [LOCAL ] SOR: Loaded 2947 existing records from primary storage. [2025-09-29T02:08:08.189902] [INFO ] [MAIN ] SOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:08.232912] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SOR took 0.5s. Estimated remaining: 2m 12s. Rate: 182.6 symbols/min [2025-09-29T02:08:08.366894] [DEBUG] [LOCAL ] SONY: Loaded 54136 existing records from primary storage. [2025-09-29T02:08:08.377829] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.421615] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.438701] [INFO ] [MAIN ] SONY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:08.463441] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SONY took 1.0s. Estimated remaining: 2m 12s. Rate: 182.6 symbols/min [2025-09-29T02:08:08.550749] [DEBUG] [LOCAL ] SOS: Loaded 8266 existing records from primary storage. [2025-09-29T02:08:08.619265] [INFO ] [MAIN ] SOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:08.668796] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SOS took 0.8s. Estimated remaining: 2m 12s. Rate: 182.6 symbols/min [2025-09-29T02:08:08.784894] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.940602] [DEBUG] [LOCAL ] SPB: Loaded 34677 existing records from primary storage. [2025-09-29T02:08:08.923285] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.948244] [INFO ] [MAIN ] SPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:08.953048] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 1.0s. Estimated remaining: 2m 11s. Rate: 182.6 symbols/min [2025-09-29T02:08:09.125580] [DEBUG] [LOCAL ] SPE: Loaded 6441 existing records from primary storage. [2025-09-29T02:08:09.132837] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:09.148987] [INFO ] [MAIN ] SPE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.165380] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPE took 0.7s. Estimated remaining: 2m 11s. Rate: 182.7 symbols/min [2025-09-29T02:08:09.324994] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:09.361610] [DEBUG] [LOCAL ] SPCE: Loaded 50615 existing records from primary storage. [2025-09-29T02:08:09.389500] [INFO ] [MAIN ] SPCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.405978] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 11s. Rate: 182.7 symbols/min [2025-09-29T02:08:09.619954] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:09.738943] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:09.757952] [DEBUG] [LOCAL ] SPGI: Loaded 46562 existing records from primary storage. [2025-09-29T02:08:09.760661] [DEBUG] [LOCAL ] SPG: Loaded 51134 existing records from primary storage. [2025-09-29T02:08:09.761936] [INFO ] [MAIN ] SPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.761523] [INFO ] [MAIN ] SPGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.762304] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPG took 1.1s. Estimated remaining: 2m 10s. Rate: 182.7 symbols/min [2025-09-29T02:08:09.762744] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPGI took 0.8s. Estimated remaining: 2m 10s. Rate: 182.8 symbols/min [2025-09-29T02:08:09.830910] [DEBUG] [LOCAL ] SPH: Loaded 18213 existing records from primary storage. [2025-09-29T02:08:09.888571] [INFO ] [MAIN ] SPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.959298] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPH took 0.8s. Estimated remaining: 2m 10s. Rate: 182.8 symbols/min [2025-09-29T02:08:10.193199] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:10.308466] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:10.339541] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-09-29T02:08:10.369824] [INFO ] [MAIN ] SPHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:10.376180] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPHR took 1.0s. Estimated remaining: 2m 9s. Rate: 182.8 symbols/min [2025-09-29T02:08:10.482098] [DEBUG] [LOCAL ] SPMC: Loaded 5613 existing records from primary storage. [2025-09-29T02:08:10.508239] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:10.514799] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-29T02:08:10.504367] [INFO ] [MAIN ] SPMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:10.540717] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-29T02:08:10.546246] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-29T02:08:10.551554] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-29T02:08:10.546051] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPMC took 0.7s. Estimated remaining: 2m 9s. Rate: 182.8 symbols/min [2025-09-29T02:08:10.564039] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-29T02:08:10.599407] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-29T02:08:10.666872] [DEBUG] [LOCAL ] SPIR: Loaded 37871 existing records from primary storage. [2025-09-29T02:08:10.815308] [INFO ] [MAIN ] SPIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:10.905494] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:10.902885] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 9s. Rate: 182.8 symbols/min [2025-09-29T02:08:11.294269] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:11.502798] [DEBUG] [LOCAL ] SPNT: Loaded 35342 existing records from primary storage. [2025-09-29T02:08:11.495827] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:11.538516] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:11.523001] [INFO ] [MAIN ] SPNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:11.539733] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-29T02:08:11.539429] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 8s. Rate: 182.8 symbols/min [2025-09-29T02:08:11.681506] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:11.713566] [DEBUG] [LOCAL ] SPOT: Loaded 51481 existing records from primary storage. [2025-09-29T02:08:11.735306] [INFO ] [MAIN ] SPOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:11.734907] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-29T02:08:11.770452] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:11.771405] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-09-29T02:08:11.769998] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 8s. Rate: 182.8 symbols/min [2025-09-29T02:08:11.782585] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:11.785535] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-29T02:08:11.823292] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:11.828850] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-29T02:08:11.851544] [DEBUG] [LOCAL ] SPR: Loaded 41867 existing records from primary storage. [2025-09-29T02:08:11.867506] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-29T02:08:11.877335] [INFO ] [MAIN ] SPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:11.902677] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPR took 1.0s. Estimated remaining: 2m 8s. Rate: 182.8 symbols/min [2025-09-29T02:08:11.884424] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-29T02:08:11.924471] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPME took 1.8s. Estimated remaining: 2m 7s. Rate: 182.9 symbols/min [2025-09-29T02:08:11.968520] [DEBUG] [LOCAL ] SPRU: Loaded 8714 existing records from primary storage. [2025-09-29T02:08:12.071944] [INFO ] [MAIN ] SPRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:12.133323] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPRU took 0.6s. Estimated remaining: 2m 7s. Rate: 183.0 symbols/min [2025-09-29T02:08:12.204486] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:12.508805] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:12.546888] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:12.614331] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:12.629669] [DEBUG] [LOCAL ] SPXC: Loaded 23666 existing records from primary storage. [2025-09-29T02:08:12.633168] [INFO ] [MAIN ] SPXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:12.633699] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXC took 0.8s. Estimated remaining: 2m 7s. Rate: 182.9 symbols/min [2025-09-29T02:08:12.703699] [DEBUG] [LOCAL ] SPXX: Loaded 9166 existing records from primary storage. [2025-09-29T02:08:12.753133] [INFO ] [MAIN ] SPXX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:12.772788] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SPXX took 0.9s. Estimated remaining: 2m 6s. Rate: 183.0 symbols/min [2025-09-29T02:08:12.778829] [DEBUG] [LOCAL ] SQNS: Loaded 26307 existing records from primary storage. [2025-09-29T02:08:12.825959] [INFO ] [MAIN ] SQNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:12.856677] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQNS took 0.7s. Estimated remaining: 2m 6s. Rate: 183.0 symbols/min [2025-09-29T02:08:12.910233] [DEBUG] [LOCAL ] SQM: Loaded 49278 existing records from primary storage. [2025-09-29T02:08:12.996468] [INFO ] [MAIN ] SQM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:13.037127] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:13.051226] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SQM took 1.1s. Estimated remaining: 2m 6s. Rate: 183.1 symbols/min [2025-09-29T02:08:13.405480] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:13.476280] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:13.590621] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:13.593350] [DEBUG] [LOCAL ] SR: Loaded 33411 existing records from primary storage. [2025-09-29T02:08:13.595068] [INFO ] [MAIN ] SR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:13.595271] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SR took 1.0s. Estimated remaining: 2m 5s. Rate: 183.0 symbols/min [2025-09-29T02:08:13.670432] [DEBUG] [LOCAL ] SREA: Loaded 10561 existing records from primary storage. [2025-09-29T02:08:13.671059] [INFO ] [MAIN ] SREA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:13.708518] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SREA took 0.8s. Estimated remaining: 2m 5s. Rate: 183.1 symbols/min [2025-09-29T02:08:14.006357] [DEBUG] [LOCAL ] SRFM: Loaded 36431 existing records from primary storage. [2025-09-29T02:08:14.060847] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-29T02:08:14.097212] [INFO ] [MAIN ] SRFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:14.145194] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SRFM took 1.0s. Estimated remaining: 2m 5s. Rate: 183.0 symbols/min [2025-09-29T02:08:14.145458] [INFO ] [MAIN ] SRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:14.208880] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:14.220484] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRE took 1.4s. Estimated remaining: 2m 4s. Rate: 183.1 symbols/min [2025-09-29T02:08:14.445414] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:14.600455] [DEBUG] [LOCAL ] SRG: Loaded 15859 existing records from primary storage. [2025-09-29T02:08:14.647795] [INFO ] [MAIN ] SRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:14.756781] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:14.755536] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRG took 1.2s. Estimated remaining: 2m 4s. Rate: 183.0 symbols/min [2025-09-29T02:08:14.760779] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:14.783361] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-29T02:08:14.857153] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-29T02:08:14.884209] [DEBUG] [LOCAL ] SRI: Loaded 27810 existing records from primary storage. [2025-09-29T02:08:14.888289] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-29T02:08:14.888941] [INFO ] [MAIN ] SRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:14.889109] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-29T02:08:14.901604] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRI took 1.2s. Estimated remaining: 2m 4s. Rate: 183.1 symbols/min [2025-09-29T02:08:14.912234] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-29T02:08:14.933471] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-29T02:08:15.011240] [DEBUG] [LOCAL ] SRV: Loaded 7631 existing records from primary storage. [2025-09-29T02:08:15.065999] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:15.132869] [INFO ] [MAIN ] SRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:15.153690] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRV took 0.9s. Estimated remaining: 2m 3s. Rate: 183.1 symbols/min [2025-09-29T02:08:15.364135] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:15.626257] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:15.745038] [DEBUG] [LOCAL ] SSD: Loaded 22631 existing records from primary storage. [2025-09-29T02:08:15.784531] [INFO ] [MAIN ] SSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:15.794397] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SSD took 0.9s. Estimated remaining: 2m 3s. Rate: 183.0 symbols/min [2025-09-29T02:08:15.773405] [DEBUG] [LOCAL ] SSB: Loaded 43377 existing records from primary storage. [2025-09-29T02:08:15.832550] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:15.821844] [INFO ] [MAIN ] SSB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:15.843840] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-29T02:08:15.843990] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSB took 1.1s. Estimated remaining: 2m 3s. Rate: 183.1 symbols/min [2025-09-29T02:08:16.024786] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:16.039904] [DEBUG] [LOCAL ] SSL: Loaded 41830 existing records from primary storage. [2025-09-29T02:08:16.040346] [INFO ] [MAIN ] SSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:16.040458] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSL took 0.9s. Estimated remaining: 2m 2s. Rate: 183.1 symbols/min [2025-09-29T02:08:16.053696] [DEBUG] [LOCAL ] SST: Loaded 12166 existing records from primary storage. [2025-09-29T02:08:16.054037] [INFO ] [MAIN ] SST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:16.054159] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SST took 0.2s. Estimated remaining: 2m 2s. Rate: 183.2 symbols/min [2025-09-29T02:08:16.224311] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T02:08:16.225874] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-29T02:08:16.500494] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T02:08:16.501844] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-29T02:08:16.699198] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T02:08:16.700297] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-29T02:08:16.900582] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:08:16.901788] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-29T02:08:17.099172] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-29T02:08:17.100468] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-29T02:08:17.222733] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.12 seconds). [2025-09-29T02:08:17.223875] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-29T02:08:17.600844] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-29T02:08:17.602167] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-29T02:08:17.803846] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:08:17.804992] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-29T02:08:18.004411] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:08:18.005530] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-29T02:08:18.199479] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-29T02:08:18.200385] [INFO ] [REMOTE ] SRL: Full fetch complete (1966 records). [2025-09-29T02:08:18.200482] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-29T02:08:18.404076] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-29T02:08:18.404314] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:18.404391] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:18.404468] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-29T02:08:18.404566] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-29T02:08:18.404672] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-29T02:08:18.404781] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-29T02:08:18.404878] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SRL took 4.2s. Estimated remaining: 2m 2s. Rate: 182.7 symbols/min [2025-09-29T02:08:19.128402] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.155256] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.241710] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.235920] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.272565] [DEBUG] [LOCAL ] STC: Loaded 17878 existing records from primary storage. [2025-09-29T02:08:19.287923] [INFO ] [MAIN ] STC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:19.288108] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 0.9s. Estimated remaining: 2m 2s. Rate: 182.5 symbols/min [2025-09-29T02:08:19.345117] [DEBUG] [LOCAL ] SSTK: Loaded 26762 existing records from primary storage. [2025-09-29T02:08:19.372878] [INFO ] [MAIN ] SSTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:19.407086] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. SSTK took 1.0s. Estimated remaining: 2m 1s. Rate: 182.6 symbols/min [2025-09-29T02:08:19.503011] [DEBUG] [LOCAL ] STAG: Loaded 50799 existing records from primary storage. [2025-09-29T02:08:19.554020] [DEBUG] [LOCAL ] ST: Loaded 50505 existing records from primary storage. [2025-09-29T02:08:19.588790] [INFO ] [MAIN ] STAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:19.630567] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. STAG took 1.2s. Estimated remaining: 2m 1s. Rate: 182.6 symbols/min [2025-09-29T02:08:19.675968] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.645801] [INFO ] [MAIN ] ST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:19.714213] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. ST took 1.3s. Estimated remaining: 2m 1s. Rate: 182.7 symbols/min [2025-09-29T02:08:19.890695] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:20.113693] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:20.208416] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:20.210129] [DEBUG] [LOCAL ] STE: Loaded 35822 existing records from primary storage. [2025-09-29T02:08:20.211149] [INFO ] [MAIN ] STE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:20.211281] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STE took 0.9s. Estimated remaining: 2m 0s. Rate: 182.6 symbols/min [2025-09-29T02:08:20.259133] [DEBUG] [LOCAL ] STEL: Loaded 23823 existing records from primary storage. [2025-09-29T02:08:20.283994] [INFO ] [MAIN ] STEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:20.294379] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEL took 0.9s. Estimated remaining: 1m 60s. Rate: 182.7 symbols/min [2025-09-29T02:08:20.462147] [DEBUG] [LOCAL ] STEW: Loaded 16354 existing records from primary storage. [2025-09-29T02:08:20.517216] [INFO ] [MAIN ] STEW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:20.549751] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STEW took 0.7s. Estimated remaining: 1m 60s. Rate: 182.7 symbols/min [2025-09-29T02:08:20.569246] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:20.570802] [DEBUG] [LOCAL ] STEM: Loaded 40374 existing records from primary storage. [2025-09-29T02:08:20.593209] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-29T02:08:20.599279] [INFO ] [MAIN ] STEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:20.604689] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-29T02:08:20.604893] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-29T02:08:20.605006] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEM took 0.9s. Estimated remaining: 1m 59s. Rate: 182.8 symbols/min [2025-09-29T02:08:20.615713] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-29T02:08:20.641638] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-29T02:08:20.703840] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-29T02:08:20.810838] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:21.052210] [DEBUG] [LOCAL ] STK: Loaded 9550 existing records from primary storage. [2025-09-29T02:08:21.122127] [INFO ] [MAIN ] STK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:21.170918] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:21.223577] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STK took 0.9s. Estimated remaining: 1m 59s. Rate: 182.7 symbols/min [2025-09-29T02:08:21.242508] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:21.712589] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:21.752358] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:21.755183] [DEBUG] [LOCAL ] STLA: Loaded 54322 existing records from primary storage. [2025-09-29T02:08:21.753174] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-29T02:08:21.756695] [INFO ] [MAIN ] STLA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:21.757007] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STLA took 1.2s. Estimated remaining: 1m 59s. Rate: 182.7 symbols/min [2025-09-29T02:08:21.858177] [DEBUG] [LOCAL ] STM: Loaded 54362 existing records from primary storage. [2025-09-29T02:08:21.892679] [INFO ] [MAIN ] STM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:21.913803] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STM took 1.3s. Estimated remaining: 1m 58s. Rate: 182.7 symbols/min [2025-09-29T02:08:21.994942] [DEBUG] [LOCAL ] STN: Loaded 23436 existing records from primary storage. [2025-09-29T02:08:22.042408] [INFO ] [MAIN ] STN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:22.055390] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.067458] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-29T02:08:22.067702] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STN took 0.8s. Estimated remaining: 1m 58s. Rate: 182.7 symbols/min [2025-09-29T02:08:22.079329] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-29T02:08:22.329457] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.399530] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.440395] [DEBUG] [LOCAL ] STRV: Loaded 11754 existing records from primary storage. [2025-09-29T02:08:22.435916] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T02:08:22.443110] [DEBUG] [LOCAL ] STNG: Loaded 44620 existing records from primary storage. [2025-09-29T02:08:22.443408] [INFO ] [MAIN ] STRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:22.445729] [INFO ] [MAIN ] STNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:22.445181] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-29T02:08:22.445964] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STRV took 0.5s. Estimated remaining: 1m 58s. Rate: 182.7 symbols/min [2025-09-29T02:08:22.447528] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STNG took 0.7s. Estimated remaining: 1m 57s. Rate: 182.8 symbols/min [2025-09-29T02:08:22.767168] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T02:08:22.847493] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.848557] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-29T02:08:22.868939] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.885427] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-29T02:08:22.887397] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-29T02:08:22.887088] [DEBUG] [LOCAL ] STT: Loaded 51793 existing records from primary storage. [2025-09-29T02:08:22.887964] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-29T02:08:22.888104] [INFO ] [MAIN ] STT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:22.888342] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-29T02:08:22.888517] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STT took 0.8s. Estimated remaining: 1m 57s. Rate: 182.8 symbols/min [2025-09-29T02:08:22.923169] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-29T02:08:22.966620] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-29T02:08:23.192695] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T02:08:23.197183] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:23.226069] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-29T02:08:23.214090] [DEBUG] [LOCAL ] STVN: Loaded 26677 existing records from primary storage. [2025-09-29T02:08:23.228681] [INFO ] [MAIN ] STVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:23.245223] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STVN took 0.8s. Estimated remaining: 1m 57s. Rate: 182.8 symbols/min [2025-09-29T02:08:23.525415] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-29T02:08:23.583406] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-29T02:08:23.687102] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:23.781670] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:23.782437] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-29T02:08:23.784766] [DEBUG] [LOCAL ] STWD: Loaded 52643 existing records from primary storage. [2025-09-29T02:08:23.786267] [INFO ] [MAIN ] STWD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:23.788361] [DEBUG] [LOCAL ] STXD: Loaded 1341 existing records from primary storage. [2025-09-29T02:08:23.788850] [INFO ] [MAIN ] STXD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:23.788993] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STWD took 0.9s. Estimated remaining: 1m 56s. Rate: 182.7 symbols/min [2025-09-29T02:08:23.794518] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STXD took 0.5s. Estimated remaining: 1m 56s. Rate: 182.8 symbols/min [2025-09-29T02:08:23.969973] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:24.004768] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-29T02:08:24.031594] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T02:08:24.052916] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-29T02:08:24.053146] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:24.053338] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-09-29T02:08:24.065106] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:24.124782] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-29T02:08:24.221033] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-29T02:08:24.221336] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-29T02:08:24.220802] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:24.188121] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:24.221530] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-29T02:08:24.222772] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STUB took 1.8s. Estimated remaining: 1m 56s. Rate: 182.8 symbols/min [2025-09-29T02:08:24.284055] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-29T02:08:24.305177] [DEBUG] [LOCAL ] STXE: Loaded 2234 existing records from primary storage. [2025-09-29T02:08:24.323735] [INFO ] [MAIN ] STXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:24.323939] [INFO ] [MAIN ] STXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:24.362247] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXE took 0.6s. Estimated remaining: 1m 55s. Rate: 182.8 symbols/min [2025-09-29T02:08:24.366201] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T02:08:24.382818] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXG took 0.6s. Estimated remaining: 1m 55s. Rate: 182.9 symbols/min [2025-09-29T02:08:24.412761] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-29T02:08:24.645447] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:24.814375] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:24.818091] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-09-29T02:08:24.818524] [INFO ] [MAIN ] STXK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:24.818930] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXK took 0.6s. Estimated remaining: 1m 54s. Rate: 182.9 symbols/min [2025-09-29T02:08:24.818767] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-29T02:08:24.864884] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-29T02:08:24.927403] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-29T02:08:25.007478] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:25.004971] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-29T02:08:25.026605] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-29T02:08:25.033914] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-29T02:08:25.145462] [DEBUG] [LOCAL ] STXT: Loaded 2592 existing records from primary storage. [2025-09-29T02:08:25.177046] [INFO ] [MAIN ] STXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:25.226250] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXT took 0.8s. Estimated remaining: 1m 54s. Rate: 182.9 symbols/min [2025-09-29T02:08:25.234979] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:25.266235] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T02:08:25.347866] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-29T02:08:25.391244] [DEBUG] [LOCAL ] STXV: Loaded 1648 existing records from primary storage. [2025-09-29T02:08:25.512065] [INFO ] [MAIN ] STXV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:25.546398] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXV took 0.7s. Estimated remaining: 1m 54s. Rate: 182.9 symbols/min [2025-09-29T02:08:25.799081] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:25.847699] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T02:08:25.909305] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-29T02:08:25.941751] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:25.982171] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-29T02:08:26.011367] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:26.074311] [DEBUG] [LOCAL ] STZ: Loaded 53035 existing records from primary storage. [2025-09-29T02:08:26.074774] [INFO ] [MAIN ] STZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:26.074909] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STZ took 0.8s. Estimated remaining: 1m 54s. Rate: 182.8 symbols/min [2025-09-29T02:08:26.271405] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T02:08:26.293896] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:26.310084] [INFO ] [REMOTE ] STG: Full fetch complete (2496 records). [2025-09-29T02:08:26.312420] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-29T02:08:26.328537] [DEBUG] [LOCAL ] SU: Loaded 54234 existing records from primary storage. [2025-09-29T02:08:26.334281] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-29T02:08:26.356476] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-29T02:08:26.334513] [INFO ] [MAIN ] SU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:26.356888] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. SU took 0.8s. Estimated remaining: 1m 53s. Rate: 182.8 symbols/min [2025-09-29T02:08:26.760505] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T02:08:26.768242] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:26.782934] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:26.768502] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T02:08:26.784669] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:26.784796] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-29T02:08:26.785982] [DEBUG] [LOCAL ] SUI: Loaded 42505 existing records from primary storage. [2025-09-29T02:08:26.787730] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-29T02:08:26.788116] [INFO ] [MAIN ] SUI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:26.789315] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SUI took 0.7s. Estimated remaining: 1m 53s. Rate: 182.8 symbols/min [2025-09-29T02:08:26.789403] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-29T02:08:26.789524] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-29T02:08:26.806780] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-29T02:08:26.851582] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. STG took 6.6s. Estimated remaining: 1m 53s. Rate: 182.9 symbols/min [2025-09-29T02:08:27.080680] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T02:08:27.151909] [DEBUG] [LOCAL ] SUN: Loaded 37928 existing records from primary storage. [2025-09-29T02:08:27.145332] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-29T02:08:27.156907] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:27.158438] [INFO ] [MAIN ] SUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:27.165202] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUN took 0.8s. Estimated remaining: 1m 52s. Rate: 182.9 symbols/min [2025-09-29T02:08:27.275882] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:27.422598] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T02:08:27.457636] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-29T02:08:27.480590] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:27.513447] [DEBUG] [LOCAL ] SUPV: Loaded 47961 existing records from primary storage. [2025-09-29T02:08:27.514694] [INFO ] [MAIN ] SUPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:27.514806] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUPV took 0.7s. Estimated remaining: 1m 52s. Rate: 182.9 symbols/min [2025-09-29T02:08:27.658973] [DEBUG] [LOCAL ] SUZ: Loaded 46428 existing records from primary storage. [2025-09-29T02:08:27.665159] [INFO ] [MAIN ] SUZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:27.697200] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUZ took 0.8s. Estimated remaining: 1m 52s. Rate: 182.9 symbols/min [2025-09-29T02:08:27.789703] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:27.848301] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-29T02:08:27.900110] [DEBUG] [LOCAL ] SVV: Loaded 40221 existing records from primary storage. [2025-09-29T02:08:27.882285] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-29T02:08:27.906786] [INFO ] [MAIN ] SVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:27.918328] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SVV took 0.7s. Estimated remaining: 1m 51s. Rate: 182.9 symbols/min [2025-09-29T02:08:28.032332] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:28.213743] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:28.217362] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-29T02:08:28.219408] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-29T02:08:28.241617] [DEBUG] [LOCAL ] SW: Loaded 53939 existing records from primary storage. [2025-09-29T02:08:28.242599] [INFO ] [MAIN ] SW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:28.242751] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SW took 0.7s. Estimated remaining: 1m 51s. Rate: 182.9 symbols/min [2025-09-29T02:08:28.493454] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:28.495956] [DEBUG] [LOCAL ] SWX: Loaded 31735 existing records from primary storage. [2025-09-29T02:08:28.498557] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T02:08:28.502299] [DEBUG] [LOCAL ] SWK: Loaded 53178 existing records from primary storage. [2025-09-29T02:08:28.499251] [INFO ] [MAIN ] SWX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:28.500442] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-29T02:08:28.502850] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWX took 0.6s. Estimated remaining: 1m 51s. Rate: 183.0 symbols/min [2025-09-29T02:08:28.503856] [INFO ] [MAIN ] SWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:28.515486] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWK took 0.8s. Estimated remaining: 1m 50s. Rate: 183.0 symbols/min [2025-09-29T02:08:28.634572] [DEBUG] [LOCAL ] SWZ: Loaded 6074 existing records from primary storage. [2025-09-29T02:08:28.703708] [INFO ] [MAIN ] SWZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:28.743703] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWZ took 0.5s. Estimated remaining: 1m 50s. Rate: 183.1 symbols/min [2025-09-29T02:08:28.810720] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T02:08:28.893830] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-29T02:08:28.892508] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:29.057698] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:29.183154] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:29.199615] [DEBUG] [LOCAL ] SXI: Loaded 11685 existing records from primary storage. [2025-09-29T02:08:29.200597] [INFO ] [MAIN ] SXI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:29.201023] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXI took 0.7s. Estimated remaining: 1m 49s. Rate: 183.0 symbols/min [2025-09-29T02:08:29.218806] [DEBUG] [LOCAL ] SXC: Loaded 42142 existing records from primary storage. [2025-09-29T02:08:29.219153] [INFO ] [MAIN ] SXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:29.219255] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXC took 0.7s. Estimated remaining: 1m 49s. Rate: 183.1 symbols/min [2025-09-29T02:08:29.243293] [DEBUG] [LOCAL ] SXT: Loaded 29557 existing records from primary storage. [2025-09-29T02:08:29.243683] [INFO ] [MAIN ] SXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:29.243791] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 0.4s. Estimated remaining: 1m 49s. Rate: 183.2 symbols/min [2025-09-29T02:08:29.269269] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T02:08:29.270395] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-29T02:08:29.464432] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-29T02:08:29.465399] [INFO ] [REMOTE ] STXM: Full fetch complete (1431 records). [2025-09-29T02:08:29.465498] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-29T02:08:29.661538] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:08:29.661821] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:29.661911] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:29.662003] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-29T02:08:29.662177] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-29T02:08:29.662276] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-29T02:08:29.662413] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-29T02:08:29.662536] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. STXM took 5.3s. Estimated remaining: 1m 48s. Rate: 183.2 symbols/min [2025-09-29T02:08:30.307416] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:30.455552] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:30.456853] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:30.493355] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:30.565993] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-09-29T02:08:30.585545] [INFO ] [MAIN ] SYF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:30.615970] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. SYF took 1.0s. Estimated remaining: 1m 48s. Rate: 183.0 symbols/min [2025-09-29T02:08:30.628991] [DEBUG] [LOCAL ] SYK: Loaded 47699 existing records from primary storage. [2025-09-29T02:08:30.671093] [INFO ] [MAIN ] SYK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:30.694712] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYK took 1.0s. Estimated remaining: 1m 48s. Rate: 183.1 symbols/min [2025-09-29T02:08:30.743786] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-29T02:08:30.767612] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-09-29T02:08:30.795565] [INFO ] [MAIN ] T: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:30.813471] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. T took 1.1s. Estimated remaining: 1m 47s. Rate: 183.1 symbols/min [2025-09-29T02:08:30.801887] [INFO ] [MAIN ] SYY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:30.845035] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. SYY took 1.2s. Estimated remaining: 1m 47s. Rate: 183.2 symbols/min [2025-09-29T02:08:31.243512] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.447065] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.477065] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.479146] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.523923] [DEBUG] [LOCAL ] TAC: Loaded 43441 existing records from primary storage. [2025-09-29T02:08:31.541308] [INFO ] [MAIN ] TAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:31.541448] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAC took 0.9s. Estimated remaining: 1m 47s. Rate: 183.1 symbols/min [2025-09-29T02:08:31.707449] [DEBUG] [LOCAL ] TALO: Loaded 51575 existing records from primary storage. [2025-09-29T02:08:31.785229] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-09-29T02:08:31.792395] [INFO ] [MAIN ] TALO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:31.805406] [DEBUG] [LOCAL ] TAL: Loaded 52783 existing records from primary storage. [2025-09-29T02:08:31.827728] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TALO took 1.0s. Estimated remaining: 1m 46s. Rate: 183.1 symbols/min [2025-09-29T02:08:31.828097] [INFO ] [MAIN ] TAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:31.827271] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.834554] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAK took 1.1s. Estimated remaining: 1m 46s. Rate: 183.2 symbols/min [2025-09-29T02:08:31.828934] [INFO ] [MAIN ] TAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:31.841094] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TAL took 1.0s. Estimated remaining: 1m 46s. Rate: 183.3 symbols/min [2025-09-29T02:08:32.330987] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:32.397578] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:32.448592] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:32.478502] [DEBUG] [LOCAL ] TAP: Loaded 53648 existing records from primary storage. [2025-09-29T02:08:32.482542] [INFO ] [MAIN ] TAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:32.482832] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TAP took 0.9s. Estimated remaining: 1m 45s. Rate: 183.2 symbols/min [2025-09-29T02:08:32.528992] [DEBUG] [LOCAL ] TBB: Loaded 11828 existing records from primary storage. [2025-09-29T02:08:32.589790] [INFO ] [MAIN ] TBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:32.616787] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBB took 0.8s. Estimated remaining: 1m 45s. Rate: 183.3 symbols/min [2025-09-29T02:08:32.611538] [DEBUG] [LOCAL ] TBI: Loaded 22937 existing records from primary storage. [2025-09-29T02:08:32.664304] [INFO ] [MAIN ] TBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:32.737124] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 0.9s. Estimated remaining: 1m 45s. Rate: 183.3 symbols/min [2025-09-29T02:08:32.800535] [DEBUG] [LOCAL ] TBBB: Loaded 36262 existing records from primary storage. [2025-09-29T02:08:32.843846] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:32.842859] [INFO ] [MAIN ] TBBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:32.865177] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-29T02:08:32.865422] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBBB took 1.0s. Estimated remaining: 1m 44s. Rate: 183.4 symbols/min [2025-09-29T02:08:32.877591] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-29T02:08:33.054720] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:33.065189] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-29T02:08:33.089930] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-29T02:08:33.116793] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-29T02:08:33.139347] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-29T02:08:33.240396] [DEBUG] [LOCAL ] TBN: Loaded 3044 existing records from primary storage. [2025-09-29T02:08:33.294344] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:33.304917] [INFO ] [MAIN ] TBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:33.328572] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBN took 0.7s. Estimated remaining: 1m 44s. Rate: 183.3 symbols/min [2025-09-29T02:08:33.382795] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-29T02:08:33.458917] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-29T02:08:33.506752] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-29T02:08:33.636220] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-29T02:08:33.640703] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:33.672862] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-29T02:08:33.684489] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-29T02:08:33.789012] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:34.259258] [DEBUG] [LOCAL ] TD: Loaded 53036 existing records from primary storage. [2025-09-29T02:08:34.350842] [INFO ] [MAIN ] TD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:34.330832] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:34.378928] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TD took 1.5s. Estimated remaining: 1m 44s. Rate: 183.1 symbols/min [2025-09-29T02:08:34.385145] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-29T02:08:34.397411] [DEBUG] [LOCAL ] TDC: Loaded 47501 existing records from primary storage. [2025-09-29T02:08:34.469296] [INFO ] [MAIN ] TDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:34.485019] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TDC took 1.1s. Estimated remaining: 1m 43s. Rate: 183.2 symbols/min [2025-09-29T02:08:34.640946] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:34.655213] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-29T02:08:34.794339] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T02:08:34.846416] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-29T02:08:34.849859] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:34.875928] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-29T02:08:34.861356] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:34.885137] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:34.888695] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:34.889760] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-09-29T02:08:34.889835] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:34.890081] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-29T02:08:34.890321] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-29T02:08:34.890464] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-29T02:08:34.890670] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-29T02:08:34.891892] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TCAI took 2.0s. Estimated remaining: 1m 43s. Rate: 183.2 symbols/min [2025-09-29T02:08:34.963552] [DEBUG] [LOCAL ] TDF: Loaded 6595 existing records from primary storage. [2025-09-29T02:08:35.003838] [INFO ] [MAIN ] TDF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.023733] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TDF took 0.6s. Estimated remaining: 1m 43s. Rate: 183.2 symbols/min [2025-09-29T02:08:35.129097] [DEBUG] [LOCAL ] TDG: Loaded 22314 existing records from primary storage. [2025-09-29T02:08:35.203806] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:35.183626] [INFO ] [MAIN ] TDG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.216549] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T02:08:35.222143] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDG took 0.7s. Estimated remaining: 1m 42s. Rate: 183.3 symbols/min [2025-09-29T02:08:35.230462] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-29T02:08:35.431140] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:35.531195] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T02:08:35.564078] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:35.540486] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-29T02:08:35.589722] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-09-29T02:08:35.590334] [INFO ] [MAIN ] TDOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.590563] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDOC took 0.7s. Estimated remaining: 1m 42s. Rate: 183.3 symbols/min [2025-09-29T02:08:35.773529] [DEBUG] [LOCAL ] TDS: Loaded 43435 existing records from primary storage. [2025-09-29T02:08:35.818154] [INFO ] [MAIN ] TDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.788145] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-29T02:08:35.820942] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDS took 0.8s. Estimated remaining: 1m 42s. Rate: 183.3 symbols/min [2025-09-29T02:08:35.854139] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:35.861770] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-29T02:08:35.895906] [DEBUG] [LOCAL ] TDW: Loaded 46091 existing records from primary storage. [2025-09-29T02:08:35.906834] [INFO ] [MAIN ] TDW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.913137] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TDW took 0.7s. Estimated remaining: 1m 41s. Rate: 183.4 symbols/min [2025-09-29T02:08:36.185046] [DEBUG] [LOCAL ] TDY: Loaded 22979 existing records from primary storage. [2025-09-29T02:08:36.203779] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T02:08:36.193156] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:36.238538] [INFO ] [MAIN ] TDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:36.226497] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-29T02:08:36.245280] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-29T02:08:36.254934] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDY took 0.7s. Estimated remaining: 1m 41s. Rate: 183.4 symbols/min [2025-09-29T02:08:36.286362] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-29T02:08:36.286182] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:36.305791] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-29T02:08:36.354715] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-29T02:08:36.380976] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-29T02:08:36.412995] [DEBUG] [LOCAL ] TEAF: Loaded 7529 existing records from primary storage. [2025-09-29T02:08:36.418079] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-29T02:08:36.418540] [INFO ] [MAIN ] TEAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:36.447216] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TEAF took 0.5s. Estimated remaining: 1m 41s. Rate: 183.4 symbols/min [2025-09-29T02:08:36.629700] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-29T02:08:36.675897] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-29T02:08:36.653244] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:36.978046] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:36.986432] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T02:08:36.987915] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-29T02:08:37.177200] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:37.202419] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-29T02:08:37.206181] [DEBUG] [LOCAL ] TECK: Loaded 54216 existing records from primary storage. [2025-09-29T02:08:37.206791] [INFO ] [MAIN ] TECK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:37.206942] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TECK took 0.9s. Estimated remaining: 1m 41s. Rate: 183.3 symbols/min [2025-09-29T02:08:37.266575] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T02:08:37.350753] [DEBUG] [LOCAL ] TEF: Loaded 37944 existing records from primary storage. [2025-09-29T02:08:37.372004] [INFO ] [MAIN ] TEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:37.405744] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEF took 0.9s. Estimated remaining: 1m 40s. Rate: 183.3 symbols/min [2025-09-29T02:08:37.429118] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:37.484575] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:37.522494] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-29T02:08:37.556890] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:37.557061] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-09-29T02:08:37.562761] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:37.578317] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-29T02:08:37.642799] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:37.643077] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-29T02:08:37.643573] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-29T02:08:37.643720] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-29T02:08:37.643829] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TE took 1.8s. Estimated remaining: 1m 40s. Rate: 183.3 symbols/min [2025-09-29T02:08:37.717692] [DEBUG] [LOCAL ] TEI: Loaded 20910 existing records from primary storage. [2025-09-29T02:08:37.769877] [INFO ] [MAIN ] TEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:37.770562] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEI took 0.6s. Estimated remaining: 1m 39s. Rate: 183.4 symbols/min [2025-09-29T02:08:37.904365] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.001230] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-29T02:08:38.065757] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.085332] [DEBUG] [LOCAL ] TEL: Loaded 51898 existing records from primary storage. [2025-09-29T02:08:38.086253] [INFO ] [MAIN ] TEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:38.086388] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEL took 0.7s. Estimated remaining: 1m 39s. Rate: 183.4 symbols/min [2025-09-29T02:08:38.241151] [DEBUG] [LOCAL ] TEN: Loaded 31383 existing records from primary storage. [2025-09-29T02:08:38.247563] [DEBUG] [LOCAL ] TEO: Loaded 22345 existing records from primary storage. [2025-09-29T02:08:38.263299] [INFO ] [MAIN ] TEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:38.328281] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.331034] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T02:08:38.308760] [INFO ] [MAIN ] TEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:38.328604] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEN took 0.7s. Estimated remaining: 1m 39s. Rate: 183.4 symbols/min [2025-09-29T02:08:38.344688] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEO took 0.6s. Estimated remaining: 1m 38s. Rate: 183.5 symbols/min [2025-09-29T02:08:38.703365] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.759978] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.780674] [DEBUG] [LOCAL ] TEVA: Loaded 54413 existing records from primary storage. [2025-09-29T02:08:38.781330] [INFO ] [MAIN ] TEVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:38.781725] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEVA took 0.7s. Estimated remaining: 1m 38s. Rate: 183.5 symbols/min [2025-09-29T02:08:38.807167] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-29T02:08:39.030310] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:39.050373] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-29T02:08:39.052744] [DEBUG] [LOCAL ] TEX: Loaded 45170 existing records from primary storage. [2025-09-29T02:08:39.054706] [INFO ] [REMOTE ] TBLU: Full fetch complete (1172 records). [2025-09-29T02:08:39.055317] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-29T02:08:39.061248] [INFO ] [MAIN ] TEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:39.076251] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEX took 0.7s. Estimated remaining: 1m 38s. Rate: 183.5 symbols/min [2025-09-29T02:08:39.116105] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-29T02:08:39.150635] [INFO ] [MAIN ] TFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:39.186246] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TFC took 0.8s. Estimated remaining: 1m 37s. Rate: 183.5 symbols/min [2025-09-29T02:08:39.516216] [DEBUG] [LOCAL ] TFII: Loaded 34733 existing records from primary storage. [2025-09-29T02:08:39.579779] [INFO ] [MAIN ] TFII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:39.539941] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:08:39.607675] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 0.8s. Estimated remaining: 1m 37s. Rate: 183.5 symbols/min [2025-09-29T02:08:39.661751] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:39.607512] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:39.711254] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:39.735711] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:39.751621] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-29T02:08:39.783049] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-29T02:08:39.828198] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-29T02:08:39.834251] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-29T02:08:39.851030] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TBLU took 7.4s. Estimated remaining: 1m 37s. Rate: 183.5 symbols/min [2025-09-29T02:08:39.946319] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:40.000093] [DEBUG] [LOCAL ] TFIN: Loaded 23896 existing records from primary storage. [2025-09-29T02:08:40.040761] [INFO ] [MAIN ] TFIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:40.067787] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFIN took 1.0s. Estimated remaining: 1m 36s. Rate: 183.6 symbols/min [2025-09-29T02:08:40.163842] [DEBUG] [LOCAL ] TFPM: Loaded 37997 existing records from primary storage. [2025-09-29T02:08:40.234892] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:40.261208] [INFO ] [MAIN ] TFPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:40.287728] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 36s. Rate: 183.6 symbols/min [2025-09-29T02:08:40.379709] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:40.392731] [DEBUG] [LOCAL ] TG: Loaded 10581 existing records from primary storage. [2025-09-29T02:08:40.394316] [DEBUG] [LOCAL ] TFX: Loaded 37936 existing records from primary storage. [2025-09-29T02:08:40.393200] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-29T02:08:40.394745] [INFO ] [MAIN ] TFX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:40.394919] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TFX took 0.8s. Estimated remaining: 1m 36s. Rate: 183.6 symbols/min [2025-09-29T02:08:40.394966] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-29T02:08:40.395571] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-29T02:08:40.395192] [INFO ] [MAIN ] TG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:40.395706] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-29T02:08:40.395851] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TG took 0.5s. Estimated remaining: 1m 35s. Rate: 183.7 symbols/min [2025-09-29T02:08:40.395915] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-29T02:08:40.396125] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-29T02:08:40.786521] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:40.787044] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-29T02:08:40.912291] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:40.912624] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-29T02:08:40.912745] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:40.912822] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-09-29T02:08:40.912891] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:40.912979] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-29T02:08:40.913070] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-29T02:08:40.913138] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-29T02:08:40.913249] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-29T02:08:40.913356] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TGE took 0.8s. Estimated remaining: 1m 35s. Rate: 183.7 symbols/min [2025-09-29T02:08:41.594045] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.698830] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.697817] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.700313] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.733543] [DEBUG] [LOCAL ] TGLS: Loaded 28709 existing records from primary storage. [2025-09-29T02:08:41.733993] [INFO ] [MAIN ] TGLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:41.734436] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGLS took 0.8s. Estimated remaining: 1m 35s. Rate: 183.5 symbols/min [2025-09-29T02:08:41.929897] [DEBUG] [LOCAL ] TGS: Loaded 33072 existing records from primary storage. [2025-09-29T02:08:41.982089] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.977515] [INFO ] [MAIN ] TGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:41.996804] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGS took 1.1s. Estimated remaining: 1m 34s. Rate: 183.6 symbols/min [2025-09-29T02:08:41.997968] [DEBUG] [LOCAL ] TGNA: Loaded 49444 existing records from primary storage. [2025-09-29T02:08:42.034639] [INFO ] [MAIN ] TGNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.062681] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 34s. Rate: 183.6 symbols/min [2025-09-29T02:08:42.127581] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-29T02:08:42.187523] [INFO ] [MAIN ] TGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.229792] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 1.3s. Estimated remaining: 1m 34s. Rate: 183.7 symbols/min [2025-09-29T02:08:42.354057] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:42.580613] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:42.623408] [DEBUG] [LOCAL ] THC: Loaded 48617 existing records from primary storage. [2025-09-29T02:08:42.669184] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:42.666986] [INFO ] [MAIN ] THC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.670937] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THC took 0.9s. Estimated remaining: 1m 33s. Rate: 183.6 symbols/min [2025-09-29T02:08:42.692554] [DEBUG] [LOCAL ] THIR: Loaded 2238 existing records from primary storage. [2025-09-29T02:08:42.728498] [INFO ] [MAIN ] THIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.726926] [DEBUG] [LOCAL ] THLV: Loaded 1614 existing records from primary storage. [2025-09-29T02:08:42.800369] [INFO ] [MAIN ] THLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.781798] [DEBUG] [LOCAL ] THG: Loaded 22081 existing records from primary storage. [2025-09-29T02:08:42.781976] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THIR took 0.6s. Estimated remaining: 1m 33s. Rate: 183.7 symbols/min [2025-09-29T02:08:42.815535] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THLV took 0.5s. Estimated remaining: 1m 33s. Rate: 183.8 symbols/min [2025-09-29T02:08:42.838255] [INFO ] [MAIN ] THG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.866353] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THG took 0.9s. Estimated remaining: 1m 32s. Rate: 183.9 symbols/min [2025-09-29T02:08:43.178371] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:43.387372] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:43.470690] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:43.500900] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:43.533500] [DEBUG] [LOCAL ] THR: Loaded 20218 existing records from primary storage. [2025-09-29T02:08:43.534527] [INFO ] [MAIN ] THR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:43.540829] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THR took 0.7s. Estimated remaining: 1m 32s. Rate: 183.8 symbols/min [2025-09-29T02:08:43.606532] [DEBUG] [LOCAL ] THO: Loaded 42957 existing records from primary storage. [2025-09-29T02:08:43.625823] [DEBUG] [LOCAL ] THQ: Loaded 24879 existing records from primary storage. [2025-09-29T02:08:43.635262] [INFO ] [MAIN ] THO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:43.635977] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THO took 1.0s. Estimated remaining: 1m 32s. Rate: 183.8 symbols/min [2025-09-29T02:08:43.689843] [INFO ] [MAIN ] THQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:43.716343] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THQ took 0.9s. Estimated remaining: 1m 31s. Rate: 183.9 symbols/min [2025-09-29T02:08:43.822975] [DEBUG] [LOCAL ] THS: Loaded 38565 existing records from primary storage. [2025-09-29T02:08:43.948800] [INFO ] [MAIN ] THS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:44.023698] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.065998] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THS took 1.1s. Estimated remaining: 1m 31s. Rate: 183.9 symbols/min [2025-09-29T02:08:44.155576] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.211147] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-29T02:08:44.253587] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-29T02:08:44.309352] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.309958] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-29T02:08:44.311204] [DEBUG] [LOCAL ] THW: Loaded 19392 existing records from primary storage. [2025-09-29T02:08:44.316547] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-29T02:08:44.337626] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-29T02:08:44.362078] [INFO ] [MAIN ] THW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:44.392308] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-29T02:08:44.392552] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THW took 0.9s. Estimated remaining: 1m 31s. Rate: 183.9 symbols/min [2025-09-29T02:08:44.399204] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.673323] [DEBUG] [LOCAL ] TISI: Loaded 3805 existing records from primary storage. [2025-09-29T02:08:44.684464] [INFO ] [MAIN ] TISI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:44.742554] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TISI took 0.7s. Estimated remaining: 1m 30s. Rate: 183.9 symbols/min [2025-09-29T02:08:44.852486] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.922838] [DEBUG] [LOCAL ] TIMB: Loaded 36983 existing records from primary storage. [2025-09-29T02:08:45.003121] [INFO ] [MAIN ] TIMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:45.067913] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TIMB took 1.3s. Estimated remaining: 1m 30s. Rate: 183.9 symbols/min [2025-09-29T02:08:45.246447] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:45.367356] [DEBUG] [LOCAL ] TIXT: Loaded 31824 existing records from primary storage. [2025-09-29T02:08:45.398274] [INFO ] [MAIN ] TIXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:45.430186] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIXT took 1.0s. Estimated remaining: 1m 30s. Rate: 183.9 symbols/min [2025-09-29T02:08:45.520395] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:45.531198] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:45.565443] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-29T02:08:45.757857] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:45.784678] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-29T02:08:45.784934] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:45.776194] [DEBUG] [LOCAL ] TJX: Loaded 54449 existing records from primary storage. [2025-09-29T02:08:45.785046] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-09-29T02:08:45.800571] [INFO ] [MAIN ] TJX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:45.802256] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:45.802061] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:45.802712] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-29T02:08:45.802823] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TJX took 1.0s. Estimated remaining: 1m 29s. Rate: 183.9 symbols/min [2025-09-29T02:08:45.815893] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-29T02:08:45.816478] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-29T02:08:45.830803] [DEBUG] [LOCAL ] TK: Loaded 40151 existing records from primary storage. [2025-09-29T02:08:45.822007] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-29T02:08:45.843110] [INFO ] [MAIN ] TK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:45.861617] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 0.7s. Estimated remaining: 1m 29s. Rate: 183.9 symbols/min [2025-09-29T02:08:45.889964] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TIC took 2.2s. Estimated remaining: 1m 29s. Rate: 184.0 symbols/min [2025-09-29T02:08:46.239538] [DEBUG] [LOCAL ] TKC: Loaded 39062 existing records from primary storage. [2025-09-29T02:08:46.298339] [INFO ] [MAIN ] TKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.325017] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:46.346114] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 0.9s. Estimated remaining: 1m 28s. Rate: 184.0 symbols/min [2025-09-29T02:08:46.420923] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:46.517551] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:46.729063] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:46.730762] [DEBUG] [LOCAL ] TKO: Loaded 44814 existing records from primary storage. [2025-09-29T02:08:46.731936] [INFO ] [MAIN ] TKO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.732061] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKO took 0.9s. Estimated remaining: 1m 28s. Rate: 184.0 symbols/min [2025-09-29T02:08:46.869862] [DEBUG] [LOCAL ] TKR: Loaded 40832 existing records from primary storage. [2025-09-29T02:08:46.863528] [DEBUG] [LOCAL ] TLK: Loaded 39925 existing records from primary storage. [2025-09-29T02:08:46.898371] [INFO ] [MAIN ] TKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.905307] [DEBUG] [LOCAL ] TLYS: Loaded 17064 existing records from primary storage. [2025-09-29T02:08:46.911002] [INFO ] [MAIN ] TLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.911333] [INFO ] [MAIN ] TLYS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.916597] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 1.0s. Estimated remaining: 1m 28s. Rate: 184.0 symbols/min [2025-09-29T02:08:46.943688] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLK took 0.9s. Estimated remaining: 1m 27s. Rate: 184.1 symbols/min [2025-09-29T02:08:46.950610] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLYS took 0.6s. Estimated remaining: 1m 27s. Rate: 184.2 symbols/min [2025-09-29T02:08:47.084110] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.492127] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.544506] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.564618] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.597212] [DEBUG] [LOCAL ] TM: Loaded 36992 existing records from primary storage. [2025-09-29T02:08:47.599113] [INFO ] [MAIN ] TM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:47.599256] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 0.9s. Estimated remaining: 1m 27s. Rate: 184.1 symbols/min [2025-09-29T02:08:47.848818] [DEBUG] [LOCAL ] TMHC: Loaded 46274 existing records from primary storage. [2025-09-29T02:08:47.873227] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.888920] [INFO ] [MAIN ] TMHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:47.904561] [DEBUG] [LOCAL ] TME: Loaded 53979 existing records from primary storage. [2025-09-29T02:08:47.904754] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TMHC took 1.0s. Estimated remaining: 1m 26s. Rate: 184.1 symbols/min [2025-09-29T02:08:47.905693] [INFO ] [MAIN ] TME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:47.918236] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TME took 1.0s. Estimated remaining: 1m 26s. Rate: 184.2 symbols/min [2025-09-29T02:08:47.906632] [DEBUG] [LOCAL ] TMO: Loaded 53089 existing records from primary storage. [2025-09-29T02:08:47.984478] [INFO ] [MAIN ] TMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:48.042573] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TMO took 1.0s. Estimated remaining: 1m 26s. Rate: 184.2 symbols/min [2025-09-29T02:08:48.128850] [DEBUG] [LOCAL ] TNC: Loaded 15334 existing records from primary storage. [2025-09-29T02:08:48.179378] [INFO ] [MAIN ] TNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:48.222327] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNC took 0.6s. Estimated remaining: 1m 25s. Rate: 184.3 symbols/min [2025-09-29T02:08:48.342362] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:48.539743] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:48.619303] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-29T02:08:48.622986] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-29T02:08:48.651245] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-29T02:08:48.660435] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:48.666439] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-29T02:08:48.688065] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-29T02:08:48.716918] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-29T02:08:48.817580] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:48.819339] [DEBUG] [LOCAL ] TNET: Loaded 29247 existing records from primary storage. [2025-09-29T02:08:48.843671] [INFO ] [MAIN ] TNET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:48.861784] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNET took 1.0s. Estimated remaining: 1m 25s. Rate: 184.2 symbols/min [2025-09-29T02:08:49.347354] [DEBUG] [LOCAL ] TNK: Loaded 35701 existing records from primary storage. [2025-09-29T02:08:49.379986] [INFO ] [MAIN ] TNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:49.368760] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:49.425777] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNK took 1.3s. Estimated remaining: 1m 25s. Rate: 184.1 symbols/min [2025-09-29T02:08:49.450904] [DEBUG] [LOCAL ] TNL: Loaded 42474 existing records from primary storage. [2025-09-29T02:08:49.499295] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:49.511788] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-29T02:08:49.523695] [INFO ] [MAIN ] TNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:49.531512] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNL took 1.3s. Estimated remaining: 1m 24s. Rate: 184.2 symbols/min [2025-09-29T02:08:49.735677] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:49.831710] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-29T02:08:49.877180] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:49.872896] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:49.877009] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:49.892719] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-09-29T02:08:49.893302] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:49.893391] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-29T02:08:49.893558] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-29T02:08:49.893771] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-29T02:08:49.893996] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-29T02:08:49.894214] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TNGY took 1.9s. Estimated remaining: 1m 24s. Rate: 184.2 symbols/min [2025-09-29T02:08:50.047608] [DEBUG] [LOCAL ] TOL: Loaded 51738 existing records from primary storage. [2025-09-29T02:08:50.085469] [INFO ] [MAIN ] TOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.109801] [DEBUG] [LOCAL ] TPB: Loaded 25409 existing records from primary storage. [2025-09-29T02:08:50.109947] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TOL took 1.2s. Estimated remaining: 1m 24s. Rate: 184.2 symbols/min [2025-09-29T02:08:50.158261] [INFO ] [MAIN ] TPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.157846] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:50.181928] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TPB took 0.6s. Estimated remaining: 1m 23s. Rate: 184.3 symbols/min [2025-09-29T02:08:50.396463] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-29T02:08:50.434213] [INFO ] [MAIN ] TOST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.521360] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TOST took 1.1s. Estimated remaining: 1m 23s. Rate: 184.3 symbols/min [2025-09-29T02:08:50.521171] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:50.546236] [DEBUG] [LOCAL ] TPC: Loaded 39311 existing records from primary storage. [2025-09-29T02:08:50.674350] [INFO ] [MAIN ] TPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.705086] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPC took 0.8s. Estimated remaining: 1m 23s. Rate: 184.3 symbols/min [2025-09-29T02:08:50.704903] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:50.855045] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:50.877350] [DEBUG] [LOCAL ] TPL: Loaded 12533 existing records from primary storage. [2025-09-29T02:08:50.877795] [INFO ] [MAIN ] TPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.877902] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPL took 0.7s. Estimated remaining: 1m 22s. Rate: 184.3 symbols/min [2025-09-29T02:08:50.879409] [DEBUG] [LOCAL ] TPH: Loaded 45821 existing records from primary storage. [2025-09-29T02:08:50.879900] [INFO ] [MAIN ] TPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.880526] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPH took 0.7s. Estimated remaining: 1m 22s. Rate: 184.4 symbols/min [2025-09-29T02:08:50.938191] [DEBUG] [LOCAL ] TPR: Loaded 54252 existing records from primary storage. [2025-09-29T02:08:50.938631] [INFO ] [MAIN ] TPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.938768] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 0.4s. Estimated remaining: 1m 22s. Rate: 184.5 symbols/min [2025-09-29T02:08:51.655963] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:51.670389] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:51.668783] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:51.706481] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:51.725508] [DEBUG] [LOCAL ] TPZ: Loaded 5095 existing records from primary storage. [2025-09-29T02:08:51.726232] [INFO ] [MAIN ] TPZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:51.731183] [DEBUG] [LOCAL ] TPYP: Loaded 8039 existing records from primary storage. [2025-09-29T02:08:51.731316] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPZ took 0.7s. Estimated remaining: 1m 21s. Rate: 184.4 symbols/min [2025-09-29T02:08:51.731684] [INFO ] [MAIN ] TPYP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:51.787461] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPYP took 0.8s. Estimated remaining: 1m 21s. Rate: 184.4 symbols/min [2025-09-29T02:08:51.812554] [DEBUG] [LOCAL ] TR: Loaded 18494 existing records from primary storage. [2025-09-29T02:08:51.851853] [INFO ] [MAIN ] TR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:51.956000] [DEBUG] [LOCAL ] TPVG: Loaded 27400 existing records from primary storage. [2025-09-29T02:08:51.954999] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TR took 1.0s. Estimated remaining: 1m 21s. Rate: 184.5 symbols/min [2025-09-29T02:08:52.053766] [INFO ] [MAIN ] TPVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:52.114721] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:52.114999] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 20s. Rate: 184.5 symbols/min [2025-09-29T02:08:52.331740] [DEBUG] [LOCAL ] TRAK: Loaded 9383 existing records from primary storage. [2025-09-29T02:08:52.374180] [INFO ] [MAIN ] TRAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:52.373405] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:52.390287] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRAK took 0.7s. Estimated remaining: 1m 20s. Rate: 184.5 symbols/min [2025-09-29T02:08:52.554993] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:52.642559] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:52.691740] [DEBUG] [LOCAL ] TRC: Loaded 16189 existing records from primary storage. [2025-09-29T02:08:52.692259] [INFO ] [MAIN ] TRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:52.692924] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 0.9s. Estimated remaining: 1m 20s. Rate: 184.5 symbols/min [2025-09-29T02:08:52.838451] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.032765] [DEBUG] [LOCAL ] TREX: Loaded 50733 existing records from primary storage. [2025-09-29T02:08:53.035688] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.037355] [INFO ] [MAIN ] TREX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:53.039088] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 1.1s. Estimated remaining: 1m 19s. Rate: 184.5 symbols/min [2025-09-29T02:08:53.092178] [DEBUG] [LOCAL ] TRGP: Loaded 51504 existing records from primary storage. [2025-09-29T02:08:53.153849] [INFO ] [MAIN ] TRGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:53.178597] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 1.0s. Estimated remaining: 1m 19s. Rate: 184.6 symbols/min [2025-09-29T02:08:53.210412] [DEBUG] [LOCAL ] TRN: Loaded 37786 existing records from primary storage. [2025-09-29T02:08:53.289283] [INFO ] [MAIN ] TRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:53.335102] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 0.9s. Estimated remaining: 1m 19s. Rate: 184.6 symbols/min [2025-09-29T02:08:53.440701] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.614275] [DEBUG] [LOCAL ] TRNO: Loaded 44598 existing records from primary storage. [2025-09-29T02:08:53.648565] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.655579] [INFO ] [MAIN ] TRNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:53.688168] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 1.0s. Estimated remaining: 1m 18s. Rate: 184.6 symbols/min [2025-09-29T02:08:53.784071] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.942839] [DEBUG] [LOCAL ] TROX: Loaded 52550 existing records from primary storage. [2025-09-29T02:08:54.006874] [INFO ] [MAIN ] TROX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.036844] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:54.037419] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TROX took 1.0s. Estimated remaining: 1m 18s. Rate: 184.6 symbols/min [2025-09-29T02:08:54.190403] [DEBUG] [LOCAL ] TRP: Loaded 52891 existing records from primary storage. [2025-09-29T02:08:54.191181] [DEBUG] [LOCAL ] TRTX: Loaded 38058 existing records from primary storage. [2025-09-29T02:08:54.218168] [INFO ] [MAIN ] TRTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.243564] [INFO ] [MAIN ] TRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.236737] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRTX took 0.9s. Estimated remaining: 1m 18s. Rate: 184.7 symbols/min [2025-09-29T02:08:54.284890] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:54.296673] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRP took 1.1s. Estimated remaining: 1m 17s. Rate: 184.7 symbols/min [2025-09-29T02:08:54.561735] [DEBUG] [LOCAL ] TRU: Loaded 51965 existing records from primary storage. [2025-09-29T02:08:54.607806] [INFO ] [MAIN ] TRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.644988] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 0.9s. Estimated remaining: 1m 17s. Rate: 184.7 symbols/min [2025-09-29T02:08:54.660914] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:54.753824] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:54.887161] [DEBUG] [LOCAL ] TRV: Loaded 48744 existing records from primary storage. [2025-09-29T02:08:54.899308] [INFO ] [MAIN ] TRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.915129] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TRV took 0.9s. Estimated remaining: 1m 17s. Rate: 184.7 symbols/min [2025-09-29T02:08:55.049282] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:55.145703] [DEBUG] [LOCAL ] TS: Loaded 52425 existing records from primary storage. [2025-09-29T02:08:55.151074] [INFO ] [MAIN ] TS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:55.196968] [DEBUG] [LOCAL ] TSE: Loaded 29074 existing records from primary storage. [2025-09-29T02:08:55.233769] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:55.234523] [INFO ] [MAIN ] TSE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:55.229120] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TS took 1.0s. Estimated remaining: 1m 16s. Rate: 184.7 symbols/min [2025-09-29T02:08:55.240318] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSE took 0.9s. Estimated remaining: 1m 16s. Rate: 184.8 symbols/min [2025-09-29T02:08:55.251384] [DEBUG] [LOCAL ] TSI: Loaded 8090 existing records from primary storage. [2025-09-29T02:08:55.298093] [INFO ] [MAIN ] TSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:55.330076] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSI took 0.7s. Estimated remaining: 1m 16s. Rate: 184.9 symbols/min [2025-09-29T02:08:55.782258] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:55.838441] [DEBUG] [LOCAL ] TSLX: Loaded 35752 existing records from primary storage. [2025-09-29T02:08:55.857404] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:55.861903] [INFO ] [MAIN ] TSLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:55.862460] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSLX took 0.9s. Estimated remaining: 1m 15s. Rate: 184.8 symbols/min [2025-09-29T02:08:55.861215] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:56.032808] [DEBUG] [LOCAL ] TSQ: Loaded 12195 existing records from primary storage. [2025-09-29T02:08:56.069058] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:56.064590] [INFO ] [MAIN ] TSQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:56.069742] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSQ took 0.7s. Estimated remaining: 1m 15s. Rate: 184.9 symbols/min [2025-09-29T02:08:56.288261] [DEBUG] [LOCAL ] TSN: Loaded 53638 existing records from primary storage. [2025-09-29T02:08:56.300315] [INFO ] [MAIN ] TSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:56.315933] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TSN took 1.1s. Estimated remaining: 1m 15s. Rate: 184.9 symbols/min [2025-09-29T02:08:56.320537] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:56.354129] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-29T02:08:56.389604] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-29T02:08:56.395153] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-29T02:08:56.437371] [INFO ] [MAIN ] TSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:56.453793] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSM took 1.2s. Estimated remaining: 1m 14s. Rate: 184.9 symbols/min [2025-09-29T02:08:56.437218] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-29T02:08:56.493578] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-29T02:08:56.597389] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-29T02:08:56.637008] [DEBUG] [LOCAL ] TT: Loaded 48538 existing records from primary storage. [2025-09-29T02:08:56.669981] [INFO ] [MAIN ] TT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:56.652695] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-29T02:08:56.695192] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:56.695364] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TT took 0.8s. Estimated remaining: 1m 14s. Rate: 185.0 symbols/min [2025-09-29T02:08:57.013438] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:57.195678] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:57.256467] [DEBUG] [LOCAL ] TTC: Loaded 43005 existing records from primary storage. [2025-09-29T02:08:57.287333] [INFO ] [MAIN ] TTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:57.305390] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TTC took 1.0s. Estimated remaining: 1m 14s. Rate: 184.9 symbols/min [2025-09-29T02:08:57.595749] [DEBUG] [LOCAL ] TTE: Loaded 52395 existing records from primary storage. [2025-09-29T02:08:57.607148] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:57.607995] [INFO ] [MAIN ] TTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:57.607791] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-29T02:08:57.614435] [DEBUG] [LOCAL ] TTI: Loaded 46112 existing records from primary storage. [2025-09-29T02:08:57.613441] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTE took 1.2s. Estimated remaining: 1m 13s. Rate: 184.9 symbols/min [2025-09-29T02:08:57.653967] [INFO ] [MAIN ] TTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:57.709835] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTI took 1.0s. Estimated remaining: 1m 13s. Rate: 184.9 symbols/min [2025-09-29T02:08:57.733791] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:57.866159] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:57.945082] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-29T02:08:57.980435] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:58.001021] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.001827] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-09-29T02:08:58.018063] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:58.028803] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-29T02:08:58.062597] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-29T02:08:58.084486] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.084746] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-29T02:08:58.085407] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-29T02:08:58.085499] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTAM took 2.0s. Estimated remaining: 1m 13s. Rate: 184.9 symbols/min [2025-09-29T02:08:58.304265] [DEBUG] [LOCAL ] TU: Loaded 50606 existing records from primary storage. [2025-09-29T02:08:58.333102] [INFO ] [MAIN ] TU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:58.345600] [DEBUG] [LOCAL ] TUYA: Loaded 47185 existing records from primary storage. [2025-09-29T02:08:58.367493] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.345888] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TU took 1.0s. Estimated remaining: 1m 12s. Rate: 184.9 symbols/min [2025-09-29T02:08:58.368138] [INFO ] [MAIN ] TUYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:58.374073] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TUYA took 0.7s. Estimated remaining: 1m 12s. Rate: 185.0 symbols/min [2025-09-29T02:08:58.516405] [DEBUG] [LOCAL ] TVC: Loaded 3466 existing records from primary storage. [2025-09-29T02:08:58.568859] [INFO ] [MAIN ] TVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:58.546430] [DEBUG] [LOCAL ] TV: Loaded 43514 existing records from primary storage. [2025-09-29T02:08:58.605245] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TVC took 0.5s. Estimated remaining: 1m 12s. Rate: 185.0 symbols/min [2025-09-29T02:08:58.708019] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.723915] [INFO ] [MAIN ] TV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:58.802864] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TV took 1.0s. Estimated remaining: 1m 11s. Rate: 185.1 symbols/min [2025-09-29T02:08:58.917365] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-29T02:08:58.974483] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.990520] [INFO ] [MAIN ] TVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.017221] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TVE took 0.6s. Estimated remaining: 1m 11s. Rate: 185.1 symbols/min [2025-09-29T02:08:59.151705] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.312565] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.389927] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-29T02:08:59.426343] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.436624] [INFO ] [MAIN ] TWN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.438814] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWN took 0.6s. Estimated remaining: 1m 11s. Rate: 185.1 symbols/min [2025-09-29T02:08:59.439577] [DEBUG] [LOCAL ] TWI: Loaded 34981 existing records from primary storage. [2025-09-29T02:08:59.480787] [INFO ] [MAIN ] TWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.487214] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWI took 1.1s. Estimated remaining: 1m 10s. Rate: 185.2 symbols/min [2025-09-29T02:08:59.849112] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.864581] [DEBUG] [LOCAL ] TWLO: Loaded 53501 existing records from primary storage. [2025-09-29T02:08:59.895583] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-29T02:08:59.937987] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-29T02:08:59.937878] [INFO ] [MAIN ] TWLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.940790] [DEBUG] [LOCAL ] TWO: Loaded 49002 existing records from primary storage. [2025-09-29T02:08:59.939549] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.940987] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 10s. Rate: 185.1 symbols/min [2025-09-29T02:08:59.941245] [INFO ] [MAIN ] TWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.941390] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-29T02:08:59.947342] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWO took 0.9s. Estimated remaining: 1m 10s. Rate: 185.2 symbols/min [2025-09-29T02:08:59.947189] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-29T02:08:59.996567] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-29T02:09:00.019325] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-29T02:09:00.385385] [DEBUG] [LOCAL ] TX: Loaded 23932 existing records from primary storage. [2025-09-29T02:09:00.496866] [INFO ] [MAIN ] TX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:00.531581] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:00.491523] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:00.531947] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TX took 1.0s. Estimated remaining: 1m 9s. Rate: 185.1 symbols/min [2025-09-29T02:09:00.711173] [DEBUG] [LOCAL ] TXO: Loaded 19060 existing records from primary storage. [2025-09-29T02:09:00.749226] [INFO ] [MAIN ] TXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:00.781695] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXO took 0.8s. Estimated remaining: 1m 9s. Rate: 185.2 symbols/min [2025-09-29T02:09:00.788045] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:00.800388] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-29T02:09:00.821030] [DEBUG] [LOCAL ] TXNM: Loaded 44463 existing records from primary storage. [2025-09-29T02:09:00.821445] [INFO ] [MAIN ] TXNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:00.821909] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TXNM took 0.9s. Estimated remaining: 1m 9s. Rate: 185.2 symbols/min [2025-09-29T02:09:00.922326] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:00.922722] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-29T02:09:00.922810] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:00.922884] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-09-29T02:09:00.922953] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:00.923032] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-29T02:09:00.923156] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-29T02:09:00.923230] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-29T02:09:00.923321] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-29T02:09:00.923406] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TWOD took 1.5s. Estimated remaining: 1m 8s. Rate: 185.3 symbols/min [2025-09-29T02:09:01.618388] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:01.716625] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:01.777318] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:01.779166] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:01.819058] [DEBUG] [LOCAL ] TY: Loaded 7756 existing records from primary storage. [2025-09-29T02:09:01.821308] [DEBUG] [LOCAL ] TYG: Loaded 14410 existing records from primary storage. [2025-09-29T02:09:01.821609] [INFO ] [MAIN ] TY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:01.822170] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 0.9s. Estimated remaining: 1m 8s. Rate: 185.1 symbols/min [2025-09-29T02:09:01.822283] [INFO ] [MAIN ] TYG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:01.845425] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYG took 0.9s. Estimated remaining: 1m 8s. Rate: 185.2 symbols/min [2025-09-29T02:09:02.063890] [DEBUG] [LOCAL ] TYL: Loaded 22582 existing records from primary storage. [2025-09-29T02:09:02.177999] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:02.128400] [INFO ] [MAIN ] TYL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.196945] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYL took 1.3s. Estimated remaining: 1m 7s. Rate: 185.2 symbols/min [2025-09-29T02:09:02.258584] [DEBUG] [LOCAL ] TXT: Loaded 50470 existing records from primary storage. [2025-09-29T02:09:02.325198] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:02.356196] [INFO ] [MAIN ] TXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.377713] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 1.5s. Estimated remaining: 1m 7s. Rate: 185.2 symbols/min [2025-09-29T02:09:02.606553] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:02.731236] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:02.749738] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-29T02:09:02.752193] [INFO ] [MAIN ] U: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.765150] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. U took 0.9s. Estimated remaining: 1m 7s. Rate: 185.2 symbols/min [2025-09-29T02:09:02.790908] [DEBUG] [LOCAL ] UA: Loaded 51189 existing records from primary storage. [2025-09-29T02:09:02.817975] [INFO ] [MAIN ] UA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.843694] [DEBUG] [LOCAL ] UAN: Loaded 5507 existing records from primary storage. [2025-09-29T02:09:02.843971] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UA took 1.0s. Estimated remaining: 1m 6s. Rate: 185.3 symbols/min [2025-09-29T02:09:02.844206] [INFO ] [MAIN ] UAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.904455] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UAN took 0.5s. Estimated remaining: 1m 6s. Rate: 185.4 symbols/min [2025-09-29T02:09:03.173076] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:03.284184] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-09-29T02:09:03.343423] [INFO ] [MAIN ] UAA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:03.381457] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UAA took 1.2s. Estimated remaining: 1m 6s. Rate: 185.3 symbols/min [2025-09-29T02:09:03.413976] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:03.451178] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:03.679985] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:03.718546] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-29T02:09:03.732261] [INFO ] [MAIN ] UBER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:03.733774] [DEBUG] [LOCAL ] UCB: Loaded 38555 existing records from primary storage. [2025-09-29T02:09:03.735052] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBER took 1.0s. Estimated remaining: 1m 5s. Rate: 185.3 symbols/min [2025-09-29T02:09:03.736934] [INFO ] [MAIN ] UCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:03.769968] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UCB took 0.8s. Estimated remaining: 1m 5s. Rate: 185.4 symbols/min [2025-09-29T02:09:03.827736] [DEBUG] [LOCAL ] UBS: Loaded 53187 existing records from primary storage. [2025-09-29T02:09:03.885912] [INFO ] [MAIN ] UBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:03.914973] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UBS took 1.1s. Estimated remaining: 1m 5s. Rate: 185.4 symbols/min [2025-09-29T02:09:04.176586] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:04.313984] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:04.332274] [DEBUG] [LOCAL ] UDR: Loaded 52555 existing records from primary storage. [2025-09-29T02:09:04.344599] [INFO ] [MAIN ] UDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:04.368471] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UDR took 1.0s. Estimated remaining: 1m 4s. Rate: 185.4 symbols/min [2025-09-29T02:09:04.475464] [DEBUG] [LOCAL ] UFI: Loaded 8229 existing records from primary storage. [2025-09-29T02:09:04.481360] [INFO ] [MAIN ] UFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:04.483449] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:04.501429] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UFI took 0.7s. Estimated remaining: 1m 4s. Rate: 185.5 symbols/min [2025-09-29T02:09:04.623532] [DEBUG] [LOCAL ] UE: Loaded 43513 existing records from primary storage. [2025-09-29T02:09:04.673285] [INFO ] [MAIN ] UE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:04.737258] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UE took 1.0s. Estimated remaining: 1m 4s. Rate: 185.5 symbols/min [2025-09-29T02:09:04.763364] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.007871] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.081103] [DEBUG] [LOCAL ] UGI: Loaded 51290 existing records from primary storage. [2025-09-29T02:09:05.115668] [INFO ] [MAIN ] UGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.102782] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.116136] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGI took 1.2s. Estimated remaining: 1m 3s. Rate: 185.5 symbols/min [2025-09-29T02:09:05.122932] [DEBUG] [LOCAL ] UGP: Loaded 43319 existing records from primary storage. [2025-09-29T02:09:05.155430] [INFO ] [MAIN ] UGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.196308] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGP took 0.8s. Estimated remaining: 1m 3s. Rate: 185.5 symbols/min [2025-09-29T02:09:05.292311] [DEBUG] [LOCAL ] UHAL: Loaded 16817 existing records from primary storage. [2025-09-29T02:09:05.403120] [INFO ] [MAIN ] UHAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.456156] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.477031] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UHAL took 0.9s. Estimated remaining: 1m 3s. Rate: 185.5 symbols/min [2025-09-29T02:09:05.664716] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.683195] [DEBUG] [LOCAL ] UHS: Loaded 41674 existing records from primary storage. [2025-09-29T02:09:05.713780] [INFO ] [MAIN ] UHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.713493] [DEBUG] [LOCAL ] UHT: Loaded 10131 existing records from primary storage. [2025-09-29T02:09:05.726023] [INFO ] [MAIN ] UHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.725136] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 1.0s. Estimated remaining: 1m 2s. Rate: 185.6 symbols/min [2025-09-29T02:09:05.765310] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHT took 0.6s. Estimated remaining: 1m 2s. Rate: 185.6 symbols/min [2025-09-29T02:09:05.961393] [DEBUG] [LOCAL ] UI: Loaded 13008 existing records from primary storage. [2025-09-29T02:09:06.057541] [INFO ] [MAIN ] UI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:06.093444] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UI took 0.9s. Estimated remaining: 1m 2s. Rate: 185.6 symbols/min [2025-09-29T02:09:06.131256] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:06.454498] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:06.614829] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:06.710831] [DEBUG] [LOCAL ] UIS: Loaded 37552 existing records from primary storage. [2025-09-29T02:09:06.711930] [INFO ] [MAIN ] UIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:06.744868] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 1.3s. Estimated remaining: 1m 1s. Rate: 185.5 symbols/min [2025-09-29T02:09:06.744425] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:06.991051] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-09-29T02:09:07.034874] [DEBUG] [LOCAL ] ULS: Loaded 39769 existing records from primary storage. [2025-09-29T02:09:07.035131] [INFO ] [MAIN ] UL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.040495] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. UL took 1.3s. Estimated remaining: 1m 1s. Rate: 185.6 symbols/min [2025-09-29T02:09:07.039901] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:07.046580] [INFO ] [MAIN ] ULS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.090808] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. ULS took 1.3s. Estimated remaining: 1m 1s. Rate: 185.6 symbols/min [2025-09-29T02:09:07.213697] [DEBUG] [LOCAL ] UMC: Loaded 53490 existing records from primary storage. [2025-09-29T02:09:07.259628] [INFO ] [MAIN ] UMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.359164] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMC took 1.2s. Estimated remaining: 1m 0s. Rate: 185.6 symbols/min [2025-09-29T02:09:07.436662] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:07.475189] [DEBUG] [LOCAL ] UMH: Loaded 34078 existing records from primary storage. [2025-09-29T02:09:07.535454] [INFO ] [MAIN ] UMH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.581574] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:07.586904] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMH took 0.8s. Estimated remaining: 1m 0s. Rate: 185.7 symbols/min [2025-09-29T02:09:07.782431] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:07.806022] [DEBUG] [LOCAL ] UNF: Loaded 12048 existing records from primary storage. [2025-09-29T02:09:07.820107] [INFO ] [MAIN ] UNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.825064] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNF took 0.8s. Estimated remaining: 59.8s. Rate: 185.7 symbols/min [2025-09-29T02:09:07.952787] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:08.055308] [DEBUG] [LOCAL ] UNFI: Loaded 42528 existing records from primary storage. [2025-09-29T02:09:08.114586] [INFO ] [MAIN ] UNFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:08.152828] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:08.152996] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 1.0s. Estimated remaining: 59.5s. Rate: 185.7 symbols/min [2025-09-29T02:09:08.247078] [DEBUG] [LOCAL ] UNMA: Loaded 3627 existing records from primary storage. [2025-09-29T02:09:08.292836] [INFO ] [MAIN ] UNMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:08.307879] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNMA took 0.5s. Estimated remaining: 59.1s. Rate: 185.7 symbols/min [2025-09-29T02:09:08.351974] [DEBUG] [LOCAL ] UNM: Loaded 49368 existing records from primary storage. [2025-09-29T02:09:08.328920] [DEBUG] [LOCAL ] UNH: Loaded 54574 existing records from primary storage. [2025-09-29T02:09:08.439835] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:08.418852] [INFO ] [MAIN ] UNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:08.445534] [INFO ] [MAIN ] UNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:08.450897] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNH took 1.1s. Estimated remaining: 58.8s. Rate: 185.8 symbols/min [2025-09-29T02:09:08.473978] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNM took 0.8s. Estimated remaining: 58.4s. Rate: 185.9 symbols/min [2025-09-29T02:09:08.879053] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:08.984574] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:09.037501] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:09.061746] [DEBUG] [LOCAL ] UNP: Loaded 54030 existing records from primary storage. [2025-09-29T02:09:09.062584] [INFO ] [MAIN ] UNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.062762] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 0.9s. Estimated remaining: 58.1s. Rate: 185.8 symbols/min [2025-09-29T02:09:09.312888] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:09.328738] [DEBUG] [LOCAL ] UP: Loaded 43857 existing records from primary storage. [2025-09-29T02:09:09.330112] [DEBUG] [LOCAL ] URI: Loaded 36669 existing records from primary storage. [2025-09-29T02:09:09.347227] [INFO ] [MAIN ] UP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.347419] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UP took 1.0s. Estimated remaining: 57.8s. Rate: 185.8 symbols/min [2025-09-29T02:09:09.347831] [INFO ] [MAIN ] URI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.373455] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. URI took 0.8s. Estimated remaining: 57.5s. Rate: 185.9 symbols/min [2025-09-29T02:09:09.521145] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-29T02:09:09.601610] [INFO ] [MAIN ] UPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.665399] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. UPS took 1.2s. Estimated remaining: 57.1s. Rate: 185.9 symbols/min [2025-09-29T02:09:09.757881] [DEBUG] [LOCAL ] USA: Loaded 36524 existing records from primary storage. [2025-09-29T02:09:09.750199] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:09.790760] [INFO ] [MAIN ] USA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.796460] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USA took 0.7s. Estimated remaining: 56.8s. Rate: 185.9 symbols/min [2025-09-29T02:09:09.945134] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:10.221841] [DEBUG] [LOCAL ] USAC: Loaded 23060 existing records from primary storage. [2025-09-29T02:09:10.230096] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:10.255667] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:10.256171] [INFO ] [MAIN ] USAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.258214] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USAC took 0.9s. Estimated remaining: 56.5s. Rate: 185.9 symbols/min [2025-09-29T02:09:10.474472] [DEBUG] [LOCAL ] USNA: Loaded 18368 existing records from primary storage. [2025-09-29T02:09:10.511485] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:10.512753] [INFO ] [MAIN ] USNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.513977] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-29T02:09:10.515116] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USNA took 0.7s. Estimated remaining: 56.2s. Rate: 185.9 symbols/min [2025-09-29T02:09:10.533052] [INFO ] [MAIN ] USB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.533874] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USB took 1.2s. Estimated remaining: 55.8s. Rate: 186.0 symbols/min [2025-09-29T02:09:10.551363] [DEBUG] [LOCAL ] USPH: Loaded 16827 existing records from primary storage. [2025-09-29T02:09:10.551910] [INFO ] [MAIN ] USPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.552092] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USPH took 0.3s. Estimated remaining: 55.5s. Rate: 186.1 symbols/min [2025-09-29T02:09:10.568328] [DEBUG] [LOCAL ] USFD: Loaded 51959 existing records from primary storage. [2025-09-29T02:09:10.568832] [INFO ] [MAIN ] USFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.569638] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USFD took 0.9s. Estimated remaining: 55.1s. Rate: 186.2 symbols/min [2025-09-29T02:09:11.167716] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.321124] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.360101] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.365499] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.380004] [DEBUG] [LOCAL ] UTL: Loaded 11273 existing records from primary storage. [2025-09-29T02:09:11.380386] [INFO ] [MAIN ] UTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:11.381325] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 0.8s. Estimated remaining: 54.8s. Rate: 186.0 symbols/min [2025-09-29T02:09:11.562366] [DEBUG] [LOCAL ] UTF: Loaded 29200 existing records from primary storage. [2025-09-29T02:09:11.563036] [INFO ] [MAIN ] UTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:11.563462] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTF took 1.0s. Estimated remaining: 54.5s. Rate: 186.1 symbols/min [2025-09-29T02:09:11.706754] [DEBUG] [LOCAL ] UTZ: Loaded 45341 existing records from primary storage. [2025-09-29T02:09:11.700365] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.713544] [DEBUG] [LOCAL ] UTI: Loaded 41146 existing records from primary storage. [2025-09-29T02:09:11.712545] [INFO ] [MAIN ] UTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:11.731945] [INFO ] [MAIN ] UTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:11.732137] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTZ took 1.2s. Estimated remaining: 54.2s. Rate: 186.1 symbols/min [2025-09-29T02:09:11.753856] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTI took 1.2s. Estimated remaining: 53.8s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.083893] [DEBUG] [LOCAL ] UVE: Loaded 22124 existing records from primary storage. [2025-09-29T02:09:12.110004] [INFO ] [MAIN ] UVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.111078] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:12.121931] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 0.7s. Estimated remaining: 53.5s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.290088] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:12.309250] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:12.441553] [DEBUG] [LOCAL ] UVV: Loaded 22660 existing records from primary storage. [2025-09-29T02:09:12.442095] [DEBUG] [LOCAL ] UZD: Loaded 6455 existing records from primary storage. [2025-09-29T02:09:12.502189] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:12.502623] [INFO ] [MAIN ] UZD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.503154] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UZD took 0.7s. Estimated remaining: 53.2s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.504314] [INFO ] [MAIN ] UVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.555433] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UVV took 1.0s. Estimated remaining: 52.8s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.711820] [DEBUG] [LOCAL ] UZE: Loaded 7528 existing records from primary storage. [2025-09-29T02:09:12.768795] [DEBUG] [LOCAL ] UWMC: Loaded 53516 existing records from primary storage. [2025-09-29T02:09:12.766911] [INFO ] [MAIN ] UZE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.821474] [INFO ] [MAIN ] UWMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.815758] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZE took 0.6s. Estimated remaining: 52.5s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.837197] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UWMC took 1.1s. Estimated remaining: 52.2s. Rate: 186.3 symbols/min [2025-09-29T02:09:13.100630] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.016559] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.324774] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.344336] [DEBUG] [LOCAL ] UZF: Loaded 6574 existing records from primary storage. [2025-09-29T02:09:13.370999] [INFO ] [MAIN ] UZF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:13.371210] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 0.9s. Estimated remaining: 51.9s. Rate: 186.3 symbols/min [2025-09-29T02:09:13.444850] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.663212] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.665295] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-09-29T02:09:13.675307] [INFO ] [MAIN ] V: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:13.677380] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. V took 1.1s. Estimated remaining: 51.5s. Rate: 186.3 symbols/min [2025-09-29T02:09:13.678381] [DEBUG] [LOCAL ] VAC: Loaded 35026 existing records from primary storage. [2025-09-29T02:09:13.684535] [INFO ] [MAIN ] VAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:13.709083] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. VAC took 0.9s. Estimated remaining: 51.2s. Rate: 186.3 symbols/min [2025-09-29T02:09:13.946752] [DEBUG] [LOCAL ] VAL: Loaded 51142 existing records from primary storage. [2025-09-29T02:09:13.991214] [INFO ] [MAIN ] VAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.002775] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VAL took 1.1s. Estimated remaining: 50.9s. Rate: 186.4 symbols/min [2025-09-29T02:09:14.126871] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:14.237479] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:14.256202] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-29T02:09:14.296108] [DEBUG] [LOCAL ] VATE: Loaded 5658 existing records from primary storage. [2025-09-29T02:09:14.291627] [INFO ] [MAIN ] VALE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.296672] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VALE took 0.9s. Estimated remaining: 50.5s. Rate: 186.4 symbols/min [2025-09-29T02:09:14.296903] [INFO ] [MAIN ] VATE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.334729] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VATE took 0.7s. Estimated remaining: 50.2s. Rate: 186.4 symbols/min [2025-09-29T02:09:14.420575] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:14.544995] [DEBUG] [LOCAL ] VBF: Loaded 7206 existing records from primary storage. [2025-09-29T02:09:14.552968] [INFO ] [MAIN ] VBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.563513] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VBF took 0.8s. Estimated remaining: 49.9s. Rate: 186.5 symbols/min [2025-09-29T02:09:14.676901] [DEBUG] [LOCAL ] VCV: Loaded 13766 existing records from primary storage. [2025-09-29T02:09:14.752494] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:14.768696] [INFO ] [MAIN ] VCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.815694] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VCV took 0.8s. Estimated remaining: 49.6s. Rate: 186.5 symbols/min [2025-09-29T02:09:15.019312] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:15.109867] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:15.216786] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:15.223904] [DEBUG] [LOCAL ] VEL: Loaded 13299 existing records from primary storage. [2025-09-29T02:09:15.225042] [INFO ] [MAIN ] VEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:15.225357] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 0.8s. Estimated remaining: 49.2s. Rate: 186.5 symbols/min [2025-09-29T02:09:15.372464] [DEBUG] [LOCAL ] VEEV: Loaded 47821 existing records from primary storage. [2025-09-29T02:09:15.435827] [INFO ] [MAIN ] VEEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:15.482791] [DEBUG] [LOCAL ] VET: Loaded 44749 existing records from primary storage. [2025-09-29T02:09:15.482467] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:15.482881] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VEEV took 1.2s. Estimated remaining: 48.9s. Rate: 186.5 symbols/min [2025-09-29T02:09:15.495839] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-29T02:09:15.495707] [INFO ] [MAIN ] VET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:15.517612] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-29T02:09:15.533247] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VET took 0.9s. Estimated remaining: 48.6s. Rate: 186.5 symbols/min [2025-09-29T02:09:15.557994] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-29T02:09:15.580155] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-29T02:09:15.618980] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-29T02:09:15.671472] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-29T02:09:15.666063] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-09-29T02:09:15.790732] [INFO ] [MAIN ] VFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:15.834601] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VFC took 0.9s. Estimated remaining: 48.2s. Rate: 186.5 symbols/min [2025-09-29T02:09:16.049496] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:16.243708] [DEBUG] [LOCAL ] VGI: Loaded 5237 existing records from primary storage. [2025-09-29T02:09:16.248062] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:16.317963] [INFO ] [MAIN ] VGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:16.341249] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VGI took 0.9s. Estimated remaining: 47.9s. Rate: 186.5 symbols/min [2025-09-29T02:09:16.503512] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:16.532165] [DEBUG] [LOCAL ] VGM: Loaded 18384 existing records from primary storage. [2025-09-29T02:09:16.587317] [INFO ] [MAIN ] VGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:16.636780] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VGM took 1.1s. Estimated remaining: 47.6s. Rate: 186.5 symbols/min [2025-09-29T02:09:16.736732] [DEBUG] [LOCAL ] VHI: Loaded 2905 existing records from primary storage. [2025-09-29T02:09:16.803810] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:16.816474] [INFO ] [MAIN ] VHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:16.866569] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:16.877480] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-29T02:09:16.888787] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VHI took 1.0s. Estimated remaining: 47.3s. Rate: 186.5 symbols/min [2025-09-29T02:09:16.888944] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-29T02:09:16.917075] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-29T02:09:16.971447] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-29T02:09:16.995687] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-29T02:09:17.047354] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-29T02:09:17.117470] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:17.074144] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-29T02:09:17.060150] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:17.175851] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-29T02:09:17.278810] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:17.268296] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:17.308277] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-09-29T02:09:17.314418] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:17.336472] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-29T02:09:17.415170] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-29T02:09:17.448205] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-29T02:09:17.507855] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-29T02:09:17.541232] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VG took 2.3s. Estimated remaining: 47.0s. Rate: 186.4 symbols/min [2025-09-29T02:09:17.747388] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:17.773112] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-29T02:09:17.803294] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-09-29T02:09:17.805476] [DEBUG] [LOCAL ] VIK: Loaded 53250 existing records from primary storage. [2025-09-29T02:09:17.806413] [INFO ] [MAIN ] VICI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:17.832705] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VICI took 1.2s. Estimated remaining: 46.7s. Rate: 186.4 symbols/min [2025-09-29T02:09:17.811796] [INFO ] [MAIN ] VIK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:17.893090] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VIK took 1.0s. Estimated remaining: 46.3s. Rate: 186.5 symbols/min [2025-09-29T02:09:17.908211] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:17.957030] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:18.023195] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-29T02:09:18.087175] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:18.138782] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-09-29T02:09:18.226184] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:18.242599] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:18.252110] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-29T02:09:18.277014] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:18.278200] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-29T02:09:18.278515] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-29T02:09:18.278672] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-29T02:09:18.278898] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIA took 1.9s. Estimated remaining: 46.0s. Rate: 186.5 symbols/min [2025-09-29T02:09:18.484585] [DEBUG] [LOCAL ] VIPS: Loaded 52093 existing records from primary storage. [2025-09-29T02:09:18.533305] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:18.533574] [INFO ] [MAIN ] VIPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:18.534373] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIPS took 1.0s. Estimated remaining: 45.7s. Rate: 186.5 symbols/min [2025-09-29T02:09:18.711238] [DEBUG] [LOCAL ] VIRT: Loaded 47448 existing records from primary storage. [2025-09-29T02:09:18.712853] [DEBUG] [LOCAL ] VIST: Loaded 46722 existing records from primary storage. [2025-09-29T02:09:18.731455] [INFO ] [MAIN ] VIST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:18.741920] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIST took 0.8s. Estimated remaining: 45.4s. Rate: 186.5 symbols/min [2025-09-29T02:09:18.742247] [INFO ] [MAIN ] VIRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:18.777907] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VIRT took 0.9s. Estimated remaining: 45.0s. Rate: 186.6 symbols/min [2025-09-29T02:09:18.959381] [DEBUG] [LOCAL ] VIV: Loaded 45667 existing records from primary storage. [2025-09-29T02:09:19.011779] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.060331] [INFO ] [MAIN ] VIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.082834] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIV took 0.8s. Estimated remaining: 44.7s. Rate: 186.6 symbols/min [2025-09-29T02:09:19.158156] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.313069] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.379139] [DEBUG] [LOCAL ] VKQ: Loaded 17552 existing records from primary storage. [2025-09-29T02:09:19.411963] [INFO ] [MAIN ] VKQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.412637] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VKQ took 0.9s. Estimated remaining: 44.4s. Rate: 186.6 symbols/min [2025-09-29T02:09:19.478497] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.468422] [DEBUG] [LOCAL ] VLN: Loaded 29056 existing records from primary storage. [2025-09-29T02:09:19.517604] [INFO ] [MAIN ] VLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.535359] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 0.8s. Estimated remaining: 44.0s. Rate: 186.7 symbols/min [2025-09-29T02:09:19.835424] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.859396] [DEBUG] [LOCAL ] VLO: Loaded 53865 existing records from primary storage. [2025-09-29T02:09:19.870456] [DEBUG] [LOCAL ] VLRS: Loaded 41188 existing records from primary storage. [2025-09-29T02:09:19.881381] [INFO ] [MAIN ] VLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.908837] [INFO ] [MAIN ] VLRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.899922] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLO took 1.1s. Estimated remaining: 43.7s. Rate: 186.7 symbols/min [2025-09-29T02:09:19.936570] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLRS took 0.8s. Estimated remaining: 43.4s. Rate: 186.7 symbols/min [2025-09-29T02:09:19.936131] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.951009] [DEBUG] [LOCAL ] VLT: Loaded 4615 existing records from primary storage. [2025-09-29T02:09:19.956417] [INFO ] [MAIN ] VLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:20.023243] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLT took 0.6s. Estimated remaining: 43.0s. Rate: 186.8 symbols/min [2025-09-29T02:09:20.272210] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:20.333748] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:20.365501] [DEBUG] [LOCAL ] VMI: Loaded 15711 existing records from primary storage. [2025-09-29T02:09:20.380994] [INFO ] [MAIN ] VMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:20.381432] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VMI took 0.4s. Estimated remaining: 42.7s. Rate: 186.8 symbols/min [2025-09-29T02:09:20.382473] [DEBUG] [LOCAL ] VLTO: Loaded 46710 existing records from primary storage. [2025-09-29T02:09:20.382957] [INFO ] [MAIN ] VLTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:20.383053] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VLTO took 0.8s. Estimated remaining: 42.4s. Rate: 186.9 symbols/min [2025-09-29T02:09:20.415314] [DEBUG] [LOCAL ] VMC: Loaded 44263 existing records from primary storage. [2025-09-29T02:09:20.415701] [INFO ] [MAIN ] VMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:20.415805] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 0.5s. Estimated remaining: 42.0s. Rate: 186.9 symbols/min [2025-09-29T02:09:21.070292] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.138176] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.144176] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.200638] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.212302] [DEBUG] [LOCAL ] VNCE: Loaded 7593 existing records from primary storage. [2025-09-29T02:09:21.213034] [INFO ] [MAIN ] VNCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.213718] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 0.8s. Estimated remaining: 41.8s. Rate: 186.8 symbols/min [2025-09-29T02:09:21.380102] [DEBUG] [LOCAL ] VMO: Loaded 21297 existing records from primary storage. [2025-09-29T02:09:21.413785] [INFO ] [MAIN ] VMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.422791] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VMO took 1.0s. Estimated remaining: 41.4s. Rate: 186.8 symbols/min [2025-09-29T02:09:21.453374] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.524592] [DEBUG] [LOCAL ] VNT: Loaded 44451 existing records from primary storage. [2025-09-29T02:09:21.557472] [INFO ] [MAIN ] VNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.563157] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNT took 1.1s. Estimated remaining: 41.1s. Rate: 186.9 symbols/min [2025-09-29T02:09:21.659186] [DEBUG] [LOCAL ] VNO: Loaded 49668 existing records from primary storage. [2025-09-29T02:09:21.670284] [INFO ] [MAIN ] VNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.670982] [DEBUG] [LOCAL ] VOC: Loaded 9021 existing records from primary storage. [2025-09-29T02:09:21.671314] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VNO took 1.2s. Estimated remaining: 40.8s. Rate: 187.0 symbols/min [2025-09-29T02:09:21.787449] [INFO ] [MAIN ] VOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.864338] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VOC took 0.7s. Estimated remaining: 40.4s. Rate: 187.0 symbols/min [2025-09-29T02:09:21.846597] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:22.119470] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:22.149327] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-29T02:09:22.149558] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-29T02:09:22.223615] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-29T02:09:22.232993] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:22.233860] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-29T02:09:22.234460] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-29T02:09:22.240060] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-29T02:09:22.408718] [DEBUG] [LOCAL ] VPG: Loaded 17373 existing records from primary storage. [2025-09-29T02:09:22.390921] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:22.433051] [INFO ] [MAIN ] VPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:22.433463] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VPG took 0.7s. Estimated remaining: 40.1s. Rate: 186.9 symbols/min [2025-09-29T02:09:22.491339] [DEBUG] [LOCAL ] VOYA: Loaded 43377 existing records from primary storage. [2025-09-29T02:09:22.549032] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-09-29T02:09:22.554484] [INFO ] [MAIN ] VOYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:22.591865] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VOYA took 1.1s. Estimated remaining: 39.8s. Rate: 187.0 symbols/min [2025-09-29T02:09:22.637088] [INFO ] [MAIN ] VPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:22.705314] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VPV took 0.8s. Estimated remaining: 39.5s. Rate: 187.0 symbols/min [2025-09-29T02:09:23.015295] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.245081] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.340639] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:23.387875] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.388627] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-29T02:09:23.410024] [DEBUG] [LOCAL ] VRE: Loaded 35345 existing records from primary storage. [2025-09-29T02:09:23.410717] [INFO ] [MAIN ] VRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:23.411041] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VRE took 1.0s. Estimated remaining: 39.2s. Rate: 186.9 symbols/min [2025-09-29T02:09:23.455302] [DEBUG] [LOCAL ] VRTS: Loaded 9287 existing records from primary storage. [2025-09-29T02:09:23.496575] [INFO ] [MAIN ] VRTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:23.522718] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRTS took 0.7s. Estimated remaining: 38.8s. Rate: 187.0 symbols/min [2025-09-29T02:09:23.540241] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:23.616185] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-29T02:09:23.719422] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.736228] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:23.741729] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-09-29T02:09:23.780389] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:23.808734] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-29T02:09:23.847625] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.847770] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-29T02:09:23.850185] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-29T02:09:23.850825] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-29T02:09:23.850976] [INFO ] [MAIN ] VRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:23.851616] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRT took 1.2s. Estimated remaining: 38.5s. Rate: 187.0 symbols/min [2025-09-29T02:09:23.851221] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-29T02:09:23.851987] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VOYG took 2.3s. Estimated remaining: 38.2s. Rate: 187.1 symbols/min [2025-09-29T02:09:24.254455] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:24.303941] [DEBUG] [LOCAL ] VSCO: Loaded 53556 existing records from primary storage. [2025-09-29T02:09:24.305580] [DEBUG] [LOCAL ] VSH: Loaded 49188 existing records from primary storage. [2025-09-29T02:09:24.305863] [INFO ] [MAIN ] VSCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:24.329706] [INFO ] [MAIN ] VSH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:24.336165] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:24.336477] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 0.9s. Estimated remaining: 37.9s. Rate: 187.0 symbols/min [2025-09-29T02:09:24.338127] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 0.8s. Estimated remaining: 37.5s. Rate: 187.1 symbols/min [2025-09-29T02:09:24.816461] [DEBUG] [LOCAL ] VSTS: Loaded 49773 existing records from primary storage. [2025-09-29T02:09:24.869887] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-09-29T02:09:24.875608] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:24.877214] [INFO ] [MAIN ] VSTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:24.876932] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:24.878030] [INFO ] [MAIN ] VST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:24.878978] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VSTS took 1.0s. Estimated remaining: 37.2s. Rate: 187.0 symbols/min [2025-09-29T02:09:24.886170] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VST took 1.0s. Estimated remaining: 36.9s. Rate: 187.1 symbols/min [2025-09-29T02:09:25.325828] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:25.330535] [DEBUG] [LOCAL ] VTEX: Loaded 43948 existing records from primary storage. [2025-09-29T02:09:25.328076] [DEBUG] [LOCAL ] VTLE: Loaded 49337 existing records from primary storage. [2025-09-29T02:09:25.359052] [INFO ] [MAIN ] VTEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:25.359897] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTEX took 1.0s. Estimated remaining: 36.6s. Rate: 187.1 symbols/min [2025-09-29T02:09:25.357796] [INFO ] [MAIN ] VTLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:25.358917] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:25.365659] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTLE took 1.0s. Estimated remaining: 36.2s. Rate: 187.2 symbols/min [2025-09-29T02:09:25.604800] [DEBUG] [LOCAL ] VTN: Loaded 7293 existing records from primary storage. [2025-09-29T02:09:25.584841] [DEBUG] [LOCAL ] VTMX: Loaded 17811 existing records from primary storage. [2025-09-29T02:09:25.678317] [INFO ] [MAIN ] VTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:25.707793] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTN took 0.8s. Estimated remaining: 35.9s. Rate: 187.2 symbols/min [2025-09-29T02:09:25.712259] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:25.696550] [INFO ] [MAIN ] VTMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:25.723614] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTMX took 0.8s. Estimated remaining: 35.6s. Rate: 187.2 symbols/min [2025-09-29T02:09:25.945390] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:26.043992] [DEBUG] [LOCAL ] VTOL: Loaded 19915 existing records from primary storage. [2025-09-29T02:09:26.138823] [INFO ] [MAIN ] VTOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:26.166162] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:26.197520] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:26.198380] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 0.8s. Estimated remaining: 35.3s. Rate: 187.2 symbols/min [2025-09-29T02:09:26.441080] [DEBUG] [LOCAL ] VTS: Loaded 30992 existing records from primary storage. [2025-09-29T02:09:26.458496] [DEBUG] [LOCAL ] VVR: Loaded 31251 existing records from primary storage. [2025-09-29T02:09:26.478466] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:26.474256] [INFO ] [MAIN ] VTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:26.480839] [INFO ] [MAIN ] VVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:26.480400] [DEBUG] [LOCAL ] VTR: Loaded 53620 existing records from primary storage. [2025-09-29T02:09:26.480950] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTS took 0.8s. Estimated remaining: 34.9s. Rate: 187.2 symbols/min [2025-09-29T02:09:26.481804] [INFO ] [MAIN ] VTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:26.487782] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTR took 1.1s. Estimated remaining: 34.6s. Rate: 187.3 symbols/min [2025-09-29T02:09:26.499118] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVR took 0.7s. Estimated remaining: 34.3s. Rate: 187.4 symbols/min [2025-09-29T02:09:26.992781] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.092810] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.093888] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.119065] [DEBUG] [LOCAL ] VVV: Loaded 50933 existing records from primary storage. [2025-09-29T02:09:27.119578] [INFO ] [MAIN ] VVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:27.119821] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVV took 0.9s. Estimated remaining: 34.0s. Rate: 187.3 symbols/min [2025-09-29T02:09:27.190572] [DEBUG] [LOCAL ] VVX: Loaded 23664 existing records from primary storage. [2025-09-29T02:09:27.225728] [INFO ] [MAIN ] VVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:27.257558] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 0.8s. Estimated remaining: 33.6s. Rate: 187.3 symbols/min [2025-09-29T02:09:27.440463] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.484294] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-29T02:09:27.507072] [DEBUG] [LOCAL ] VYX: Loaded 49624 existing records from primary storage. [2025-09-29T02:09:27.507292] [INFO ] [MAIN ] VZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:27.527169] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VZ took 1.0s. Estimated remaining: 33.3s. Rate: 187.3 symbols/min [2025-09-29T02:09:27.537838] [INFO ] [MAIN ] VYX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:27.555508] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VYX took 1.1s. Estimated remaining: 33.0s. Rate: 187.4 symbols/min [2025-09-29T02:09:27.697881] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.973589] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.987700] [DEBUG] [LOCAL ] W: Loaded 54266 existing records from primary storage. [2025-09-29T02:09:28.004600] [INFO ] [MAIN ] W: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:28.062199] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 0.9s. Estimated remaining: 32.7s. Rate: 187.4 symbols/min [2025-09-29T02:09:28.061568] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:28.257578] [DEBUG] [LOCAL ] WAB: Loaded 44872 existing records from primary storage. [2025-09-29T02:09:28.345130] [DEBUG] [LOCAL ] WAT: Loaded 35620 existing records from primary storage. [2025-09-29T02:09:28.328352] [DEBUG] [LOCAL ] WAL: Loaded 46040 existing records from primary storage. [2025-09-29T02:09:28.325306] [INFO ] [MAIN ] WAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:28.348856] [INFO ] [MAIN ] WAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:28.350175] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:28.350405] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WAB took 1.1s. Estimated remaining: 32.3s. Rate: 187.4 symbols/min [2025-09-29T02:09:28.351309] [INFO ] [MAIN ] WAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:28.351494] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-29T02:09:28.351586] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-29T02:09:28.351765] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-29T02:09:28.351853] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-29T02:09:28.351939] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-29T02:09:28.352014] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-29T02:09:28.413337] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAT took 0.7s. Estimated remaining: 32.0s. Rate: 187.4 symbols/min [2025-09-29T02:09:28.498082] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAL took 0.8s. Estimated remaining: 31.7s. Rate: 187.5 symbols/min [2025-09-29T02:09:28.956040] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.176615] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.402941] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.433781] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:29.434991] [DEBUG] [LOCAL ] WBX: Loaded 12558 existing records from primary storage. [2025-09-29T02:09:29.436907] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-29T02:09:29.450114] [INFO ] [MAIN ] WBX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:29.450972] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WBX took 1.0s. Estimated remaining: 31.4s. Rate: 187.3 symbols/min [2025-09-29T02:09:29.473392] [DEBUG] [LOCAL ] WBS: Loaded 49471 existing records from primary storage. [2025-09-29T02:09:29.505727] [INFO ] [MAIN ] WBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:29.529500] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBS took 1.1s. Estimated remaining: 31.1s. Rate: 187.4 symbols/min [2025-09-29T02:09:29.594240] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:29.642795] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-29T02:09:29.705744] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:29.785626] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.803637] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-09-29T02:09:29.820496] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:29.847270] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-29T02:09:29.855289] [DEBUG] [LOCAL ] WCC: Loaded 40567 existing records from primary storage. [2025-09-29T02:09:29.886192] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.886325] [INFO ] [MAIN ] WCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:29.886415] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-29T02:09:29.887379] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-29T02:09:29.887604] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WCC took 1.2s. Estimated remaining: 30.7s. Rate: 187.4 symbols/min [2025-09-29T02:09:29.893215] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-29T02:09:29.900396] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WBI took 1.8s. Estimated remaining: 30.4s. Rate: 187.5 symbols/min [2025-09-29T02:09:30.186897] [DEBUG] [LOCAL ] WD: Loaded 23747 existing records from primary storage. [2025-09-29T02:09:30.198590] [INFO ] [MAIN ] WD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:30.270689] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WD took 0.7s. Estimated remaining: 30.1s. Rate: 187.5 symbols/min [2025-09-29T02:09:30.345906] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:30.368514] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:30.370846] [DEBUG] [LOCAL ] WCN: Loaded 48708 existing records from primary storage. [2025-09-29T02:09:30.373489] [INFO ] [MAIN ] WCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:30.373611] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WCN took 0.9s. Estimated remaining: 29.8s. Rate: 187.5 symbols/min [2025-09-29T02:09:30.418677] [DEBUG] [LOCAL ] WDI: Loaded 21314 existing records from primary storage. [2025-09-29T02:09:30.419093] [DEBUG] [LOCAL ] WDH: Loaded 17597 existing records from primary storage. [2025-09-29T02:09:30.419511] [INFO ] [MAIN ] WDH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:30.419596] [INFO ] [MAIN ] WDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:30.419820] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WDH took 0.5s. Estimated remaining: 29.4s. Rate: 187.6 symbols/min [2025-09-29T02:09:30.420060] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 0.5s. Estimated remaining: 29.1s. Rate: 187.7 symbols/min [2025-09-29T02:09:31.098728] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.192073] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.281181] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.286127] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.317503] [DEBUG] [LOCAL ] WEA: Loaded 7379 existing records from primary storage. [2025-09-29T02:09:31.318186] [INFO ] [MAIN ] WEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:31.318515] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 0.9s. Estimated remaining: 28.8s. Rate: 187.5 symbols/min [2025-09-29T02:09:31.492477] [DEBUG] [LOCAL ] WEAV: Loaded 42562 existing records from primary storage. [2025-09-29T02:09:31.509450] [INFO ] [MAIN ] WEAV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:31.557735] [DEBUG] [LOCAL ] WEC: Loaded 52958 existing records from primary storage. [2025-09-29T02:09:31.540598] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 1.1s. Estimated remaining: 28.5s. Rate: 187.5 symbols/min [2025-09-29T02:09:31.616536] [DEBUG] [LOCAL ] WDS: Loaded 44259 existing records from primary storage. [2025-09-29T02:09:31.626102] [INFO ] [MAIN ] WDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:31.646004] [INFO ] [MAIN ] WEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:31.657440] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.665147] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 1.2s. Estimated remaining: 28.1s. Rate: 187.6 symbols/min [2025-09-29T02:09:31.702878] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 1.3s. Estimated remaining: 27.8s. Rate: 187.7 symbols/min [2025-09-29T02:09:32.112876] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:32.216896] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:32.285486] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:32.304736] [DEBUG] [LOCAL ] WELL: Loaded 53132 existing records from primary storage. [2025-09-29T02:09:32.305507] [INFO ] [MAIN ] WELL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:32.305603] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 1.0s. Estimated remaining: 27.5s. Rate: 187.6 symbols/min [2025-09-29T02:09:32.449548] [DEBUG] [LOCAL ] WF: Loaded 10903 existing records from primary storage. [2025-09-29T02:09:32.450027] [INFO ] [MAIN ] WF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:32.501871] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WF took 0.8s. Estimated remaining: 27.2s. Rate: 187.6 symbols/min [2025-09-29T02:09:32.571527] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:32.656110] [DEBUG] [LOCAL ] WEX: Loaded 35697 existing records from primary storage. [2025-09-29T02:09:32.668017] [DEBUG] [LOCAL ] WES: Loaded 48689 existing records from primary storage. [2025-09-29T02:09:32.696965] [INFO ] [MAIN ] WES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:32.697090] [INFO ] [MAIN ] WEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:32.702970] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WES took 1.1s. Estimated remaining: 26.9s. Rate: 187.7 symbols/min [2025-09-29T02:09:32.715477] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WEX took 1.0s. Estimated remaining: 26.5s. Rate: 187.7 symbols/min [2025-09-29T02:09:32.839975] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.183046] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.187260] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.217014] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-29T02:09:33.218381] [INFO ] [MAIN ] WFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.219489] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFC took 0.9s. Estimated remaining: 26.2s. Rate: 187.7 symbols/min [2025-09-29T02:09:33.218140] [DEBUG] [LOCAL ] WFG: Loaded 25211 existing records from primary storage. [2025-09-29T02:09:33.220240] [INFO ] [MAIN ] WFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.232220] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFG took 0.7s. Estimated remaining: 25.9s. Rate: 187.8 symbols/min [2025-09-29T02:09:33.677841] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.682297] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.684079] [DEBUG] [LOCAL ] WH: Loaded 46339 existing records from primary storage. [2025-09-29T02:09:33.685969] [DEBUG] [LOCAL ] WGO: Loaded 39823 existing records from primary storage. [2025-09-29T02:09:33.687133] [INFO ] [MAIN ] WH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.687323] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WH took 0.9s. Estimated remaining: 25.6s. Rate: 187.7 symbols/min [2025-09-29T02:09:33.688713] [INFO ] [MAIN ] WGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.728402] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WGO took 1.0s. Estimated remaining: 25.2s. Rate: 187.8 symbols/min [2025-09-29T02:09:33.844081] [DEBUG] [LOCAL ] WHG: Loaded 3416 existing records from primary storage. [2025-09-29T02:09:33.899671] [INFO ] [MAIN ] WHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.941086] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 0.7s. Estimated remaining: 24.9s. Rate: 187.8 symbols/min [2025-09-29T02:09:34.128532] [DEBUG] [LOCAL ] WHD: Loaded 41130 existing records from primary storage. [2025-09-29T02:09:34.208929] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.237772] [INFO ] [MAIN ] WHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:34.270052] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.276386] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 1.1s. Estimated remaining: 24.6s. Rate: 187.8 symbols/min [2025-09-29T02:09:34.462428] [DEBUG] [LOCAL ] WIA: Loaded 4937 existing records from primary storage. [2025-09-29T02:09:34.509690] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.511320] [INFO ] [MAIN ] WIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:34.517462] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 0.8s. Estimated remaining: 24.3s. Rate: 187.8 symbols/min [2025-09-29T02:09:34.723542] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.782983] [DEBUG] [LOCAL ] WINN: Loaded 11944 existing records from primary storage. [2025-09-29T02:09:34.783788] [INFO ] [MAIN ] WINN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:34.800524] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 0.8s. Estimated remaining: 24.0s. Rate: 187.9 symbols/min [2025-09-29T02:09:34.836708] [DEBUG] [LOCAL ] WHR: Loaded 48846 existing records from primary storage. [2025-09-29T02:09:34.884853] [INFO ] [MAIN ] WHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:34.980628] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.991873] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 1.3s. Estimated remaining: 23.6s. Rate: 187.9 symbols/min [2025-09-29T02:09:35.250606] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:35.362362] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:35.363001] [DEBUG] [LOCAL ] WIW: Loaded 20756 existing records from primary storage. [2025-09-29T02:09:35.364877] [DEBUG] [LOCAL ] WIT: Loaded 53070 existing records from primary storage. [2025-09-29T02:09:35.366045] [INFO ] [MAIN ] WIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:35.365959] [INFO ] [MAIN ] WIW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:35.366618] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIT took 1.1s. Estimated remaining: 23.3s. Rate: 187.9 symbols/min [2025-09-29T02:09:35.367239] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIW took 0.8s. Estimated remaining: 23.0s. Rate: 188.0 symbols/min [2025-09-29T02:09:35.725965] [DEBUG] [LOCAL ] WK: Loaded 37342 existing records from primary storage. [2025-09-29T02:09:35.720222] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:35.737066] [INFO ] [MAIN ] WK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:35.738507] [DEBUG] [LOCAL ] WKC: Loaded 35538 existing records from primary storage. [2025-09-29T02:09:35.739412] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 0.9s. Estimated remaining: 22.7s. Rate: 187.9 symbols/min [2025-09-29T02:09:35.750362] [INFO ] [MAIN ] WKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:35.808743] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 0.8s. Estimated remaining: 22.3s. Rate: 188.0 symbols/min [2025-09-29T02:09:35.845179] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:36.113407] [DEBUG] [LOCAL ] WLKP: Loaded 6800 existing records from primary storage. [2025-09-29T02:09:36.146327] [INFO ] [MAIN ] WLKP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:36.239500] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:36.214613] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 0.8s. Estimated remaining: 22.0s. Rate: 188.0 symbols/min [2025-09-29T02:09:36.313899] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:36.345083] [DEBUG] [LOCAL ] WLK: Loaded 46113 existing records from primary storage. [2025-09-29T02:09:36.350430] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-29T02:09:36.375566] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-29T02:09:36.375950] [INFO ] [MAIN ] WLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:36.410559] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 1.0s. Estimated remaining: 21.7s. Rate: 188.0 symbols/min [2025-09-29T02:09:36.415696] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-29T02:09:36.416018] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-29T02:09:36.427374] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-29T02:09:36.427767] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-29T02:09:36.721340] [DEBUG] [LOCAL ] WLY: Loaded 30414 existing records from primary storage. [2025-09-29T02:09:36.761858] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:36.762107] [INFO ] [MAIN ] WLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:36.764563] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLY took 0.9s. Estimated remaining: 21.4s. Rate: 188.0 symbols/min [2025-09-29T02:09:37.024696] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:37.305907] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:37.395862] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:37.414891] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-29T02:09:37.422316] [DEBUG] [LOCAL ] WM: Loaded 51697 existing records from primary storage. [2025-09-29T02:09:37.422920] [INFO ] [MAIN ] WM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:37.429633] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WM took 1.1s. Estimated remaining: 21.1s. Rate: 187.9 symbols/min [2025-09-29T02:09:37.430352] [DEBUG] [LOCAL ] WMK: Loaded 14753 existing records from primary storage. [2025-09-29T02:09:37.443159] [INFO ] [MAIN ] WMK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:37.484551] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMK took 0.6s. Estimated remaining: 20.7s. Rate: 188.0 symbols/min [2025-09-29T02:09:37.675086] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T02:09:37.697524] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-29T02:09:37.709201] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-29T02:09:37.734591] [INFO ] [MAIN ] WMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:37.735090] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMB took 1.3s. Estimated remaining: 20.4s. Rate: 188.0 symbols/min [2025-09-29T02:09:37.935947] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:37.951501] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:37.966458] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T02:09:37.989531] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-29T02:09:38.116061] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:38.166601] [DEBUG] [LOCAL ] WMS: Loaded 40249 existing records from primary storage. [2025-09-29T02:09:38.167437] [INFO ] [MAIN ] WMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:38.167598] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMS took 0.7s. Estimated remaining: 20.1s. Rate: 188.0 symbols/min [2025-09-29T02:09:38.294278] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-29T02:09:38.299717] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T02:09:38.317606] [INFO ] [MAIN ] WMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:38.319262] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-29T02:09:38.319965] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMT took 0.8s. Estimated remaining: 19.8s. Rate: 188.0 symbols/min [2025-09-29T02:09:38.450891] [DEBUG] [LOCAL ] WNC: Loaded 40452 existing records from primary storage. [2025-09-29T02:09:38.495864] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:38.514799] [INFO ] [MAIN ] WNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:38.535613] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 0.7s. Estimated remaining: 19.5s. Rate: 188.0 symbols/min [2025-09-29T02:09:38.684843] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:38.840428] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:38.845727] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T02:09:38.847021] [DEBUG] [LOCAL ] WNS: Loaded 40539 existing records from primary storage. [2025-09-29T02:09:38.849109] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-29T02:09:38.851884] [INFO ] [MAIN ] WNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:38.853081] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNS took 0.7s. Estimated remaining: 19.1s. Rate: 188.0 symbols/min [2025-09-29T02:09:39.117355] [DEBUG] [LOCAL ] WOR: Loaded 25288 existing records from primary storage. [2025-09-29T02:09:39.078898] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-29T02:09:39.118137] [INFO ] [MAIN ] WOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.118384] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WOR took 0.6s. Estimated remaining: 18.8s. Rate: 188.1 symbols/min [2025-09-29T02:09:39.123413] [INFO ] [MAIN ] WOLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.123211] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:39.141849] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 0.8s. Estimated remaining: 18.5s. Rate: 188.1 symbols/min [2025-09-29T02:09:39.201000] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-29T02:09:39.223567] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-29T02:09:39.526989] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:39.562704] [DEBUG] [LOCAL ] WOW: Loaded 30769 existing records from primary storage. [2025-09-29T02:09:39.568483] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:39.569551] [INFO ] [MAIN ] WOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.573004] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T02:09:39.573451] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOW took 0.7s. Estimated remaining: 18.2s. Rate: 188.1 symbols/min [2025-09-29T02:09:39.577480] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-29T02:09:39.816794] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:39.820300] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-29T02:09:39.837827] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-29T02:09:39.840492] [DEBUG] [LOCAL ] WPC: Loaded 49217 existing records from primary storage. [2025-09-29T02:09:39.856403] [INFO ] [MAIN ] WPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.858610] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WPC took 0.7s. Estimated remaining: 17.9s. Rate: 188.1 symbols/min [2025-09-29T02:09:39.872123] [DEBUG] [LOCAL ] WPM: Loaded 53504 existing records from primary storage. [2025-09-29T02:09:39.912941] [INFO ] [MAIN ] WPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.958372] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPM took 0.8s. Estimated remaining: 17.5s. Rate: 188.2 symbols/min [2025-09-29T02:09:40.116500] [DEBUG] [LOCAL ] WPP: Loaded 34282 existing records from primary storage. [2025-09-29T02:09:40.161615] [INFO ] [MAIN ] WPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:40.163637] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-29T02:09:40.202503] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:40.203927] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPP took 0.6s. Estimated remaining: 17.2s. Rate: 188.2 symbols/min [2025-09-29T02:09:40.205551] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-29T02:09:40.291010] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:40.356000] [DEBUG] [LOCAL ] WRB: Loaded 51313 existing records from primary storage. [2025-09-29T02:09:40.356666] [INFO ] [MAIN ] WRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:40.357216] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WRB took 0.5s. Estimated remaining: 16.9s. Rate: 188.2 symbols/min [2025-09-29T02:09:40.383638] [DEBUG] [LOCAL ] WRBY: Loaded 51609 existing records from primary storage. [2025-09-29T02:09:40.384179] [INFO ] [MAIN ] WRBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:40.384932] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRBY took 0.4s. Estimated remaining: 16.6s. Rate: 188.3 symbols/min [2025-09-29T02:09:40.525606] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-29T02:09:40.526883] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-29T02:09:40.737085] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-29T02:09:40.738042] [INFO ] [REMOTE ] WLTG: Full fetch complete (1661 records). [2025-09-29T02:09:40.738158] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-29T02:09:40.926975] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:09:40.927235] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:09:40.927328] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:09:40.927426] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-29T02:09:40.927559] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-29T02:09:40.927679] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-29T02:09:40.927785] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-29T02:09:40.927875] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WLTG took 5.2s. Estimated remaining: 16.3s. Rate: 188.2 symbols/min [2025-09-29T02:09:41.529684] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:41.619952] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:41.640837] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:41.724550] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:41.758195] [DEBUG] [LOCAL ] WSO: Loaded 25059 existing records from primary storage. [2025-09-29T02:09:41.768590] [INFO ] [MAIN ] WSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:41.768804] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSO took 0.8s. Estimated remaining: 15.9s. Rate: 188.1 symbols/min [2025-09-29T02:09:41.769454] [DEBUG] [LOCAL ] WS: Loaded 24434 existing records from primary storage. [2025-09-29T02:09:41.771091] [INFO ] [MAIN ] WS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:41.796787] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WS took 0.9s. Estimated remaining: 15.6s. Rate: 188.2 symbols/min [2025-09-29T02:09:41.803423] [DEBUG] [LOCAL ] WSR: Loaded 23550 existing records from primary storage. [2025-09-29T02:09:41.816845] [INFO ] [MAIN ] WSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:41.891369] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSR took 0.9s. Estimated remaining: 15.3s. Rate: 188.2 symbols/min [2025-09-29T02:09:42.228475] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.268255] [DEBUG] [LOCAL ] WSM: Loaded 50533 existing records from primary storage. [2025-09-29T02:09:42.312366] [INFO ] [MAIN ] WSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:42.326391] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 1.4s. Estimated remaining: 15.0s. Rate: 188.2 symbols/min [2025-09-29T02:09:42.411322] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.432288] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.598212] [DEBUG] [LOCAL ] WST: Loaded 38092 existing records from primary storage. [2025-09-29T02:09:42.652359] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.647712] [INFO ] [MAIN ] WST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:42.663382] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 0.9s. Estimated remaining: 14.7s. Rate: 188.2 symbols/min [2025-09-29T02:09:42.678489] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-29T02:09:42.705250] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-29T02:09:42.716779] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-29T02:09:42.732570] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-29T02:09:42.777249] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-29T02:09:42.822242] [DEBUG] [LOCAL ] WT: Loaded 48354 existing records from primary storage. [2025-09-29T02:09:42.849233] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-29T02:09:42.843918] [DEBUG] [LOCAL ] WTI: Loaded 44472 existing records from primary storage. [2025-09-29T02:09:42.921468] [INFO ] [MAIN ] WT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:42.878221] [INFO ] [MAIN ] WTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:42.942460] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WT took 1.1s. Estimated remaining: 14.3s. Rate: 188.2 symbols/min [2025-09-29T02:09:42.952304] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.982316] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WTI took 1.0s. Estimated remaining: 14.0s. Rate: 188.3 symbols/min [2025-09-29T02:09:43.445766] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:43.591633] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:43.729878] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:43.731775] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-09-29T02:09:43.732570] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-29T02:09:43.734133] [INFO ] [MAIN ] WTRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:43.734268] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTRG took 1.1s. Estimated remaining: 13.7s. Rate: 188.2 symbols/min [2025-09-29T02:09:43.790026] [DEBUG] [LOCAL ] WTS: Loaded 18597 existing records from primary storage. [2025-09-29T02:09:43.796136] [INFO ] [MAIN ] WTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:43.816256] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTS took 0.8s. Estimated remaining: 13.4s. Rate: 188.2 symbols/min [2025-09-29T02:09:44.077079] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T02:09:43.952333] [DEBUG] [LOCAL ] WTTR: Loaded 45735 existing records from primary storage. [2025-09-29T02:09:44.056128] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:44.094134] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-29T02:09:44.106520] [INFO ] [MAIN ] WTTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:44.131056] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTTR took 1.1s. Estimated remaining: 13.1s. Rate: 188.2 symbols/min [2025-09-29T02:09:44.274772] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:44.441538] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:44.463560] [DEBUG] [LOCAL ] WU: Loaded 54232 existing records from primary storage. [2025-09-29T02:09:44.464223] [INFO ] [MAIN ] WU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:44.464677] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WU took 0.7s. Estimated remaining: 12.7s. Rate: 188.2 symbols/min [2025-09-29T02:09:44.556055] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T02:09:44.596007] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-29T02:09:44.633112] [DEBUG] [LOCAL ] WWW: Loaded 49906 existing records from primary storage. [2025-09-29T02:09:44.662061] [INFO ] [MAIN ] WWW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:44.676472] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WWW took 0.8s. Estimated remaining: 12.4s. Rate: 188.3 symbols/min [2025-09-29T02:09:44.719201] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:44.855249] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-29T02:09:44.864296] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-29T02:09:44.857031] [DEBUG] [LOCAL ] WY: Loaded 53899 existing records from primary storage. [2025-09-29T02:09:44.869890] [INFO ] [MAIN ] WY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:44.876673] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WY took 0.7s. Estimated remaining: 12.1s. Rate: 188.3 symbols/min [2025-09-29T02:09:45.001768] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:45.103853] [DEBUG] [LOCAL ] XFLT: Loaded 30306 existing records from primary storage. [2025-09-29T02:09:45.164614] [INFO ] [MAIN ] XFLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:45.169299] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:45.173305] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XFLT took 0.7s. Estimated remaining: 11.8s. Rate: 188.3 symbols/min [2025-09-29T02:09:45.173439] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T02:09:45.173684] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-29T02:09:45.174188] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-29T02:09:45.181269] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-29T02:09:45.217190] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-29T02:09:45.241735] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-29T02:09:45.289744] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-29T02:09:45.296542] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-29T02:09:45.517545] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:45.519258] [DEBUG] [LOCAL ] XHR: Loaded 44680 existing records from primary storage. [2025-09-29T02:09:45.522973] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T02:09:45.544527] [INFO ] [MAIN ] XHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:45.551345] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-29T02:09:45.574576] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XHR took 0.9s. Estimated remaining: 11.5s. Rate: 188.3 symbols/min [2025-09-29T02:09:45.855369] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T02:09:45.894627] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-29T02:09:46.025638] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:46.052226] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:46.053172] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-29T02:09:46.073778] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-09-29T02:09:46.074409] [INFO ] [MAIN ] XOM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:46.074519] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XOM took 0.9s. Estimated remaining: 11.2s. Rate: 188.2 symbols/min [2025-09-29T02:09:46.216624] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:46.250363] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-29T02:09:46.243984] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T02:09:46.267493] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:46.267371] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-29T02:09:46.267636] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-09-29T02:09:46.345779] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:46.344333] [DEBUG] [LOCAL ] XPER: Loaded 30181 existing records from primary storage. [2025-09-29T02:09:46.345616] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:46.345934] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-29T02:09:46.347761] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-29T02:09:46.347862] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-29T02:09:46.347978] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-29T02:09:46.348167] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XIFR took 1.4s. Estimated remaining: 10.8s. Rate: 188.2 symbols/min [2025-09-29T02:09:46.346488] [INFO ] [MAIN ] XPER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:46.397277] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPER took 0.8s. Estimated remaining: 10.5s. Rate: 188.3 symbols/min [2025-09-29T02:09:46.691890] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:46.711431] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T02:09:46.767900] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:46.770449] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-29T02:09:46.792256] [DEBUG] [LOCAL ] XPEV: Loaded 54419 existing records from primary storage. [2025-09-29T02:09:46.793679] [INFO ] [MAIN ] XPEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:46.794326] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPEV took 0.7s. Estimated remaining: 10.2s. Rate: 188.3 symbols/min [2025-09-29T02:09:47.046229] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:47.047958] [DEBUG] [LOCAL ] XPO: Loaded 48656 existing records from primary storage. [2025-09-29T02:09:47.048789] [DEBUG] [LOCAL ] XPOF: Loaded 39243 existing records from primary storage. [2025-09-29T02:09:47.049572] [INFO ] [MAIN ] XPOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:47.049807] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPOF took 0.6s. Estimated remaining: 9.9s. Rate: 188.3 symbols/min [2025-09-29T02:09:47.049951] [INFO ] [MAIN ] XPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:47.056046] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPO took 0.7s. Estimated remaining: 9.6s. Rate: 188.4 symbols/min [2025-09-29T02:09:47.092692] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-29T02:09:47.150512] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-29T02:09:47.474343] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:47.478588] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:47.482783] [DEBUG] [LOCAL ] XPRO: Loaded 46617 existing records from primary storage. [2025-09-29T02:09:47.483517] [INFO ] [MAIN ] XPRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:47.483668] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPRO took 0.7s. Estimated remaining: 9.2s. Rate: 188.4 symbols/min [2025-09-29T02:09:47.675378] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-29T02:09:47.694430] [DEBUG] [LOCAL ] XYF: Loaded 28464 existing records from primary storage. [2025-09-29T02:09:47.716842] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:47.733472] [INFO ] [REMOTE ] WTM: Full fetch complete (2277 records). [2025-09-29T02:09:47.733579] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-29T02:09:47.733861] [INFO ] [MAIN ] XYF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:47.734563] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYF took 0.7s. Estimated remaining: 8.9s. Rate: 188.4 symbols/min [2025-09-29T02:09:47.734110] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-29T02:09:47.735346] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-29T02:09:47.746319] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-29T02:09:47.824733] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-29T02:09:47.912595] [DEBUG] [LOCAL ] XYL: Loaded 48777 existing records from primary storage. [2025-09-29T02:09:47.912706] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-29T02:09:47.987888] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-29T02:09:47.973937] [INFO ] [MAIN ] XYL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:48.019219] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XYL took 0.9s. Estimated remaining: 8.6s. Rate: 188.4 symbols/min [2025-09-29T02:09:48.294887] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:09:48.371733] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:09:48.378985] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:09:48.378785] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:48.407560] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-29T02:09:48.413378] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-29T02:09:48.464719] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-29T02:09:48.498476] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-29T02:09:48.499009] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. WTM took 6.1s. Estimated remaining: 8.3s. Rate: 188.3 symbols/min [2025-09-29T02:09:48.634006] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:48.864520] [DEBUG] [LOCAL ] YALA: Loaded 37892 existing records from primary storage. [2025-09-29T02:09:48.904813] [INFO ] [MAIN ] YALA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:48.905026] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. YALA took 1.2s. Estimated remaining: 8.0s. Rate: 188.3 symbols/min [2025-09-29T02:09:49.118830] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:49.070933] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:49.129507] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-29T02:09:49.182072] [DEBUG] [LOCAL ] YELP: Loaded 45909 existing records from primary storage. [2025-09-29T02:09:49.201372] [INFO ] [MAIN ] YELP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:49.239799] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YELP took 1.2s. Estimated remaining: 7.6s. Rate: 188.3 symbols/min [2025-09-29T02:09:49.293696] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:49.300949] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:49.324708] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-29T02:09:49.340135] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:49.361415] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-09-29T02:09:49.367048] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:49.391579] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-29T02:09:49.397255] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-29T02:09:49.413281] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-29T02:09:49.464297] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-29T02:09:49.491079] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. XYZ took 2.0s. Estimated remaining: 7.3s. Rate: 188.3 symbols/min [2025-09-29T02:09:49.496865] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:49.639739] [DEBUG] [LOCAL ] YETI: Loaded 53216 existing records from primary storage. [2025-09-29T02:09:49.660074] [DEBUG] [LOCAL ] YEXT: Loaded 43863 existing records from primary storage. [2025-09-29T02:09:49.660850] [INFO ] [MAIN ] YETI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:49.677431] [INFO ] [MAIN ] YEXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:49.688887] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 1.1s. Estimated remaining: 7.0s. Rate: 188.4 symbols/min [2025-09-29T02:09:49.743986] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YEXT took 0.8s. Estimated remaining: 6.7s. Rate: 188.4 symbols/min [2025-09-29T02:09:49.749464] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:50.124691] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:50.099710] [DEBUG] [LOCAL ] YMM: Loaded 53425 existing records from primary storage. [2025-09-29T02:09:50.167296] [INFO ] [MAIN ] YMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:50.206624] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:50.207381] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 1.0s. Estimated remaining: 6.4s. Rate: 188.4 symbols/min [2025-09-29T02:09:50.347118] [DEBUG] [LOCAL ] YOU: Loaded 50504 existing records from primary storage. [2025-09-29T02:09:50.376084] [INFO ] [MAIN ] YOU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:50.365537] [DEBUG] [LOCAL ] YRD: Loaded 12726 existing records from primary storage. [2025-09-29T02:09:50.404557] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 0.9s. Estimated remaining: 6.0s. Rate: 188.4 symbols/min [2025-09-29T02:09:50.415091] [INFO ] [MAIN ] YRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:50.471130] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YRD took 0.7s. Estimated remaining: 5.7s. Rate: 188.5 symbols/min [2025-09-29T02:09:50.501741] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:50.606417] [DEBUG] [LOCAL ] YPF: Loaded 51252 existing records from primary storage. [2025-09-29T02:09:50.672990] [INFO ] [MAIN ] YPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:50.695531] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YPF took 1.0s. Estimated remaining: 5.4s. Rate: 188.5 symbols/min [2025-09-29T02:09:50.873312] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.000010] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.103877] [DEBUG] [LOCAL ] YSG: Loaded 25485 existing records from primary storage. [2025-09-29T02:09:51.128676] [INFO ] [MAIN ] YSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.129408] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 0.9s. Estimated remaining: 5.1s. Rate: 188.5 symbols/min [2025-09-29T02:09:51.128315] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.385393] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.405468] [DEBUG] [LOCAL ] YUMC: Loaded 53455 existing records from primary storage. [2025-09-29T02:09:51.407977] [DEBUG] [LOCAL ] YUM: Loaded 51931 existing records from primary storage. [2025-09-29T02:09:51.408263] [INFO ] [MAIN ] YUMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.408890] [INFO ] [MAIN ] YUM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.409117] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 1.0s. Estimated remaining: 4.8s. Rate: 188.5 symbols/min [2025-09-29T02:09:51.421981] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. YUMC took 0.8s. Estimated remaining: 4.5s. Rate: 188.6 symbols/min [2025-09-29T02:09:51.553068] [DEBUG] [LOCAL ] ZEPP: Loaded 17335 existing records from primary storage. [2025-09-29T02:09:51.591916] [INFO ] [MAIN ] ZEPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.602628] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. ZEPP took 0.5s. Estimated remaining: 4.1s. Rate: 188.6 symbols/min [2025-09-29T02:09:51.659390] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.627586] [DEBUG] [LOCAL ] ZBH: Loaded 51948 existing records from primary storage. [2025-09-29T02:09:51.660919] [INFO ] [MAIN ] ZBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.661674] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZBH took 0.9s. Estimated remaining: 3.8s. Rate: 188.7 symbols/min [2025-09-29T02:09:51.722906] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-29T02:09:51.723429] [INFO ] [MAIN ] ZETA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.723535] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 0.3s. Estimated remaining: 3.5s. Rate: 188.7 symbols/min [2025-09-29T02:09:52.440557] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:52.483869] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:52.509344] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:52.533448] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:52.579059] [DEBUG] [LOCAL ] ZH: Loaded 27298 existing records from primary storage. [2025-09-29T02:09:52.581052] [INFO ] [MAIN ] ZH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:52.593363] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 0.9s. Estimated remaining: 3.2s. Rate: 188.6 symbols/min [2025-09-29T02:09:52.611563] [DEBUG] [LOCAL ] ZGN: Loaded 41333 existing records from primary storage. [2025-09-29T02:09:52.666479] [INFO ] [MAIN ] ZGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:52.710183] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZGN took 1.0s. Estimated remaining: 2.9s. Rate: 188.7 symbols/min [2025-09-29T02:09:52.843156] [DEBUG] [LOCAL ] ZIP: Loaded 44952 existing records from primary storage. [2025-09-29T02:09:52.845162] [DEBUG] [LOCAL ] ZIM: Loaded 54298 existing records from primary storage. [2025-09-29T02:09:52.880235] [INFO ] [MAIN ] ZIP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:52.880733] [INFO ] [MAIN ] ZIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:52.880564] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZIP took 1.2s. Estimated remaining: 2.5s. Rate: 188.7 symbols/min [2025-09-29T02:09:52.913035] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 1.1s. Estimated remaining: 2.2s. Rate: 188.8 symbols/min [2025-09-29T02:09:53.111284] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.251837] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.409391] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.437717] [DEBUG] [LOCAL ] ZKH: Loaded 8119 existing records from primary storage. [2025-09-29T02:09:53.460723] [INFO ] [MAIN ] ZKH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:53.483974] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.484621] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZKH took 0.8s. Estimated remaining: 1.9s. Rate: 188.7 symbols/min [2025-09-29T02:09:53.574952] [DEBUG] [LOCAL ] ZK: Loaded 40504 existing records from primary storage. [2025-09-29T02:09:53.611283] [INFO ] [MAIN ] ZK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:53.647842] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 1.1s. Estimated remaining: 1.6s. Rate: 188.7 symbols/min [2025-09-29T02:09:53.670092] [DEBUG] [LOCAL ] ZTR: Loaded 16911 existing records from primary storage. [2025-09-29T02:09:53.697334] [INFO ] [MAIN ] ZTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:53.765771] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTR took 0.8s. Estimated remaining: 1.3s. Rate: 188.8 symbols/min [2025-09-29T02:09:53.798715] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.910035] [DEBUG] [LOCAL ] ZTO: Loaded 50751 existing records from primary storage. [2025-09-29T02:09:53.952488] [INFO ] [MAIN ] ZTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:53.952635] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTO took 1.0s. Estimated remaining: 1.0s. Rate: 188.8 symbols/min [2025-09-29T02:09:54.089563] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:54.184808] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:54.217981] [DEBUG] [LOCAL ] ZTS: Loaded 53775 existing records from primary storage. [2025-09-29T02:09:54.218766] [INFO ] [MAIN ] ZTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:54.218975] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZTS took 0.7s. Estimated remaining: 0.6s. Rate: 188.8 symbols/min [2025-09-29T02:09:54.231905] [DEBUG] [LOCAL ] ZVIA: Loaded 35966 existing records from primary storage. [2025-09-29T02:09:54.232321] [INFO ] [MAIN ] ZVIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:54.232788] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZVIA took 0.6s. Estimated remaining: 0.3s. Rate: 188.9 symbols/min [2025-09-29T02:09:54.267819] [DEBUG] [LOCAL ] ZWS: Loaded 43134 existing records from primary storage. [2025-09-29T02:09:54.268227] [INFO ] [MAIN ] ZWS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:54.268383] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 189.0 symbols/min [2025-09-29T02:09:54.269613] [INFO ] [MAIN ] Parallel update completed in 12m 33s [2025-09-29T02:09:54.269852] [WARN ] [MAIN ] Failed symbols (160): AAMI, AAUC, AAM, AD, AEXA, AHL, AII, AKA, AMBQ, AMRZ... [2025-09-29T02:09:54.269933] [INFO ] [MAIN ] Update success rate: 93.3% (2211/2371 symbols) [2025-09-29T02:09:54.844447] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2211/2371 @ 93.25%)' [2025-09-29T02:09:54.845110] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-09-29T02:09:54.845220] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-09-29T02:09:54.845312] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-29T02:09:54.845481] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-29T02:09:54.845561] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T02:09:56.395234] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T02:09:56.395446] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T02:09:56.395815] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-29T02:09:56.397012] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-29T02:09:56.397117] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-29T02:09:56.397235] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-29T02:09:56.397408] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-29T02:09:56.397497] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-29T02:09:56.397596] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T02:09:56.398244] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T02:09:56.398341] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T02:09:56.398638] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-29T02:09:56.398766] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-29T02:09:56.398874] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-29T02:09:56.398964] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-29T02:09:56.429173] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-29T02:09:56.460009] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-29T02:09:56.460216] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-29T02:09:56.460305] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-29T02:09:56.460394] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-29T02:09:56.460506] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-29T02:09:56.460590] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-29T02:09:56.460730] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-29T02:09:56.462765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-29T02:09:56.463117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-29T02:09:56.463489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-29T02:09:56.463887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-29T02:09:56.464258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-29T02:09:56.464583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-29T02:09:56.464863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-29T02:09:56.465170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-29T02:09:56.465440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-29T02:09:56.465750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-29T02:09:56.466107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-29T02:09:56.466423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-29T02:09:56.466731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-29T02:09:56.467024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-29T02:09:56.467307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-29T02:09:56.467571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-29T02:09:56.467889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-29T02:09:56.468267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-29T02:09:56.468532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-29T02:09:56.468742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-29T02:09:56.469036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-29T02:09:56.469300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-29T02:09:56.469575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-29T02:09:56.469858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-29T02:09:56.470123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-29T02:09:56.470375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-29T02:09:56.470629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-29T02:09:56.470817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-29T02:09:56.470996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-29T02:09:56.471259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-29T02:09:56.471533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-29T02:09:56.471887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-29T02:09:56.472173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-29T02:09:56.472465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-29T02:09:56.472715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-29T02:09:56.472963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-29T02:09:56.473234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-29T02:09:56.473477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-29T02:09:56.473683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-29T02:09:56.473886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-29T02:09:56.474291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-29T02:09:56.474583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-29T02:09:56.474880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-29T02:09:56.475114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-29T02:09:56.475402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-29T02:09:56.475627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-29T02:09:56.475899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-29T02:09:56.476154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-29T02:09:56.476429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-29T02:09:56.476680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-29T02:09:56.476943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-29T02:09:56.477115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-29T02:09:56.477329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-29T02:09:56.477484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-29T02:09:56.477690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-29T02:09:56.477959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-29T02:09:56.478287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-29T02:09:56.478561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-29T02:09:56.478801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-29T02:09:56.479074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-29T02:09:56.479339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-29T02:09:56.479616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-29T02:09:56.479988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-29T02:09:56.480251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-29T02:09:56.480533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-29T02:09:56.480806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-29T02:09:56.481123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-29T02:09:56.481374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-29T02:09:56.481664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-29T02:09:56.481901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-29T02:09:56.482147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-29T02:09:56.482446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-29T02:09:56.482725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-29T02:09:56.482896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-29T02:09:56.483081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-29T02:09:56.483329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-29T02:09:56.483589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-29T02:09:56.483925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-29T02:09:56.484385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-29T02:09:56.484713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-29T02:09:56.485001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-29T02:09:56.485312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-29T02:09:56.485560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-29T02:09:56.485846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-29T02:09:56.486093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-29T02:09:56.486402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-29T02:09:56.486636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-29T02:09:56.490400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-29T02:09:56.490627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-29T02:09:56.490972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-29T02:09:56.491288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-29T02:09:56.491540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-29T02:09:56.491785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-29T02:09:56.492035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-29T02:09:56.492288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-29T02:09:56.492536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-29T02:09:56.492716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-29T02:09:56.492913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-29T02:09:56.493170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-29T02:09:56.493445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-29T02:09:56.493599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-29T02:09:56.493891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-29T02:09:56.494141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-29T02:09:56.494379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-29T02:09:56.494692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-29T02:09:56.494884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-29T02:09:56.495151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-29T02:09:56.495399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-29T02:09:56.495833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-29T02:09:56.496136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-29T02:09:56.496404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-29T02:09:56.496630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-29T02:09:56.496953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-09-29T02:09:56.497234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-29T02:09:56.497440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-29T02:09:56.497678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-29T02:09:56.497844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-29T02:09:56.498061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-29T02:09:56.498313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-29T02:09:56.498516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-29T02:09:56.498787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-29T02:09:56.499032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-29T02:09:56.499160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-29T02:09:56.499421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-29T02:09:56.499691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-29T02:09:56.499927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-29T02:09:56.500172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-29T02:09:56.500418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-29T02:09:56.500635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-29T02:09:56.500917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-29T02:09:56.501140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-29T02:09:56.501375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-29T02:09:56.501607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-29T02:09:56.501854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-29T02:09:56.502251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-29T02:09:56.502475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-29T02:09:56.502742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-29T02:09:56.502972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-29T02:09:56.503141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-29T02:09:56.503360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-29T02:09:56.503732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-29T02:09:56.503966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-29T02:09:56.504199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-29T02:09:56.504448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-29T02:09:56.504726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-29T02:09:56.504971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-29T02:09:56.505190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-29T02:09:56.505429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-29T02:09:56.505624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PG.csv [2025-09-29T02:09:56.505803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-29T02:09:56.506035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-29T02:09:56.506255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-29T02:09:56.506478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-29T02:09:56.506672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-29T02:09:56.506942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-29T02:09:56.507145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-29T02:09:56.507390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-29T02:09:56.507603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-29T02:09:56.507888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-29T02:09:56.508131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-29T02:09:56.508337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-29T02:09:56.508562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-29T02:09:56.508809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-29T02:09:56.508981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-29T02:09:56.509144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-29T02:09:56.509391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-29T02:09:56.509665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-29T02:09:56.509951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-29T02:09:56.510146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-29T02:09:56.510370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-29T02:09:56.510555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-29T02:09:56.510800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-29T02:09:56.511029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-29T02:09:56.511351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-29T02:09:56.511577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-29T02:09:56.511909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-29T02:09:56.512115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-29T02:09:56.512275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-29T02:09:56.512488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-29T02:09:56.512741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-29T02:09:56.512944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-29T02:09:56.513111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-29T02:09:56.513271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-29T02:09:56.513498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-29T02:09:56.513723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-29T02:09:56.513936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-29T02:09:56.514092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-29T02:09:56.514337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-29T02:09:56.514516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-29T02:09:56.514743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-29T02:09:56.515183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-29T02:09:56.515415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-29T02:09:56.515630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-29T02:09:56.515819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-29T02:09:56.516066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-29T02:09:56.516279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-29T02:09:56.516500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-29T02:09:56.516726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-29T02:09:56.516961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-29T02:09:56.517191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-29T02:09:56.517417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-29T02:09:56.517637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-29T02:09:56.517861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-29T02:09:56.518073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-29T02:09:56.518306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-29T02:09:56.518550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-29T02:09:56.518818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-29T02:09:56.519073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-29T02:09:56.519334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-29T02:09:56.519540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-29T02:09:56.519884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-29T02:09:56.520102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-29T02:09:56.520347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-09-29T02:09:56.520575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-29T02:09:56.520756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-29T02:09:56.520986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-29T02:09:56.521196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-29T02:09:56.521401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-29T02:09:56.521669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-29T02:09:56.521932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-29T02:09:56.522134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-29T02:09:56.522309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-29T02:09:56.522453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-29T02:09:56.522716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-29T02:09:56.522942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-29T02:09:56.523115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-29T02:09:56.523369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-29T02:09:56.523560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-29T02:09:56.523874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-29T02:09:56.524128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-29T02:09:56.524380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-29T02:09:56.524633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-29T02:09:56.525020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-29T02:09:56.525260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-29T02:09:56.525431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-29T02:09:56.525673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-29T02:09:56.525835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-29T02:09:56.526117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-29T02:09:56.526361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-29T02:09:56.526586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-29T02:09:56.526870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-29T02:09:56.527058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-29T02:09:56.527297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-29T02:09:56.527573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-29T02:09:56.527856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-29T02:09:56.528064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-29T02:09:56.528366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-29T02:09:56.528583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-29T02:09:56.528858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-29T02:09:56.529105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-29T02:09:56.529341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-29T02:09:56.529582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-29T02:09:56.529850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-29T02:09:56.530045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-29T02:09:56.530341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-29T02:09:56.530564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-29T02:09:56.530864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-29T02:09:56.531131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-29T02:09:56.531412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-29T02:09:56.531627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-29T02:09:56.531892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-29T02:09:56.532150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-29T02:09:56.532344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-29T02:09:56.532530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-29T02:09:56.532827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-29T02:09:56.533112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-29T02:09:56.533428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-29T02:09:56.533708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-29T02:09:56.533963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-29T02:09:56.534200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-29T02:09:56.534493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-29T02:09:56.534823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-29T02:09:56.535245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-29T02:09:56.535486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-29T02:09:56.535695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-29T02:09:56.535949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-29T02:09:56.536239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-29T02:09:56.536439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-29T02:09:56.536599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-29T02:09:56.536810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-29T02:09:56.537090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-29T02:09:56.537253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-29T02:09:56.537471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-29T02:09:56.537768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-29T02:09:56.537950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-29T02:09:56.538174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-29T02:09:56.538434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-29T02:09:56.538693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-29T02:09:56.538953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-29T02:09:56.539104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-29T02:09:56.539356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-29T02:09:56.539548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-29T02:09:56.539746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-29T02:09:56.540025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-29T02:09:56.540275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-29T02:09:56.540518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-29T02:09:56.540799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-09-29T02:09:56.541078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-29T02:09:56.541369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBD.csv [2025-09-29T02:09:56.541606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-29T02:09:56.541866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-29T02:09:56.542112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-29T02:09:56.542322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-29T02:09:56.542560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-29T02:09:56.542815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-29T02:09:56.543038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-29T02:09:56.543277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-29T02:09:56.543555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-29T02:09:56.544003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-29T02:09:56.544318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-29T02:09:56.544531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-29T02:09:56.544788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-29T02:09:56.545098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-29T02:09:56.545325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-29T02:09:56.545615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-29T02:09:56.545991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-29T02:09:56.546234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-29T02:09:56.546464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-29T02:09:56.546728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCG.csv [2025-09-29T02:09:56.547022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-29T02:09:56.547252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-29T02:09:56.547498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-29T02:09:56.547797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-29T02:09:56.548014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-29T02:09:56.548258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-29T02:09:56.548550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-29T02:09:56.548839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-29T02:09:56.549097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-29T02:09:56.549324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-29T02:09:56.549542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-29T02:09:56.549822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-29T02:09:56.550102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-29T02:09:56.550380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-29T02:09:56.550609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-29T02:09:56.550911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-29T02:09:56.551172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-29T02:09:56.551407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-29T02:09:56.551672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-29T02:09:56.551911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-29T02:09:56.552141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-29T02:09:56.552416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-29T02:09:56.552737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-29T02:09:56.552969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-29T02:09:56.553144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-29T02:09:56.553376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-29T02:09:56.553606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-29T02:09:56.553858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-29T02:09:56.554187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-29T02:09:56.554402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-29T02:09:56.554666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-29T02:09:56.554911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-29T02:09:56.555090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-29T02:09:56.555340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-29T02:09:56.555557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-29T02:09:56.555745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-29T02:09:56.555897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-29T02:09:56.556058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-29T02:09:56.556321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-29T02:09:56.556561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-29T02:09:56.556853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-29T02:09:56.557066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-29T02:09:56.557292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-29T02:09:56.557499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-29T02:09:56.557800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-29T02:09:56.558047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-29T02:09:56.558279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-29T02:09:56.558499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-29T02:09:56.558710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-29T02:09:56.559162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-29T02:09:56.559404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-29T02:09:56.559605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-29T02:09:56.559829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-29T02:09:56.560052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-29T02:09:56.560287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-29T02:09:56.560473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-29T02:09:56.560772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-29T02:09:56.561002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-29T02:09:56.561246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-29T02:09:56.561458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-29T02:09:56.561748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-29T02:09:56.561976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-29T02:09:56.562259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-29T02:09:56.562494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-29T02:09:56.562746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-29T02:09:56.562974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-29T02:09:56.563217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-29T02:09:56.563446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-29T02:09:56.563686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-29T02:09:56.563949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-29T02:09:56.564201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-29T02:09:56.564437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-29T02:09:56.564736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-29T02:09:56.564912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-29T02:09:56.565075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-29T02:09:56.565342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-29T02:09:56.565548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-29T02:09:56.565824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-29T02:09:56.565992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-29T02:09:56.566166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-29T02:09:56.566374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-29T02:09:56.566533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-29T02:09:56.566809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-29T02:09:56.567082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-29T02:09:56.567263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-29T02:09:56.567525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-29T02:09:56.567754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNC.csv [2025-09-29T02:09:56.568020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-29T02:09:56.568279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-29T02:09:56.568533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-29T02:09:56.568898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-29T02:09:56.569105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-29T02:09:56.569322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-29T02:09:56.569564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-29T02:09:56.569839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-09-29T02:09:56.569999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-29T02:09:56.570329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-29T02:09:56.570583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-29T02:09:56.570841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-29T02:09:56.571063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-29T02:09:56.571266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-29T02:09:56.571510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-29T02:09:56.571740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-29T02:09:56.571959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-29T02:09:56.572178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-29T02:09:56.572457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-29T02:09:56.572887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-29T02:09:56.573053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-29T02:09:56.573333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-09-29T02:09:56.573709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-29T02:09:56.573935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-29T02:09:56.574127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-29T02:09:56.574340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-29T02:09:56.574500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-29T02:09:56.574717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-29T02:09:56.574912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-29T02:09:56.575178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-29T02:09:56.575371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-29T02:09:56.575564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-29T02:09:56.575861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-29T02:09:56.576073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-29T02:09:56.576201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-29T02:09:56.576380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-29T02:09:56.576607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-29T02:09:56.576871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-29T02:09:56.577019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-29T02:09:56.577217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-29T02:09:56.577406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-29T02:09:56.577572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-29T02:09:56.577847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-29T02:09:56.578059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-29T02:09:56.578272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-29T02:09:56.578466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-29T02:09:56.578718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-29T02:09:56.578952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-29T02:09:56.579102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-29T02:09:56.579303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-29T02:09:56.579427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-29T02:09:56.579592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-29T02:09:56.579805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-29T02:09:56.580264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-29T02:09:56.580419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-29T02:09:56.580668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-29T02:09:56.580861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-29T02:09:56.581137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-29T02:09:56.581362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-29T02:09:56.581573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-29T02:09:56.581922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-29T02:09:56.582143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-29T02:09:56.582290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-29T02:09:56.582514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-29T02:09:56.582725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-29T02:09:56.582919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-29T02:09:56.583145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-29T02:09:56.583292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-29T02:09:56.583422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-29T02:09:56.583634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-29T02:09:56.583813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-29T02:09:56.584172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-29T02:09:56.584381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-29T02:09:56.584544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-29T02:09:56.584742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-29T02:09:56.584934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-29T02:09:56.585174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-29T02:09:56.585393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-29T02:09:56.585536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-29T02:09:56.585757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-29T02:09:56.585977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-29T02:09:56.586319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-29T02:09:56.586565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-29T02:09:56.586795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-29T02:09:56.586955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-29T02:09:56.587078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-29T02:09:56.587317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-29T02:09:56.587500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-29T02:09:56.587702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-29T02:09:56.587900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-29T02:09:56.588116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-29T02:09:56.588350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-29T02:09:56.588560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-29T02:09:56.588783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-29T02:09:56.589071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-29T02:09:56.589257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-29T02:09:56.589485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-29T02:09:56.589698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-29T02:09:56.589924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-29T02:09:56.590155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-29T02:09:56.590335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-29T02:09:56.590563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-29T02:09:56.591244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-29T02:09:56.591535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-29T02:09:56.591794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-29T02:09:56.592108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-29T02:09:56.592239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-29T02:09:56.592459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-29T02:09:56.592743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-29T02:09:56.592949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-29T02:09:56.593175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-29T02:09:56.593344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-29T02:09:56.593754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-29T02:09:56.593969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-29T02:09:56.594172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-29T02:09:56.594289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-29T02:09:56.594507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-29T02:09:56.594763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-29T02:09:56.594957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-29T02:09:56.595218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-29T02:09:56.595372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-29T02:09:56.595557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-29T02:09:56.595796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-29T02:09:56.595945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-29T02:09:56.596256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-29T02:09:56.596478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-29T02:09:56.596722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-29T02:09:56.597067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-29T02:09:56.597273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-29T02:09:56.597407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-29T02:09:56.597606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-29T02:09:56.597841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-29T02:09:56.598101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-29T02:09:56.598304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-29T02:09:56.598514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-29T02:09:56.598661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-29T02:09:56.598852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-29T02:09:56.599052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-29T02:09:56.599279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-29T02:09:56.599502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-29T02:09:56.599704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-29T02:09:56.599978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-29T02:09:56.600193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-29T02:09:56.600441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-29T02:09:56.600754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-29T02:09:56.600967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-29T02:09:56.601227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-29T02:09:56.601430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-29T02:09:56.601716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-29T02:09:56.602024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-29T02:09:56.602226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-29T02:09:56.602446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-29T02:09:56.602666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-29T02:09:56.602859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-29T02:09:56.603004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-29T02:09:56.603206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-29T02:09:56.603402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-29T02:09:56.603596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-29T02:09:56.603755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-29T02:09:56.603898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-29T02:09:56.604089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-29T02:09:56.604329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-29T02:09:56.604507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-29T02:09:56.604704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-29T02:09:56.604918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-29T02:09:56.605049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-29T02:09:56.605488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-29T02:09:56.605686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-29T02:09:56.605839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-29T02:09:56.606030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-29T02:09:56.606197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-29T02:09:56.606367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-29T02:09:56.606602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-29T02:09:56.606801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-29T02:09:56.606982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-29T02:09:56.607155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-29T02:09:56.607375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-29T02:09:56.607496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-29T02:09:56.607678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-29T02:09:56.607807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-29T02:09:56.607995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-29T02:09:56.608173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-29T02:09:56.608374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-29T02:09:56.608546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-29T02:09:56.608749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-29T02:09:56.608961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-29T02:09:56.609175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-29T02:09:56.609353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-29T02:09:56.609544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-29T02:09:56.609796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-29T02:09:56.609968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-29T02:09:56.610161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-29T02:09:56.610283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-29T02:09:56.610458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-29T02:09:56.610580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-29T02:09:56.610866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-29T02:09:56.611052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-29T02:09:56.611269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-29T02:09:56.611439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-29T02:09:56.611617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-29T02:09:56.611841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-29T02:09:56.611970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-29T02:09:56.612168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-29T02:09:56.612417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-29T02:09:56.612611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-29T02:09:56.612838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-29T02:09:56.613031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-29T02:09:56.613225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-29T02:09:56.613466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-29T02:09:56.613681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-29T02:09:56.613877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-29T02:09:56.614083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-29T02:09:56.614326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-29T02:09:56.614533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-29T02:09:56.614751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-29T02:09:56.614935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-29T02:09:56.615157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-29T02:09:56.615324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-29T02:09:56.615518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-29T02:09:56.615744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-29T02:09:56.615887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-29T02:09:56.616095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-29T02:09:56.616301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-29T02:09:56.616498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-29T02:09:56.616720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-29T02:09:56.616916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-29T02:09:56.617225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-29T02:09:56.617442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-29T02:09:56.617801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-29T02:09:56.618013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-29T02:09:56.618213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-29T02:09:56.618420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-29T02:09:56.618806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-29T02:09:56.619004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-29T02:09:56.619241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-29T02:09:56.619461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-29T02:09:56.619636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-29T02:09:56.619884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-29T02:09:56.620100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-29T02:09:56.620294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-29T02:09:56.620446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-29T02:09:56.620671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-29T02:09:56.620871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-29T02:09:56.621075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPL.csv [2025-09-29T02:09:56.621272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-29T02:09:56.621475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-29T02:09:56.621717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-29T02:09:56.621893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-29T02:09:56.622076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-29T02:09:56.622211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-29T02:09:56.622421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-29T02:09:56.622625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-29T02:09:56.622859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-29T02:09:56.623044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-29T02:09:56.623234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-29T02:09:56.623433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-29T02:09:56.623671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-29T02:09:56.623869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-29T02:09:56.624092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-29T02:09:56.624322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-29T02:09:56.624745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-29T02:09:56.626504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-29T02:09:56.626700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-29T02:09:56.626942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-29T02:09:56.627124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-29T02:09:56.627318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-29T02:09:56.627495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-29T02:09:56.627703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-29T02:09:56.627887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-29T02:09:56.628066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-29T02:09:56.628262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-29T02:09:56.628391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-29T02:09:56.628595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-29T02:09:56.628800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-29T02:09:56.628974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-29T02:09:56.629155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-29T02:09:56.629343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-29T02:09:56.629516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-29T02:09:56.629750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-29T02:09:56.629940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-29T02:09:56.630108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-29T02:09:56.630296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-29T02:09:56.630484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-29T02:09:56.630679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-29T02:09:56.630850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-29T02:09:56.631051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-29T02:09:56.631229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-29T02:09:56.631397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-29T02:09:56.631584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-29T02:09:56.631807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-29T02:09:56.632013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-29T02:09:56.632189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-29T02:09:56.632364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-29T02:09:56.632550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-29T02:09:56.632756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-29T02:09:56.632945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-29T02:09:56.633112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-29T02:09:56.633307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-29T02:09:56.633519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-29T02:09:56.633842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-29T02:09:56.634024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-29T02:09:56.634331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-29T02:09:56.634465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-29T02:09:56.634661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-29T02:09:56.634840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-29T02:09:56.635006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-29T02:09:56.635133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-29T02:09:56.635361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-29T02:09:56.635554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-29T02:09:56.635735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-29T02:09:56.635896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-29T02:09:56.636113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-29T02:09:56.636304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-29T02:09:56.636475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-29T02:09:56.636708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-29T02:09:56.636906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-29T02:09:56.637107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-29T02:09:56.637308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-29T02:09:56.637521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-29T02:09:56.637819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-09-29T02:09:56.637981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-29T02:09:56.638143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-29T02:09:56.638346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-29T02:09:56.638575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-29T02:09:56.638802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-29T02:09:56.638938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-29T02:09:56.639136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-29T02:09:56.639312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-29T02:09:56.639480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-29T02:09:56.639899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-29T02:09:56.640090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-29T02:09:56.640279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-09-29T02:09:56.640482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-29T02:09:56.640685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-29T02:09:56.640877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-29T02:09:56.641058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-29T02:09:56.641368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-29T02:09:56.641604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-29T02:09:56.641755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-29T02:09:56.642000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-29T02:09:56.642205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-29T02:09:56.642390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-29T02:09:56.642600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-29T02:09:56.642879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-29T02:09:56.643079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-29T02:09:56.643241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-29T02:09:56.643449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-29T02:09:56.643699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-09-29T02:09:56.643903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-29T02:09:56.644194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-29T02:09:56.644406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-29T02:09:56.644670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGR.csv [2025-09-29T02:09:56.644884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-29T02:09:56.645069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-29T02:09:56.645184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-29T02:09:56.645307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-29T02:09:56.645502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-29T02:09:56.645730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-29T02:09:56.645917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-29T02:09:56.646053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-29T02:09:56.646249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-29T02:09:56.646414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-29T02:09:56.646749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-29T02:09:56.646979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-29T02:09:56.647150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-29T02:09:56.647349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-29T02:09:56.647530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-29T02:09:56.647700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-29T02:09:56.647920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-29T02:09:56.648048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-29T02:09:56.648259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-29T02:09:56.648521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-29T02:09:56.648713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-29T02:09:56.648869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-29T02:09:56.649089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-29T02:09:56.649299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-29T02:09:56.649484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-29T02:09:56.649731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-29T02:09:56.649928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-29T02:09:56.650108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-29T02:09:56.650324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-29T02:09:56.650783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-29T02:09:56.650937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-29T02:09:56.651136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-29T02:09:56.651346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-29T02:09:56.651565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-29T02:09:56.651991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-29T02:09:56.652192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-29T02:09:56.652393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-29T02:09:56.652678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-29T02:09:56.653007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-29T02:09:56.653198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-29T02:09:56.653403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-29T02:09:56.653544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-29T02:09:56.653748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-09-29T02:09:56.653971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-29T02:09:56.654163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-29T02:09:56.654355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-29T02:09:56.654580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-29T02:09:56.654816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-29T02:09:56.655019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-29T02:09:56.655234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-29T02:09:56.655450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-29T02:09:56.655630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-29T02:09:56.655848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-29T02:09:56.656060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-29T02:09:56.656315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-29T02:09:56.656499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-29T02:09:56.656662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-29T02:09:56.656856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-29T02:09:56.657286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHM.csv [2025-09-29T02:09:56.657510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-29T02:09:56.657725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-29T02:09:56.657945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-29T02:09:56.658185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-29T02:09:56.658413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-29T02:09:56.658632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-29T02:09:56.658860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-29T02:09:56.659077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-29T02:09:56.659251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-29T02:09:56.659413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-29T02:09:56.659609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-29T02:09:56.659819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-29T02:09:56.659995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-29T02:09:56.660162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-29T02:09:56.660319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-29T02:09:56.660464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-29T02:09:56.660662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-29T02:09:56.660848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-29T02:09:56.660989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-09-29T02:09:56.661117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-29T02:09:56.661286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-29T02:09:56.661504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-29T02:09:56.661758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-29T02:09:56.662200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-29T02:09:56.662452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-29T02:09:56.662705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-29T02:09:56.662909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-29T02:09:56.663113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-29T02:09:56.663251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-29T02:09:56.663436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-29T02:09:56.663687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-29T02:09:56.663828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-29T02:09:56.664041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-29T02:09:56.664242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-29T02:09:56.664439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-29T02:09:56.664666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-29T02:09:56.664808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-29T02:09:56.665004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-09-29T02:09:56.665198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-29T02:09:56.665381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-29T02:09:56.665579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-29T02:09:56.665816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-29T02:09:56.666052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-29T02:09:56.666256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-29T02:09:56.666477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-29T02:09:56.666711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-29T02:09:56.666958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-29T02:09:56.667131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-29T02:09:56.667372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-29T02:09:56.667598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-29T02:09:56.667826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-29T02:09:56.668031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-29T02:09:56.668239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-29T02:09:56.668473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-29T02:09:56.668696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-29T02:09:56.668927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-29T02:09:56.669122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-29T02:09:56.669268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-29T02:09:56.669497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-29T02:09:56.669721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-09-29T02:09:56.669958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-29T02:09:56.670185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-29T02:09:56.670391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-29T02:09:56.670574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-29T02:09:56.670808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-29T02:09:56.671060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-29T02:09:56.671297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-29T02:09:56.671495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-29T02:09:56.671721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-29T02:09:56.671903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-29T02:09:56.672117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-29T02:09:56.672311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-29T02:09:56.672520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-29T02:09:56.672802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-29T02:09:56.672977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-29T02:09:56.673187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-29T02:09:56.673380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-29T02:09:56.673496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-29T02:09:56.673720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-29T02:09:56.673955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-29T02:09:56.674202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-29T02:09:56.674374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-29T02:09:56.674512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-29T02:09:56.674715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-29T02:09:56.674900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-29T02:09:56.675140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-29T02:09:56.675298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-29T02:09:56.675514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-29T02:09:56.675723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-29T02:09:56.675959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-29T02:09:56.676212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-29T02:09:56.676412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-29T02:09:56.676689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-29T02:09:56.676897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-29T02:09:56.677103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-29T02:09:56.677308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-29T02:09:56.677508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-29T02:09:56.677948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-29T02:09:56.678132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-29T02:09:56.678311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-29T02:09:56.678528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-29T02:09:56.678745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-29T02:09:56.678933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-29T02:09:56.679139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-29T02:09:56.679403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-29T02:09:56.679610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-29T02:09:56.679942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-29T02:09:56.680166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-29T02:09:56.680386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-29T02:09:56.680590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-29T02:09:56.680834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-29T02:09:56.681026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-29T02:09:56.681211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-29T02:09:56.681337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-29T02:09:56.681514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-29T02:09:56.681738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-29T02:09:56.681944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-29T02:09:56.682133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-29T02:09:56.682324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-29T02:09:56.682531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-29T02:09:56.682735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-29T02:09:56.682950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-29T02:09:56.683074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-29T02:09:56.683280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-29T02:09:56.683444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-09-29T02:09:56.683629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-29T02:09:56.683944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-29T02:09:56.684299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-29T02:09:56.684484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-29T02:09:56.684680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-29T02:09:56.684851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-29T02:09:56.685081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-29T02:09:56.685290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-29T02:09:56.685484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-29T02:09:56.685667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-29T02:09:56.685865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-29T02:09:56.686052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-29T02:09:56.686246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-29T02:09:56.686426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-29T02:09:56.686693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-29T02:09:56.686914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-29T02:09:56.687129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-29T02:09:56.687514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-29T02:09:56.687724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-29T02:09:56.687904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-29T02:09:56.688093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-29T02:09:56.688288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-29T02:09:56.688472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-29T02:09:56.688745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-29T02:09:56.688948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-29T02:09:56.689106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-29T02:09:56.689320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-29T02:09:56.689495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-29T02:09:56.689719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-29T02:09:56.689863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-29T02:09:56.690049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-29T02:09:56.690253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-29T02:09:56.690444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-29T02:09:56.690706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-29T02:09:56.690889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-29T02:09:56.691072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-29T02:09:56.691290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-29T02:09:56.691424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-29T02:09:56.691669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-29T02:09:56.691892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-29T02:09:56.692074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-29T02:09:56.692273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-29T02:09:56.692814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-29T02:09:56.693098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-29T02:09:56.693295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-29T02:09:56.693502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-29T02:09:56.693719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-29T02:09:56.693887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-29T02:09:56.694343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-29T02:09:56.694524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-29T02:09:56.694725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-29T02:09:56.694923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-29T02:09:56.695098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-29T02:09:56.695266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-29T02:09:56.695585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-29T02:09:56.695800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-29T02:09:56.695992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-29T02:09:56.696198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-29T02:09:56.696390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-29T02:09:56.696602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-29T02:09:56.696842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-29T02:09:56.697032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-29T02:09:56.697249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-29T02:09:56.697434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-29T02:09:56.697661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-29T02:09:56.697855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-29T02:09:56.698005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-09-29T02:09:56.698178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-29T02:09:56.698366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-29T02:09:56.698559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-29T02:09:56.698799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-29T02:09:56.698995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-29T02:09:56.699194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-29T02:09:56.699374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-29T02:09:56.699598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-29T02:09:56.699808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-29T02:09:56.700016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-29T02:09:56.700211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-29T02:09:56.700372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-29T02:09:56.700589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-29T02:09:56.700854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-29T02:09:56.701040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-29T02:09:56.701215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-29T02:09:56.701351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-29T02:09:56.701547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-29T02:09:56.701765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-29T02:09:56.701960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-29T02:09:56.702140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-29T02:09:56.702320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-29T02:09:56.702489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-29T02:09:56.702741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-29T02:09:56.702918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-29T02:09:56.703139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-29T02:09:56.703338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-29T02:09:56.703503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-29T02:09:56.703712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-29T02:09:56.703891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-29T02:09:56.704040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-29T02:09:56.704219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-29T02:09:56.704360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-29T02:09:56.704551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-29T02:09:56.704767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-29T02:09:56.704955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-29T02:09:56.705120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-29T02:09:56.705328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-29T02:09:56.705521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-29T02:09:56.705754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-29T02:09:56.705935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-29T02:09:56.706327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-29T02:09:56.706541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-29T02:09:56.706982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-29T02:09:56.707353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-29T02:09:56.707473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-29T02:09:56.707774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-29T02:09:56.707984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-29T02:09:56.708166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-29T02:09:56.708360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-29T02:09:56.708549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-29T02:09:56.708764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-29T02:09:56.708882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-29T02:09:56.709093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-29T02:09:56.709295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-29T02:09:56.709500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-29T02:09:56.709731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-29T02:09:56.709912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-29T02:09:56.710051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-29T02:09:56.710232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-29T02:09:56.710423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-29T02:09:56.710632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-29T02:09:56.710941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-29T02:09:56.711164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-29T02:09:56.711554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-29T02:09:56.711754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-29T02:09:56.711946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-29T02:09:56.712165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-29T02:09:56.712348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-29T02:09:56.712534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-29T02:09:56.712728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-29T02:09:56.712918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-29T02:09:56.713115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-29T02:09:56.713551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-29T02:09:56.713959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-29T02:09:56.714158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-29T02:09:56.714340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-29T02:09:56.714535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-29T02:09:56.714758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-29T02:09:56.714963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-29T02:09:56.715148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-29T02:09:56.715373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-29T02:09:56.715545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-29T02:09:56.715768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-29T02:09:56.715966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-29T02:09:56.716160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-29T02:09:56.716563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-29T02:09:56.716777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-29T02:09:56.717008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-29T02:09:56.717215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-29T02:09:56.717403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-29T02:09:56.717601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-29T02:09:56.717809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-29T02:09:56.718006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-29T02:09:56.718211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-29T02:09:56.718385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-29T02:09:56.718595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-29T02:09:56.718818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-29T02:09:56.719000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-29T02:09:56.719140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-29T02:09:56.719278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-29T02:09:56.719448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-29T02:09:56.719673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-29T02:09:56.719861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-29T02:09:56.720038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-29T02:09:56.720221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-29T02:09:56.720452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-29T02:09:56.720661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-29T02:09:56.720857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-29T02:09:56.721056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-29T02:09:56.721233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-29T02:09:56.721379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-29T02:09:56.721560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-29T02:09:56.721739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-29T02:09:56.721979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-29T02:09:56.722174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-29T02:09:56.722289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-29T02:09:56.722524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-29T02:09:56.722756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-29T02:09:56.722944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-29T02:09:56.723132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-29T02:09:56.723260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-29T02:09:56.723466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-29T02:09:56.723581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-29T02:09:56.723879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-29T02:09:56.724086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-29T02:09:56.724310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-29T02:09:56.724486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-29T02:09:56.724718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-29T02:09:56.724883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-29T02:09:56.725060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-29T02:09:56.725266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-29T02:09:56.725456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-29T02:09:56.725833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-29T02:09:56.726018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-29T02:09:56.726132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-29T02:09:56.726365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-29T02:09:56.726554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-29T02:09:56.726800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-29T02:09:56.726956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-29T02:09:56.727169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-29T02:09:56.727366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-29T02:09:56.727722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-29T02:09:56.727908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-29T02:09:56.728091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-29T02:09:56.728268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-29T02:09:56.728496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-29T02:09:56.728716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-29T02:09:56.728862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-29T02:09:56.729030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-29T02:09:56.729322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-29T02:09:56.729507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-29T02:09:56.729734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-29T02:09:56.729924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-29T02:09:56.730166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-29T02:09:56.730357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-29T02:09:56.730480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-29T02:09:56.730701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-29T02:09:56.730906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-29T02:09:56.731120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-29T02:09:56.731321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-29T02:09:56.731492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-29T02:09:56.731694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-29T02:09:56.731895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-29T02:09:56.732122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-29T02:09:56.732338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-29T02:09:56.732507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-29T02:09:56.732694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-29T02:09:56.732857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-29T02:09:56.733071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-29T02:09:56.733223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-29T02:09:56.733384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-29T02:09:56.733592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-29T02:09:56.733749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-29T02:09:56.733937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-29T02:09:56.734126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-29T02:09:56.734372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-29T02:09:56.735053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-29T02:09:56.735288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-29T02:09:56.735470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-29T02:09:56.735615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-29T02:09:56.735828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-29T02:09:56.735994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-29T02:09:56.736173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-29T02:09:56.736390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-29T02:09:56.736558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-29T02:09:56.736773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-29T02:09:56.736984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-29T02:09:56.737153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-29T02:09:56.737297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-29T02:09:56.737449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-29T02:09:56.737623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-29T02:09:56.737824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-29T02:09:56.738006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-29T02:09:56.738171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-29T02:09:56.738311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-29T02:09:56.738455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-29T02:09:56.738660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-29T02:09:56.738830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-29T02:09:56.739021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-29T02:09:56.739209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-29T02:09:56.739345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-29T02:09:56.739528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-29T02:09:56.739798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-29T02:09:56.739976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-29T02:09:56.740211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-29T02:09:56.740393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-29T02:09:56.740582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-29T02:09:56.740787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-29T02:09:56.740983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-29T02:09:56.741188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-29T02:09:56.741370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-29T02:09:56.741569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-29T02:09:56.741769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-29T02:09:56.741947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-29T02:09:56.742083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-29T02:09:56.742265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-29T02:09:56.742461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-29T02:09:56.742661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-29T02:09:56.742845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-29T02:09:56.743093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-29T02:09:56.743289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-29T02:09:56.743473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-29T02:09:56.743670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-29T02:09:56.743804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-29T02:09:56.744019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-29T02:09:56.744231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-29T02:09:56.744419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-29T02:09:56.744595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-29T02:09:56.744871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-29T02:09:56.745056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-29T02:09:56.745265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-29T02:09:56.745459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-29T02:09:56.745680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-29T02:09:56.745891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-29T02:09:56.746103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-29T02:09:56.746259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-29T02:09:56.746433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-29T02:09:56.746661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-29T02:09:56.746884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-29T02:09:56.747091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-29T02:09:56.747637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-09-29T02:09:56.747870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-29T02:09:56.748080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-29T02:09:56.748307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-29T02:09:56.748501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-29T02:09:56.748755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-29T02:09:56.748957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-29T02:09:56.749108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-29T02:09:56.749302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-29T02:09:56.749432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-29T02:09:56.749629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-29T02:09:56.749900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-29T02:09:56.750100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-29T02:09:56.750283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-29T02:09:56.750507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-29T02:09:56.750711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-29T02:09:56.750851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-29T02:09:56.751102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-29T02:09:56.751310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-29T02:09:56.751541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-29T02:09:56.751743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-29T02:09:56.751894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-29T02:09:56.752075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-29T02:09:56.752221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-29T02:09:56.752385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-29T02:09:56.752577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-29T02:09:56.752784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-29T02:09:56.752981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-29T02:09:56.753185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCL.csv [2025-09-29T02:09:56.753360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-29T02:09:56.753528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-29T02:09:56.753763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-29T02:09:56.753970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-29T02:09:56.754136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-29T02:09:56.754309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-29T02:09:56.754494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-29T02:09:56.754692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-29T02:09:56.754898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-29T02:09:56.755146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-29T02:09:56.755350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-29T02:09:56.755577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-29T02:09:56.755800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-29T02:09:56.756009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-09-29T02:09:56.756219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-29T02:09:56.756386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-29T02:09:56.756580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-29T02:09:56.756915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-29T02:09:56.757091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-29T02:09:56.757275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-29T02:09:56.757485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-29T02:09:56.757681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-29T02:09:56.757879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-29T02:09:56.758092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-29T02:09:56.758289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-29T02:09:56.758479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-29T02:09:56.758724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSC.csv [2025-09-29T02:09:56.758907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-29T02:09:56.759323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-29T02:09:56.759449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-29T02:09:56.759681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-29T02:09:56.759823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-29T02:09:56.760005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-29T02:09:56.760189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFE.csv [2025-09-29T02:09:56.760387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-29T02:09:56.760588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-29T02:09:56.760790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEG.csv [2025-09-29T02:09:56.760972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-29T02:09:56.761118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-29T02:09:56.761267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-29T02:09:56.761504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-29T02:09:56.761723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-29T02:09:56.761935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-29T02:09:56.762132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-29T02:09:56.762279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-29T02:09:56.762448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-29T02:09:56.762607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-29T02:09:56.762814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-29T02:09:56.763002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-29T02:09:56.763192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-29T02:09:56.763317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-29T02:09:56.763453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-29T02:09:56.763630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-29T02:09:56.763816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-29T02:09:56.763984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-29T02:09:56.764194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-29T02:09:56.764399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-29T02:09:56.764578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-29T02:09:56.764786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-29T02:09:56.764971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-29T02:09:56.765110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-29T02:09:56.765316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-29T02:09:56.765490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-29T02:09:56.765737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-29T02:09:56.765894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-29T02:09:56.766062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-29T02:09:56.766310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-09-29T02:09:56.766467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-29T02:09:56.766686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-29T02:09:56.766898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-29T02:09:56.767034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-29T02:09:56.767210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-29T02:09:56.767409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-29T02:09:56.767833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-29T02:09:56.768041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-29T02:09:56.768235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-29T02:09:56.768424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-09-29T02:09:56.768598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-29T02:09:56.768766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-29T02:09:56.768962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-29T02:09:56.769140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-29T02:09:56.769335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-29T02:09:56.769514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-29T02:09:56.769700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-29T02:09:56.769879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-29T02:09:56.770078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-29T02:09:56.770320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-29T02:09:56.770528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-29T02:09:56.770715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-29T02:09:56.770911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-29T02:09:56.771116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-29T02:09:56.771293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-29T02:09:56.771491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-29T02:09:56.771713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-29T02:09:56.771953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-29T02:09:56.772187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-29T02:09:56.772364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-29T02:09:56.772558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-29T02:09:56.772766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-29T02:09:56.772921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-29T02:09:56.773181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-29T02:09:56.773373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-29T02:09:56.773571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-29T02:09:56.773848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-29T02:09:56.774048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-29T02:09:56.774184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-09-29T02:09:56.774436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-29T02:09:56.774606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-29T02:09:56.774806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-29T02:09:56.775015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-29T02:09:56.775193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-29T02:09:56.775400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-29T02:09:56.775794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-29T02:09:56.775931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-29T02:09:56.776142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-29T02:09:56.776319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-29T02:09:56.776501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-29T02:09:56.776881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-29T02:09:56.777070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-29T02:09:56.777281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-29T02:09:56.777445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-29T02:09:56.777619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-29T02:09:56.777826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-29T02:09:56.778007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-29T02:09:56.778213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-29T02:09:56.778380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-29T02:09:56.778551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-29T02:09:56.778775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-29T02:09:56.778984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-29T02:09:56.779159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-29T02:09:56.779349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-29T02:09:56.779513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-29T02:09:56.779745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-29T02:09:56.779939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-29T02:09:56.780132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-29T02:09:56.780345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-29T02:09:56.780515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-29T02:09:56.780709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-29T02:09:56.780933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-29T02:09:56.781129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-29T02:09:56.781297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-09-29T02:09:56.781477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-29T02:09:56.781620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-29T02:09:56.781951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-29T02:09:56.782169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-29T02:09:56.782337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-29T02:09:56.782530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-29T02:09:56.782758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-29T02:09:56.782936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-29T02:09:56.783069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-29T02:09:56.783237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-29T02:09:56.783420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-29T02:09:56.783816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-29T02:09:56.784024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-29T02:09:56.784225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-29T02:09:56.784406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-29T02:09:56.784573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-29T02:09:56.784811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-29T02:09:56.784967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-29T02:09:56.785147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-29T02:09:56.785345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-29T02:09:56.785488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-29T02:09:56.785678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-29T02:09:56.785831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-29T02:09:56.785994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-29T02:09:56.786178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-29T02:09:56.786374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-29T02:09:56.786561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-29T02:09:56.786789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-29T02:09:56.787017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-29T02:09:56.787200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-29T02:09:56.787400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-29T02:09:56.787599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-09-29T02:09:56.787852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-29T02:09:56.788092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-29T02:09:56.788268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-29T02:09:56.788479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-29T02:09:56.788609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-29T02:09:56.788848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-29T02:09:56.788979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-29T02:09:56.789182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-29T02:09:56.789363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-29T02:09:56.789565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-29T02:09:56.789796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-29T02:09:56.789982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-29T02:09:56.790115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-29T02:09:56.790297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-29T02:09:56.790499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-29T02:09:56.790703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-29T02:09:56.790879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-29T02:09:56.791059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-29T02:09:56.791531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-29T02:09:56.791839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-29T02:09:56.791985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-29T02:09:56.792158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-29T02:09:56.792289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-29T02:09:56.792528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-29T02:09:56.792754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-29T02:09:56.792949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-29T02:09:56.793139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-29T02:09:56.793326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-29T02:09:56.793525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-29T02:09:56.793726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-29T02:09:56.793928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-29T02:09:56.794155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-29T02:09:56.794365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-29T02:09:56.794568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-29T02:09:56.794780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-29T02:09:56.794941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-29T02:09:56.795149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-29T02:09:56.795353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-29T02:09:56.795481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-29T02:09:56.795701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-29T02:09:56.795893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-29T02:09:56.796078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-29T02:09:56.796291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-09-29T02:09:56.796491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-29T02:09:56.796748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-29T02:09:56.796962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-29T02:09:56.797193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-29T02:09:56.797409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-29T02:09:56.797538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-29T02:09:56.797729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-29T02:09:56.797924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-29T02:09:56.798083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-29T02:09:56.798265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-29T02:09:56.798453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-29T02:09:56.798635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-29T02:09:56.798863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-29T02:09:56.799043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-29T02:09:56.799214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-29T02:09:56.799371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-29T02:09:56.799534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-29T02:09:56.799722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-29T02:09:56.800157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-29T02:09:56.800307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-29T02:09:56.800477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-29T02:09:56.800628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-29T02:09:56.800814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-29T02:09:56.800973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-29T02:09:56.801142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-29T02:09:56.801343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-29T02:09:56.801537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-29T02:09:56.801783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-29T02:09:56.801963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-29T02:09:56.802089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-29T02:09:56.802252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-29T02:09:56.802430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-29T02:09:56.802593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-29T02:09:56.802817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-29T02:09:56.803026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-29T02:09:56.803201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-29T02:09:56.803409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-29T02:09:56.803577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-29T02:09:56.803757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-29T02:09:56.803961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-29T02:09:56.804156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-29T02:09:56.804330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-29T02:09:56.804499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-29T02:09:56.804726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-29T02:09:56.804902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-29T02:09:56.805094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-29T02:09:56.805279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-29T02:09:56.805454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-29T02:09:56.805660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-29T02:09:56.805831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-29T02:09:56.806022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-29T02:09:56.806198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-29T02:09:56.806390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-29T02:09:56.806568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-29T02:09:56.806856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-29T02:09:56.807048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-29T02:09:56.807198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-29T02:09:56.807348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-29T02:09:56.807545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-29T02:09:56.807728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-29T02:09:56.807933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-29T02:09:56.808082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-29T02:09:56.808216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-29T02:09:56.808417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-29T02:09:56.808578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-29T02:09:56.808789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-29T02:09:56.808948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-29T02:09:56.809176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-29T02:09:56.809372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-29T02:09:56.809572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-29T02:09:56.809777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-29T02:09:56.809910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-29T02:09:56.810309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-29T02:09:56.810547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-29T02:09:56.810812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-29T02:09:56.811016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-29T02:09:56.811197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-29T02:09:56.811474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-29T02:09:56.811675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-29T02:09:56.811849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-29T02:09:56.812054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-29T02:09:56.812187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-29T02:09:56.812369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-29T02:09:56.812532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-29T02:09:56.812773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-29T02:09:56.812931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-29T02:09:56.813127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-29T02:09:56.813348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-29T02:09:56.813524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-29T02:09:56.813708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-29T02:09:56.813891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-29T02:09:56.814073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-29T02:09:56.814249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-29T02:09:56.814414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-29T02:09:56.814618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-29T02:09:56.814867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-29T02:09:56.815039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-29T02:09:56.815226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-29T02:09:56.815417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-29T02:09:56.815597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-29T02:09:56.815863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-29T02:09:56.816055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-29T02:09:56.816240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-29T02:09:56.816443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-29T02:09:56.816668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKLO.csv [2025-09-29T02:09:56.816939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-29T02:09:56.817125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-29T02:09:56.817342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PM.csv [2025-09-29T02:09:56.817525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-29T02:09:56.817691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-29T02:09:56.817904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-29T02:09:56.818491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-29T02:09:56.818713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-29T02:09:56.818923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-29T02:09:56.819100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-29T02:09:56.819313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-29T02:09:56.819487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-29T02:09:56.819662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-29T02:09:56.819815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-29T02:09:56.819984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-29T02:09:56.820148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-29T02:09:56.820354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-29T02:09:56.820558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-29T02:09:56.820755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-29T02:09:56.820944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-29T02:09:56.821131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-29T02:09:56.821308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-29T02:09:56.821496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-29T02:09:56.821699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-29T02:09:56.821879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-29T02:09:56.822026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-29T02:09:56.822515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-29T02:09:56.822772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-29T02:09:56.822927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-29T02:09:56.823155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-29T02:09:56.823335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-29T02:09:56.823518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-29T02:09:56.823808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-29T02:09:56.824006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-29T02:09:56.824189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-29T02:09:56.824363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-29T02:09:56.824547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-29T02:09:56.824772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-29T02:09:56.824979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-29T02:09:56.825189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-29T02:09:56.825349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-29T02:09:56.825558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-29T02:09:56.825872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-29T02:09:56.826052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-29T02:09:56.826254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-29T02:09:56.826446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-29T02:09:56.826709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNR.csv [2025-09-29T02:09:56.826920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-29T02:09:56.827125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-29T02:09:56.827291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-29T02:09:56.827474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-29T02:09:56.827799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-29T02:09:56.827978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-29T02:09:56.828143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-29T02:09:56.828312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-29T02:09:56.828501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-29T02:09:56.828709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-29T02:09:56.828896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-29T02:09:56.829078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-29T02:09:56.829258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-29T02:09:56.829421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-29T02:09:56.829634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-29T02:09:56.830185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-29T02:09:56.830377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-29T02:09:56.830621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-29T02:09:56.830835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-29T02:09:56.831029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-29T02:09:56.831204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-29T02:09:56.831383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-29T02:09:56.831544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-29T02:09:56.831895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-29T02:09:56.832091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-29T02:09:56.832267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-29T02:09:56.832438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-29T02:09:56.832611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-29T02:09:56.832835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-29T02:09:56.833063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-29T02:09:56.833207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-29T02:09:56.833390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-29T02:09:56.833611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-29T02:09:56.833844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-29T02:09:56.834067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-29T02:09:56.834284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-29T02:09:56.834433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-29T02:09:56.834603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-29T02:09:56.834813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-29T02:09:56.834960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-29T02:09:56.835112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-29T02:09:56.835331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-29T02:09:56.835478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-29T02:09:56.835633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-29T02:09:56.835827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-29T02:09:56.835966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-29T02:09:56.836145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-29T02:09:56.836275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-29T02:09:56.836473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-29T02:09:56.836690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-29T02:09:56.836940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-29T02:09:56.837215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-29T02:09:56.837470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-29T02:09:56.837730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-29T02:09:56.837927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-29T02:09:56.838118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-29T02:09:56.838324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-29T02:09:56.838476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-29T02:09:56.838694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-29T02:09:56.838891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-29T02:09:56.839104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-29T02:09:56.839317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-29T02:09:56.839501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-29T02:09:56.839819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-29T02:09:56.839997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-29T02:09:56.840182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-29T02:09:56.840357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-09-29T02:09:56.840578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-29T02:09:56.841180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-29T02:09:56.841353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-29T02:09:56.841576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-29T02:09:56.841802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-29T02:09:56.841980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-29T02:09:56.842175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-29T02:09:56.842376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-29T02:09:56.842579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-29T02:09:56.842786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-29T02:09:56.842970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-29T02:09:56.843148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-29T02:09:56.843354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-29T02:09:56.843522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-29T02:09:56.843813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-29T02:09:56.844012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-29T02:09:56.844188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-29T02:09:56.844357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-29T02:09:56.844532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-29T02:09:56.844724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-29T02:09:56.844909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-29T02:09:56.845071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-29T02:09:56.845258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-29T02:09:56.845411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-29T02:09:56.845588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-29T02:09:56.845829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-29T02:09:56.846033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-29T02:09:56.846207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-29T02:09:56.846423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-29T02:09:56.846722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-29T02:09:56.846900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-29T02:09:56.847106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-29T02:09:56.847280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-29T02:09:56.847503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-29T02:09:56.847819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-29T02:09:56.847992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-29T02:09:56.848184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-29T02:09:56.848388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-29T02:09:56.848572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-29T02:09:56.848779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-29T02:09:56.848995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-29T02:09:56.849201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-29T02:09:56.849378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-29T02:09:56.849540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-29T02:09:56.849765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-29T02:09:56.849948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-29T02:09:56.850108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-29T02:09:56.850267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-29T02:09:56.850451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-29T02:09:56.850638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-29T02:09:56.850845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-29T02:09:56.851003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-29T02:09:56.851189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-29T02:09:56.851365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-29T02:09:56.851549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-29T02:09:56.851774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-29T02:09:56.851976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-29T02:09:56.852391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-29T02:09:56.852566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-29T02:09:56.852735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-29T02:09:56.852928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-29T02:09:56.853166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-29T02:09:56.853353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-29T02:09:56.853536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-29T02:09:56.853742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-29T02:09:56.853922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-29T02:09:56.854098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-29T02:09:56.854289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-29T02:09:56.854469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-29T02:09:56.854724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-29T02:09:56.854864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-29T02:09:56.855025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-29T02:09:56.855211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-29T02:09:56.855436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-29T02:09:56.855626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-29T02:09:56.855862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-29T02:09:56.856027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-29T02:09:56.856180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-29T02:09:56.856373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-29T02:09:56.856545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-29T02:09:56.856751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-29T02:09:56.856906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-29T02:09:56.857104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-29T02:09:56.857264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-29T02:09:56.857424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-29T02:09:56.857614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-29T02:09:56.857831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-29T02:09:56.858021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-29T02:09:56.858146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-09-29T02:09:56.858367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-29T02:09:56.858586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-29T02:09:56.858786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-29T02:09:56.858948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-29T02:09:56.859092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-29T02:09:56.859280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-29T02:09:56.859404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-29T02:09:56.859571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-29T02:09:56.859899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-29T02:09:56.860092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-29T02:09:56.860260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-29T02:09:56.860388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-29T02:09:56.860551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-29T02:09:56.860884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-29T02:09:56.861071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-29T02:09:56.861213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-29T02:09:56.861401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-29T02:09:56.861588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-29T02:09:56.861827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-29T02:09:56.862030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-29T02:09:56.862253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-29T02:09:56.862454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-29T02:09:56.862679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-29T02:09:56.862818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-29T02:09:56.863029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-29T02:09:56.863208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-29T02:09:56.863347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-29T02:09:56.863566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-29T02:09:56.863820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-29T02:09:56.863998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-29T02:09:56.864211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-29T02:09:56.864389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-29T02:09:56.864565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-29T02:09:56.864788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-29T02:09:56.865002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-29T02:09:56.865206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-29T02:09:56.865356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-29T02:09:56.865559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-29T02:09:56.865759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-29T02:09:56.865963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-29T02:09:56.866297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-29T02:09:56.866472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-29T02:09:56.866726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-29T02:09:56.866952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-29T02:09:56.867130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-29T02:09:56.867315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-29T02:09:56.867480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-29T02:09:56.867758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-29T02:09:56.867902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-29T02:09:56.868083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-29T02:09:56.868247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-29T02:09:56.868431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-29T02:09:56.868596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-29T02:09:56.868807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRG.csv [2025-09-29T02:09:56.869011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-29T02:09:56.869191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-29T02:09:56.869381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-29T02:09:56.869553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-29T02:09:56.869753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-29T02:09:56.869935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-29T02:09:56.870100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-29T02:09:56.870264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-29T02:09:56.870433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-29T02:09:56.870596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-29T02:09:56.870766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-29T02:09:56.870919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-29T02:09:56.871108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-29T02:09:56.871301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-29T02:09:56.871800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-29T02:09:56.872013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-29T02:09:56.872263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-29T02:09:56.872424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-29T02:09:56.872709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-29T02:09:56.872894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-29T02:09:56.873084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-29T02:09:56.873297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-29T02:09:56.873461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-29T02:09:56.873673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-29T02:09:56.873870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-29T02:09:56.874081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-29T02:09:56.874291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-29T02:09:56.874501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-29T02:09:56.874744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-29T02:09:56.874946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-29T02:09:56.875127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-29T02:09:56.875296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-29T02:09:56.875478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-29T02:09:56.875740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-29T02:09:56.875920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-29T02:09:56.876123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-29T02:09:56.876349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-29T02:09:56.876532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-29T02:09:56.876695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-29T02:09:56.876889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-29T02:09:56.877110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-29T02:09:56.877295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-29T02:09:56.877479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-29T02:09:56.877710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-29T02:09:56.877946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-29T02:09:56.878167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-29T02:09:56.878366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-29T02:09:56.878568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-29T02:09:56.878824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-29T02:09:56.879007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-29T02:09:56.879201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-29T02:09:56.879406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-29T02:09:56.879572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-29T02:09:56.879816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-29T02:09:56.879984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-29T02:09:56.880136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-29T02:09:56.880342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-29T02:09:56.880524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-29T02:09:56.880753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-09-29T02:09:56.880963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-29T02:09:56.881142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-29T02:09:56.881374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-29T02:09:56.881572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-29T02:09:56.881804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-29T02:09:56.881936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-29T02:09:56.882117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-29T02:09:56.882299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-29T02:09:56.882465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-29T02:09:56.882696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-29T02:09:56.882899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-29T02:09:56.883090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-29T02:09:56.883284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-29T02:09:56.883837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-29T02:09:56.883988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-29T02:09:56.884191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QBTS.csv [2025-09-29T02:09:56.884350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-29T02:09:56.884535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-29T02:09:56.884719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-29T02:09:56.884928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-29T02:09:56.885104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-29T02:09:56.885294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-29T02:09:56.885476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-29T02:09:56.885674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-29T02:09:56.885927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-29T02:09:56.886136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-29T02:09:56.886359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-29T02:09:56.886529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-29T02:09:56.886739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-29T02:09:56.886984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-29T02:09:56.887197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-29T02:09:56.887387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-29T02:09:56.887518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-29T02:09:56.887719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-29T02:09:56.887895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-29T02:09:56.888115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-29T02:09:56.888285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-29T02:09:56.888449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-29T02:09:56.888598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-29T02:09:56.888817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-29T02:09:56.889019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-29T02:09:56.889221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-29T02:09:56.889435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-29T02:09:56.889673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-29T02:09:56.889902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-29T02:09:56.890091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-29T02:09:56.890295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-29T02:09:56.890545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-29T02:09:56.890778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-29T02:09:56.891009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-29T02:09:56.891206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-29T02:09:56.891404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-29T02:09:56.891617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-29T02:09:56.891872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-29T02:09:56.892076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-29T02:09:56.892267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-29T02:09:56.892473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-29T02:09:56.892778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-29T02:09:56.893033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-29T02:09:56.893262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-29T02:09:56.893468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-29T02:09:56.894105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-29T02:09:56.894314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-29T02:09:56.894524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-29T02:09:56.894743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-29T02:09:56.894956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-29T02:09:56.895134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-29T02:09:56.895298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-29T02:09:56.895520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-29T02:09:56.895766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-29T02:09:56.895979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-29T02:09:56.896190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-29T02:09:56.896349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-29T02:09:56.896543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-29T02:09:56.896788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-29T02:09:56.896976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-29T02:09:56.897188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-29T02:09:56.897421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-29T02:09:56.897577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-29T02:09:56.897845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-29T02:09:56.898063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-29T02:09:56.898262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-29T02:09:56.898455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-29T02:09:56.898724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-29T02:09:56.898920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-29T02:09:56.899121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-29T02:09:56.899328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-29T02:09:56.899574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-29T02:09:56.899771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-29T02:09:56.899969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EICC.csv [2025-09-29T02:09:56.900181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-29T02:09:56.900364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-29T02:09:56.900619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-29T02:09:56.900849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-29T02:09:56.901060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-29T02:09:56.901259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-29T02:09:56.901428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-29T02:09:56.901658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-29T02:09:56.901891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-29T02:09:56.902089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-09-29T02:09:56.902302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-29T02:09:56.902556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-29T02:09:56.902777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-29T02:09:56.902945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-29T02:09:56.903163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-29T02:09:56.903417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-29T02:09:56.903618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-29T02:09:56.903855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-29T02:09:56.904018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-29T02:09:56.904237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-29T02:09:56.904404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-29T02:09:56.904636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-29T02:09:56.904992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-29T02:09:56.905190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-29T02:09:56.905415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-29T02:09:56.905566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-29T02:09:56.905808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-29T02:09:56.906018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-29T02:09:56.906181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-29T02:09:56.906374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-29T02:09:56.906558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-29T02:09:56.906743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-29T02:09:56.906968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-29T02:09:56.907146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-29T02:09:56.907350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-29T02:09:56.907590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-29T02:09:56.907821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-29T02:09:56.908007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-29T02:09:56.908146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-09-29T02:09:56.908284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-29T02:09:56.908924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-29T02:09:56.909075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-29T02:09:56.909269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-29T02:09:56.909448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-29T02:09:56.909661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-29T02:09:56.909843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-29T02:09:56.910017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-29T02:09:56.910207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-29T02:09:56.910382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-29T02:09:56.910549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-29T02:09:56.910734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-29T02:09:56.910900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-29T02:09:56.911060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-29T02:09:56.911251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-29T02:09:56.911395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-29T02:09:56.911569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-29T02:09:56.911822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-29T02:09:56.912023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-29T02:09:56.912165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-29T02:09:56.912307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-29T02:09:56.912486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-29T02:09:56.912666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-29T02:09:56.912853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-29T02:09:56.912977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-29T02:09:56.913145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-29T02:09:56.913321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-29T02:09:56.913465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-29T02:09:56.913610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-29T02:09:56.913835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-29T02:09:56.914014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-29T02:09:56.914197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-29T02:09:56.914366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-29T02:09:56.914547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-29T02:09:56.914732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-29T02:09:56.914939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-09-29T02:09:56.915092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-29T02:09:56.915256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-29T02:09:56.915425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-29T02:09:56.915583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-29T02:09:56.915756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-29T02:09:56.915926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-29T02:09:56.916107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-29T02:09:56.916259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-29T02:09:56.916440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-29T02:09:56.917102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-29T02:09:56.917304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-29T02:09:56.917485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-29T02:09:56.917684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-29T02:09:56.917836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-29T02:09:56.917986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-29T02:09:56.918143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-29T02:09:56.918321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-29T02:09:56.918523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-29T02:09:56.918785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-29T02:09:56.918985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-29T02:09:56.919160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-29T02:09:56.919369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-29T02:09:56.919548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-29T02:09:56.919769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-29T02:09:56.919936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-29T02:09:56.920051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-29T02:09:56.920216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-29T02:09:56.920375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-29T02:09:56.920531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-29T02:09:56.920773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-29T02:09:56.920925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-29T02:09:56.921084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-29T02:09:56.921264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-29T02:09:56.921483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-29T02:09:56.921671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-29T02:09:56.921829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-29T02:09:56.922000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-29T02:09:56.922166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-29T02:09:56.922334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-29T02:09:56.922587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-29T02:09:56.922755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-29T02:09:56.922905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-29T02:09:56.923106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-29T02:09:56.923223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-29T02:09:56.923373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-29T02:09:56.923529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-29T02:09:56.923700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-29T02:09:56.923841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-29T02:09:56.924041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-29T02:09:56.924206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-29T02:09:56.924374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-29T02:09:56.924541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-29T02:09:56.924714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-29T02:09:56.924890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-29T02:09:56.925089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-29T02:09:56.925338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-29T02:09:56.925544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-29T02:09:56.925711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-29T02:09:56.925883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-29T02:09:56.926046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-29T02:09:56.926200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-29T02:09:56.926357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-29T02:09:56.926537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-29T02:09:56.926778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-29T02:09:56.926966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-29T02:09:56.927197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-29T02:09:56.927458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-29T02:09:56.927597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-29T02:09:56.928044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-29T02:09:56.928224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-29T02:09:56.928393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-29T02:09:56.928533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-29T02:09:56.928816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-29T02:09:56.928975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-29T02:09:56.929153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-29T02:09:56.929295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-29T02:09:56.929488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-29T02:09:56.929740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-29T02:09:56.929890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-29T02:09:56.930043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-29T02:09:56.930233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-29T02:09:56.930421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-29T02:09:56.930598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-29T02:09:56.930791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-29T02:09:56.930917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-29T02:09:56.931095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-29T02:09:56.931266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-29T02:09:56.931380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-09-29T02:09:56.931554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-29T02:09:56.931766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-29T02:09:56.931930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-29T02:09:56.932079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-29T02:09:56.932235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-29T02:09:56.932489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-29T02:09:56.932707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-29T02:09:56.932887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-29T02:09:56.933046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-29T02:09:56.933160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-29T02:09:56.933362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-29T02:09:56.933532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-29T02:09:56.933876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-29T02:09:56.934061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-29T02:09:56.934203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-09-29T02:09:56.934607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-29T02:09:56.934784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-29T02:09:56.934996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-29T02:09:56.935180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-29T02:09:56.935375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-29T02:09:56.935556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-29T02:09:56.935774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-29T02:09:56.935946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-29T02:09:56.936123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-29T02:09:56.936279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-29T02:09:56.936473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-29T02:09:56.936698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-29T02:09:56.936880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-29T02:09:56.937039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-29T02:09:56.937152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-29T02:09:56.937868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-29T02:09:56.938037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-29T02:09:56.938236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-29T02:09:56.938386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-29T02:09:56.938567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-29T02:09:56.938786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-29T02:09:56.938952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-29T02:09:56.939144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-29T02:09:56.939304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-29T02:09:56.939504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-29T02:09:56.939709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-29T02:09:56.939950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-09-29T02:09:56.940115] [INFO ] [LOCAL ] Deleted 2211 derivative data files. [2025-09-29T02:09:56.940189] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-29T02:09:56.942815] [INFO ] [LOCAL ] Found 2211 symbols with primary data. [2025-09-29T02:09:56.943509] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2211 symbols [2025-09-29T02:09:56.944521] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:56.945147] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:56.945469] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:57.043490] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-29T02:09:57.045993] [INFO ] [MAIN ] AAP: Loaded 52789 primary data records. [2025-09-29T02:09:57.134275] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-29T02:09:57.138824] [INFO ] [MAIN ] AA: Loaded 54394 primary data records. [2025-09-29T02:09:57.176804] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-29T02:09:57.209937] [INFO ] [MAIN ] A: Loaded 51487 primary data records. [2025-09-29T02:09:58.196624] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:58.198467] [INFO ] [MAIN ] AAP: Generated 1820 derivative records from 52789 primary records. [2025-09-29T02:09:58.198768] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-29T02:09:58.217701] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:58.232535] [INFO ] [MAIN ] AA: Generated 1820 derivative records from 54394 primary records. [2025-09-29T02:09:58.234105] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-29T02:09:58.252790] [DEBUG] [LOCAL ] AA: Derivative data saved (1820 records). [2025-09-29T02:09:58.253527] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-29T02:09:58.258758] [INFO ] [MAIN ] Derivative Progress: 1/2211 symbols completed. AA took 1.3s. Estimated remaining: 48m 28s. Rate: 45.6 symbols/min [2025-09-29T02:09:58.261863] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:58.262615] [DEBUG] [LOCAL ] AAP: Derivative data saved (1820 records). [2025-09-29T02:09:58.263303] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-29T02:09:58.265879] [INFO ] [MAIN ] Derivative Progress: 2/2211 symbols completed. AAP took 1.3s. Estimated remaining: 24m 21s. Rate: 90.7 symbols/min [2025-09-29T02:09:58.266183] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:58.282092] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:58.282940] [INFO ] [MAIN ] A: Generated 1820 derivative records from 51487 primary records. [2025-09-29T02:09:58.283034] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-29T02:09:58.309559] [DEBUG] [LOCAL ] A: Derivative data saved (1820 records). [2025-09-29T02:09:58.309753] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-29T02:09:58.312915] [INFO ] [MAIN ] Derivative Progress: 3/2211 symbols completed. A took 1.4s. Estimated remaining: 16m 48s. Rate: 131.4 symbols/min [2025-09-29T02:09:58.313274] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:58.336435] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-29T02:09:58.345206] [INFO ] [MAIN ] AAT: Loaded 31069 primary data records. [2025-09-29T02:09:58.346065] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-29T02:09:58.358662] [INFO ] [MAIN ] AB: Loaded 28642 primary data records. [2025-09-29T02:09:59.081894] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-29T02:09:59.084467] [INFO ] [MAIN ] ABBV: Loaded 54465 primary data records. [2025-09-29T02:09:59.451492] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:59.465505] [INFO ] [MAIN ] AAT: Generated 1820 derivative records from 31069 primary records. [2025-09-29T02:09:59.465990] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-29T02:09:59.466474] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:59.468091] [INFO ] [MAIN ] AB: Generated 1820 derivative records from 28642 primary records. [2025-09-29T02:09:59.469060] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-29T02:09:59.499918] [DEBUG] [LOCAL ] AAT: Derivative data saved (1820 records). [2025-09-29T02:09:59.504919] [DEBUG] [LOCAL ] AB: Derivative data saved (1820 records). [2025-09-29T02:09:59.505152] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-29T02:09:59.507611] [INFO ] [MAIN ] Derivative Progress: 4/2211 symbols completed. AAT took 1.2s. Estimated remaining: 23m 35s. Rate: 93.6 symbols/min [2025-09-29T02:09:59.508040] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:59.508288] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-29T02:09:59.511698] [INFO ] [MAIN ] Derivative Progress: 5/2211 symbols completed. AB took 1.2s. Estimated remaining: 18m 53s. Rate: 116.8 symbols/min [2025-09-29T02:09:59.512413] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:59.534836] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:59.535936] [INFO ] [MAIN ] ABBV: Generated 1820 derivative records from 54465 primary records. [2025-09-29T02:09:59.536220] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-29T02:09:59.563828] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1820 records). [2025-09-29T02:09:59.565262] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-29T02:09:59.577917] [INFO ] [MAIN ] Derivative Progress: 6/2211 symbols completed. ABBV took 1.3s. Estimated remaining: 16m 8s. Rate: 136.6 symbols/min [2025-09-29T02:09:59.579144] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-29T02:09:59.579729] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:59.579829] [INFO ] [MAIN ] ABCB: Loaded 31144 primary data records. [2025-09-29T02:09:59.773473] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-29T02:09:59.799747] [INFO ] [MAIN ] ABEV: Loaded 54055 primary data records. [2025-09-29T02:09:59.800506] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-29T02:09:59.810398] [INFO ] [MAIN ] ABG: Loaded 19034 primary data records. [2025-09-29T02:10:00.731924] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:00.734171] [INFO ] [MAIN ] ABCB: Generated 1820 derivative records from 31144 primary records. [2025-09-29T02:10:00.734447] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-29T02:10:00.757688] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1820 records). [2025-09-29T02:10:00.758299] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-29T02:10:00.761176] [INFO ] [MAIN ] Derivative Progress: 7/2211 symbols completed. ABCB took 1.3s. Estimated remaining: 20m 2s. Rate: 110.0 symbols/min [2025-09-29T02:10:00.761782] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:00.798179] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:00.799989] [INFO ] [MAIN ] ABG: Generated 1820 derivative records from 19034 primary records. [2025-09-29T02:10:00.798552] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:00.800352] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-29T02:10:00.801244] [INFO ] [MAIN ] ABEV: Generated 1820 derivative records from 54055 primary records. [2025-09-29T02:10:00.801574] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-29T02:10:00.847953] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1820 records). [2025-09-29T02:10:00.848728] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-29T02:10:00.851525] [INFO ] [MAIN ] Derivative Progress: 8/2211 symbols completed. ABEV took 1.3s. Estimated remaining: 17m 56s. Rate: 122.8 symbols/min [2025-09-29T02:10:00.852733] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:00.856173] [DEBUG] [LOCAL ] ABG: Derivative data saved (1820 records). [2025-09-29T02:10:00.856368] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-29T02:10:00.860136] [INFO ] [MAIN ] Derivative Progress: 9/2211 symbols completed. ABG took 1.3s. Estimated remaining: 15m 58s. Rate: 137.9 symbols/min [2025-09-29T02:10:00.860583] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:00.877392] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-29T02:10:00.877684] [INFO ] [MAIN ] ABM: Loaded 32915 primary data records. [2025-09-29T02:10:01.270000] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-29T02:10:01.271114] [INFO ] [MAIN ] ABR: Loaded 52817 primary data records. [2025-09-29T02:10:01.398462] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-29T02:10:01.417701] [INFO ] [MAIN ] ABT: Loaded 54400 primary data records. [2025-09-29T02:10:01.860451] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:01.897217] [INFO ] [MAIN ] ABM: Generated 1820 derivative records from 32915 primary records. [2025-09-29T02:10:02.035723] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-29T02:10:02.059052] [DEBUG] [LOCAL ] ABM: Derivative data saved (1820 records). [2025-09-29T02:10:02.060507] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-29T02:10:02.063388] [INFO ] [MAIN ] Derivative Progress: 10/2211 symbols completed. ABM took 1.3s. Estimated remaining: 18m 47s. Rate: 117.2 symbols/min [2025-09-29T02:10:02.064203] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:02.086479] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:02.087749] [INFO ] [MAIN ] ABR: Generated 1820 derivative records from 52817 primary records. [2025-09-29T02:10:02.088212] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-29T02:10:02.114342] [DEBUG] [LOCAL ] ABR: Derivative data saved (1820 records). [2025-09-29T02:10:02.116668] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-29T02:10:02.118828] [INFO ] [MAIN ] Derivative Progress: 11/2211 symbols completed. ABR took 1.3s. Estimated remaining: 17m 15s. Rate: 127.5 symbols/min [2025-09-29T02:10:02.120231] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:02.142491] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-29T02:10:02.143054] [INFO ] [MAIN ] ACA: Loaded 24034 primary data records. [2025-09-29T02:10:02.142913] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:02.156024] [INFO ] [MAIN ] ABT: Generated 1820 derivative records from 54400 primary records. [2025-09-29T02:10:02.191342] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-29T02:10:02.524499] [DEBUG] [LOCAL ] ABT: Derivative data saved (1820 records). [2025-09-29T02:10:02.527185] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-29T02:10:02.529065] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-29T02:10:02.535579] [INFO ] [MAIN ] ACCO: Loaded 38214 primary data records. [2025-09-29T02:10:02.533947] [INFO ] [MAIN ] Derivative Progress: 12/2211 symbols completed. ABT took 1.7s. Estimated remaining: 17m 5s. Rate: 128.8 symbols/min [2025-09-29T02:10:02.537138] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:02.951899] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-29T02:10:02.952722] [INFO ] [MAIN ] ACEL: Loaded 27405 primary data records. [2025-09-29T02:10:03.003956] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:03.028551] [INFO ] [MAIN ] ACA: Generated 1820 derivative records from 24034 primary records. [2025-09-29T02:10:03.029185] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-29T02:10:03.110213] [DEBUG] [LOCAL ] ACA: Derivative data saved (1820 records). [2025-09-29T02:10:03.111094] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-29T02:10:03.135750] [INFO ] [MAIN ] Derivative Progress: 13/2211 symbols completed. ACA took 1.1s. Estimated remaining: 17m 27s. Rate: 126.0 symbols/min [2025-09-29T02:10:03.351230] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:03.352875] [INFO ] [MAIN ] ACCO: Generated 1820 derivative records from 38214 primary records. [2025-09-29T02:10:03.353152] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-29T02:10:03.370495] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1820 records). [2025-09-29T02:10:03.370730] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-29T02:10:03.373227] [INFO ] [MAIN ] Derivative Progress: 14/2211 symbols completed. ACCO took 1.3s. Estimated remaining: 16m 49s. Rate: 130.6 symbols/min [2025-09-29T02:10:03.393112] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:03.393965] [INFO ] [MAIN ] ACEL: Generated 1820 derivative records from 27405 primary records. [2025-09-29T02:10:03.394051] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-29T02:10:03.409752] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1820 records). [2025-09-29T02:10:03.409862] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-29T02:10:03.413071] [INFO ] [MAIN ] Derivative Progress: 15/2211 symbols completed. ACEL took 0.9s. Estimated remaining: 15m 47s. Rate: 139.1 symbols/min [2025-09-29T02:10:03.413505] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:03.413634] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:03.413578] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:03.520000] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-29T02:10:03.540385] [INFO ] [MAIN ] ACM: Loaded 43767 primary data records. [2025-09-29T02:10:03.521089] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-29T02:10:03.541058] [INFO ] [MAIN ] ACHR: Loaded 54598 primary data records. [2025-09-29T02:10:03.568064] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-29T02:10:03.568346] [INFO ] [MAIN ] ACI: Loaded 54044 primary data records. [2025-09-29T02:10:04.600077] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:04.601607] [INFO ] [MAIN ] ACM: Generated 1820 derivative records from 43767 primary records. [2025-09-29T02:10:04.602118] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-29T02:10:04.621463] [DEBUG] [LOCAL ] ACM: Derivative data saved (1820 records). [2025-09-29T02:10:04.624683] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-29T02:10:04.629532] [INFO ] [MAIN ] Derivative Progress: 16/2211 symbols completed. ACM took 1.2s. Estimated remaining: 17m 35s. Rate: 124.9 symbols/min [2025-09-29T02:10:04.631070] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:04.658349] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:04.658928] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:04.661322] [INFO ] [MAIN ] ACI: Generated 1820 derivative records from 54044 primary records. [2025-09-29T02:10:04.660312] [INFO ] [MAIN ] ACHR: Generated 1820 derivative records from 54598 primary records. [2025-09-29T02:10:04.661450] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-29T02:10:04.661785] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-29T02:10:04.703580] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1820 records). [2025-09-29T02:10:04.709591] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-29T02:10:04.710723] [DEBUG] [LOCAL ] ACI: Derivative data saved (1820 records). [2025-09-29T02:10:04.715158] [INFO ] [MAIN ] Derivative Progress: 17/2211 symbols completed. ACHR took 1.3s. Estimated remaining: 16m 43s. Rate: 131.2 symbols/min [2025-09-29T02:10:04.715689] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-29T02:10:04.715875] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:04.720158] [INFO ] [MAIN ] Derivative Progress: 18/2211 symbols completed. ACI took 1.3s. Estimated remaining: 15m 48s. Rate: 138.9 symbols/min [2025-09-29T02:10:04.720914] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:04.751009] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-29T02:10:04.751230] [INFO ] [MAIN ] ACR: Loaded 6352 primary data records. [2025-09-29T02:10:04.896051] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-29T02:10:04.912736] [INFO ] [MAIN ] ACN: Loaded 54204 primary data records. [2025-09-29T02:10:05.265087] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-29T02:10:05.270244] [INFO ] [MAIN ] ACP: Loaded 31428 primary data records. [2025-09-29T02:10:05.850966] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:05.853111] [INFO ] [MAIN ] ACR: Generated 1820 derivative records from 6352 primary records. [2025-09-29T02:10:05.855406] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-29T02:10:05.879341] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:05.884842] [INFO ] [MAIN ] ACN: Generated 1820 derivative records from 54204 primary records. [2025-09-29T02:10:05.888493] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-29T02:10:05.890773] [DEBUG] [LOCAL ] ACR: Derivative data saved (1820 records). [2025-09-29T02:10:05.891970] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-29T02:10:05.906056] [INFO ] [MAIN ] Derivative Progress: 19/2211 symbols completed. ACR took 1.2s. Estimated remaining: 17m 14s. Rate: 127.2 symbols/min [2025-09-29T02:10:05.909950] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:05.912467] [DEBUG] [LOCAL ] ACN: Derivative data saved (1820 records). [2025-09-29T02:10:05.913251] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-29T02:10:05.917689] [INFO ] [MAIN ] Derivative Progress: 20/2211 symbols completed. ACN took 1.3s. Estimated remaining: 16m 23s. Rate: 133.7 symbols/min [2025-09-29T02:10:05.918861] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:05.936916] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:05.937914] [INFO ] [MAIN ] ACP: Generated 1820 derivative records from 31428 primary records. [2025-09-29T02:10:05.938144] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-29T02:10:05.957450] [DEBUG] [LOCAL ] ACP: Derivative data saved (1820 records). [2025-09-29T02:10:05.957785] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-29T02:10:05.961032] [INFO ] [MAIN ] Derivative Progress: 21/2211 symbols completed. ACP took 1.2s. Estimated remaining: 15m 40s. Rate: 139.7 symbols/min [2025-09-29T02:10:05.961405] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:05.965846] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-29T02:10:05.966561] [INFO ] [MAIN ] ACV: Loaded 7095 primary data records. [2025-09-29T02:10:06.114720] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-29T02:10:06.131388] [INFO ] [MAIN ] ACRE: Loaded 34027 primary data records. [2025-09-29T02:10:06.502284] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-29T02:10:06.536954] [INFO ] [MAIN ] ACVA: Loaded 50072 primary data records. [2025-09-29T02:10:07.110517] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:07.114142] [INFO ] [MAIN ] ACV: Generated 1820 derivative records from 7095 primary records. [2025-09-29T02:10:07.127823] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:07.129140] [INFO ] [MAIN ] ACRE: Generated 1820 derivative records from 34027 primary records. [2025-09-29T02:10:07.130214] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-29T02:10:07.130445] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-29T02:10:07.168439] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1820 records). [2025-09-29T02:10:07.173578] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-29T02:10:07.176414] [INFO ] [MAIN ] Derivative Progress: 22/2211 symbols completed. ACRE took 1.3s. Estimated remaining: 16m 58s. Rate: 129.0 symbols/min [2025-09-29T02:10:07.173468] [DEBUG] [LOCAL ] ACV: Derivative data saved (1820 records). [2025-09-29T02:10:07.177486] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:07.177625] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-29T02:10:07.181077] [INFO ] [MAIN ] Derivative Progress: 23/2211 symbols completed. ACV took 1.3s. Estimated remaining: 16m 14s. Rate: 134.8 symbols/min [2025-09-29T02:10:07.181764] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:07.201740] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:07.202837] [INFO ] [MAIN ] ACVA: Generated 1820 derivative records from 50072 primary records. [2025-09-29T02:10:07.202982] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-29T02:10:07.233356] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1820 records). [2025-09-29T02:10:07.233565] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-29T02:10:07.236288] [INFO ] [MAIN ] Derivative Progress: 24/2211 symbols completed. ACVA took 1.3s. Estimated remaining: 15m 38s. Rate: 139.9 symbols/min [2025-09-29T02:10:07.236738] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:07.251500] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-29T02:10:07.265113] [INFO ] [MAIN ] ADCT: Loaded 34670 primary data records. [2025-09-29T02:10:07.419546] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-29T02:10:07.466253] [INFO ] [MAIN ] ADC: Loaded 46934 primary data records. [2025-09-29T02:10:07.791739] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-29T02:10:07.840723] [INFO ] [MAIN ] ADM: Loaded 54175 primary data records. [2025-09-29T02:10:08.337512] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:08.353437] [INFO ] [MAIN ] ADCT: Generated 1820 derivative records from 34670 primary records. [2025-09-29T02:10:08.354100] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-29T02:10:08.373677] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1820 records). [2025-09-29T02:10:08.374524] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-29T02:10:08.378631] [INFO ] [MAIN ] Derivative Progress: 25/2211 symbols completed. ADCT took 1.2s. Estimated remaining: 16m 40s. Rate: 131.2 symbols/min [2025-09-29T02:10:08.379428] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:08.399683] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:08.400559] [INFO ] [MAIN ] ADC: Generated 1820 derivative records from 46934 primary records. [2025-09-29T02:10:08.401055] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-29T02:10:08.420117] [DEBUG] [LOCAL ] ADC: Derivative data saved (1820 records). [2025-09-29T02:10:08.420604] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-29T02:10:08.423576] [INFO ] [MAIN ] Derivative Progress: 26/2211 symbols completed. ADC took 1.2s. Estimated remaining: 16m 5s. Rate: 135.9 symbols/min [2025-09-29T02:10:08.424078] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:08.449575] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:08.451265] [INFO ] [MAIN ] ADM: Generated 1820 derivative records from 54175 primary records. [2025-09-29T02:10:08.451727] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-29T02:10:08.470307] [DEBUG] [LOCAL ] ADM: Derivative data saved (1820 records). [2025-09-29T02:10:08.481512] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-29T02:10:08.485105] [INFO ] [MAIN ] Derivative Progress: 27/2211 symbols completed. ADM took 1.2s. Estimated remaining: 15m 34s. Rate: 140.4 symbols/min [2025-09-29T02:10:08.485825] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:08.528981] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-29T02:10:08.529495] [INFO ] [MAIN ] ADNT: Loaded 48095 primary data records. [2025-09-29T02:10:08.640709] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-29T02:10:08.656800] [INFO ] [MAIN ] ADT: Loaded 54253 primary data records. [2025-09-29T02:10:08.705346] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-29T02:10:08.767963] [INFO ] [MAIN ] ADX: Loaded 28180 primary data records. [2025-09-29T02:10:09.724112] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:09.739248] [INFO ] [MAIN ] ADNT: Generated 1820 derivative records from 48095 primary records. [2025-09-29T02:10:09.740445] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-29T02:10:09.740943] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:09.743099] [INFO ] [MAIN ] ADT: Generated 1820 derivative records from 54253 primary records. [2025-09-29T02:10:09.752581] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-29T02:10:09.769089] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1820 records). [2025-09-29T02:10:09.774769] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-29T02:10:09.777536] [INFO ] [MAIN ] Derivative Progress: 28/2211 symbols completed. ADNT took 1.4s. Estimated remaining: 16m 41s. Rate: 130.9 symbols/min [2025-09-29T02:10:09.780741] [DEBUG] [LOCAL ] ADT: Derivative data saved (1820 records). [2025-09-29T02:10:09.780891] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-29T02:10:09.785495] [INFO ] [MAIN ] Derivative Progress: 29/2211 symbols completed. ADT took 1.4s. Estimated remaining: 16m 6s. Rate: 135.5 symbols/min [2025-09-29T02:10:09.800208] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:09.801007] [INFO ] [MAIN ] ADX: Generated 1820 derivative records from 28180 primary records. [2025-09-29T02:10:09.801097] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-29T02:10:09.818377] [DEBUG] [LOCAL ] ADX: Derivative data saved (1820 records). [2025-09-29T02:10:09.818483] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-29T02:10:09.821371] [INFO ] [MAIN ] Derivative Progress: 30/2211 symbols completed. ADX took 1.3s. Estimated remaining: 15m 36s. Rate: 139.8 symbols/min [2025-09-29T02:10:09.821982] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:09.822407] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:09.822706] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:09.841715] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-29T02:10:09.842098] [INFO ] [MAIN ] AEFC: Loaded 8643 primary data records. [2025-09-29T02:10:10.233801] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-29T02:10:10.235440] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-29T02:10:10.234123] [INFO ] [MAIN ] AEE: Loaded 50875 primary data records. [2025-09-29T02:10:10.235944] [INFO ] [MAIN ] AEG: Loaded 50307 primary data records. [2025-09-29T02:10:10.913088] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:10.915361] [INFO ] [MAIN ] AEFC: Generated 1820 derivative records from 8643 primary records. [2025-09-29T02:10:10.915637] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-29T02:10:10.935979] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1820 records). [2025-09-29T02:10:10.936596] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-29T02:10:10.939003] [INFO ] [MAIN ] Derivative Progress: 31/2211 symbols completed. AEFC took 1.1s. Estimated remaining: 16m 24s. Rate: 132.9 symbols/min [2025-09-29T02:10:10.939741] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:10.963670] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:10.977459] [INFO ] [MAIN ] AEE: Generated 1820 derivative records from 50875 primary records. [2025-09-29T02:10:10.978156] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:10.978308] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-29T02:10:10.979985] [INFO ] [MAIN ] AEG: Generated 1820 derivative records from 50307 primary records. [2025-09-29T02:10:10.980386] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-29T02:10:11.012184] [DEBUG] [LOCAL ] AEE: Derivative data saved (1820 records). [2025-09-29T02:10:11.014010] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-29T02:10:11.015212] [DEBUG] [LOCAL ] AEG: Derivative data saved (1820 records). [2025-09-29T02:10:11.015418] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-29T02:10:11.018558] [INFO ] [MAIN ] Derivative Progress: 32/2211 symbols completed. AEE took 1.2s. Estimated remaining: 15m 58s. Rate: 136.4 symbols/min [2025-09-29T02:10:11.022026] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:11.022097] [INFO ] [MAIN ] Derivative Progress: 33/2211 symbols completed. AEG took 1.2s. Estimated remaining: 15m 29s. Rate: 140.6 symbols/min [2025-09-29T02:10:11.022792] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:11.076735] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-29T02:10:11.077251] [INFO ] [MAIN ] AEM: Loaded 54243 primary data records. [2025-09-29T02:10:11.333188] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-29T02:10:11.314975] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-29T02:10:11.337546] [INFO ] [MAIN ] AEO: Loaded 54336 primary data records. [2025-09-29T02:10:11.337603] [INFO ] [MAIN ] AER: Loaded 49271 primary data records. [2025-09-29T02:10:12.227418] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:12.229602] [INFO ] [MAIN ] AEM: Generated 1820 derivative records from 54243 primary records. [2025-09-29T02:10:12.229738] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-29T02:10:12.252180] [DEBUG] [LOCAL ] AEM: Derivative data saved (1820 records). [2025-09-29T02:10:12.253716] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-29T02:10:12.256105] [INFO ] [MAIN ] Derivative Progress: 34/2211 symbols completed. AEM took 1.3s. Estimated remaining: 16m 20s. Rate: 133.2 symbols/min [2025-09-29T02:10:12.256454] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:12.278060] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:12.279316] [INFO ] [MAIN ] AEO: Generated 1820 derivative records from 54336 primary records. [2025-09-29T02:10:12.286970] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-29T02:10:12.292750] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:12.294019] [INFO ] [MAIN ] AER: Generated 1820 derivative records from 49271 primary records. [2025-09-29T02:10:12.294315] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-29T02:10:12.325176] [DEBUG] [LOCAL ] AEO: Derivative data saved (1820 records). [2025-09-29T02:10:12.326552] [DEBUG] [LOCAL ] AER: Derivative data saved (1820 records). [2025-09-29T02:10:12.326740] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-29T02:10:12.329841] [INFO ] [MAIN ] Derivative Progress: 35/2211 symbols completed. AER took 1.3s. Estimated remaining: 15m 57s. Rate: 136.5 symbols/min [2025-09-29T02:10:12.326838] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-29T02:10:12.330213] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:12.333592] [INFO ] [MAIN ] Derivative Progress: 36/2211 symbols completed. AEO took 1.3s. Estimated remaining: 15m 30s. Rate: 140.3 symbols/min [2025-09-29T02:10:12.334180] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:12.370434] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-29T02:10:12.370898] [INFO ] [MAIN ] AFB: Loaded 11422 primary data records. [2025-09-29T02:10:12.412837] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-29T02:10:12.438342] [INFO ] [MAIN ] AES: Loaded 54450 primary data records. [2025-09-29T02:10:12.646672] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-29T02:10:12.743719] [INFO ] [MAIN ] AESI: Loaded 50213 primary data records. [2025-09-29T02:10:13.467756] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:13.469337] [INFO ] [MAIN ] AFB: Generated 1820 derivative records from 11422 primary records. [2025-09-29T02:10:13.469800] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-29T02:10:13.485171] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:13.488609] [INFO ] [MAIN ] AES: Generated 1820 derivative records from 54450 primary records. [2025-09-29T02:10:13.501554] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-29T02:10:13.508466] [DEBUG] [LOCAL ] AFB: Derivative data saved (1820 records). [2025-09-29T02:10:13.521333] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-29T02:10:13.526513] [INFO ] [MAIN ] Derivative Progress: 37/2211 symbols completed. AFB took 1.2s. Estimated remaining: 16m 14s. Rate: 133.9 symbols/min [2025-09-29T02:10:13.527789] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:13.532595] [DEBUG] [LOCAL ] AES: Derivative data saved (1820 records). [2025-09-29T02:10:13.534908] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-29T02:10:13.538165] [INFO ] [MAIN ] Derivative Progress: 38/2211 symbols completed. AES took 1.3s. Estimated remaining: 15m 49s. Rate: 137.4 symbols/min [2025-09-29T02:10:13.539392] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:13.555504] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:13.556736] [INFO ] [MAIN ] AESI: Generated 1820 derivative records from 50213 primary records. [2025-09-29T02:10:13.557178] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-29T02:10:13.578800] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-29T02:10:13.581479] [DEBUG] [LOCAL ] AESI: Derivative data saved (1820 records). [2025-09-29T02:10:13.581814] [INFO ] [MAIN ] AFGB: Loaded 2404 primary data records. [2025-09-29T02:10:13.581946] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-29T02:10:13.600355] [INFO ] [MAIN ] Derivative Progress: 39/2211 symbols completed. AESI took 1.3s. Estimated remaining: 15m 28s. Rate: 140.5 symbols/min [2025-09-29T02:10:13.632205] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:13.744259] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-29T02:10:13.749548] [INFO ] [MAIN ] AFGC: Loaded 2602 primary data records. [2025-09-29T02:10:13.731056] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-29T02:10:13.760090] [INFO ] [MAIN ] AFG: Loaded 33021 primary data records. [2025-09-29T02:10:14.707579] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:14.708943] [INFO ] [MAIN ] AFGB: Generated 1820 derivative records from 2404 primary records. [2025-09-29T02:10:14.709250] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-29T02:10:14.731995] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1820 records). [2025-09-29T02:10:14.745733] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-29T02:10:14.748367] [INFO ] [MAIN ] Derivative Progress: 40/2211 symbols completed. AFGB took 1.2s. Estimated remaining: 16m 6s. Rate: 134.8 symbols/min [2025-09-29T02:10:14.746123] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:10:14.748584] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:14.751348] [INFO ] [MAIN ] AFGC: Generated 1819 derivative records from 2602 primary records. [2025-09-29T02:10:14.751539] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-29T02:10:14.757639] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-29T02:10:14.778044] [INFO ] [MAIN ] AFGD: Loaded 1859 primary data records. [2025-09-29T02:10:14.797355] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:14.835504] [INFO ] [MAIN ] AFG: Generated 1820 derivative records from 33021 primary records. [2025-09-29T02:10:14.797453] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1819 records). [2025-09-29T02:10:14.841151] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-29T02:10:14.841300] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-29T02:10:14.869490] [INFO ] [MAIN ] Derivative Progress: 41/2211 symbols completed. AFGC took 1.2s. Estimated remaining: 15m 49s. Rate: 137.2 symbols/min [2025-09-29T02:10:14.905467] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:14.980516] [DEBUG] [LOCAL ] AFG: Derivative data saved (1820 records). [2025-09-29T02:10:15.017634] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-29T02:10:15.135183] [INFO ] [MAIN ] AFGE: Loaded 2512 primary data records. [2025-09-29T02:10:15.144232] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-29T02:10:15.148145] [INFO ] [MAIN ] Derivative Progress: 42/2211 symbols completed. AFG took 1.6s. Estimated remaining: 15m 40s. Rate: 138.4 symbols/min [2025-09-29T02:10:15.148559] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:15.532046] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:10:15.533175] [INFO ] [MAIN ] AFGD: Generated 1818 derivative records from 1859 primary records. [2025-09-29T02:10:15.534556] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-29T02:10:15.569002] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1818 records). [2025-09-29T02:10:15.570587] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-29T02:10:15.570860] [INFO ] [MAIN ] AFL: Loaded 53915 primary data records. [2025-09-29T02:10:15.570959] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-29T02:10:15.612493] [INFO ] [MAIN ] Derivative Progress: 43/2211 symbols completed. AFGD took 0.9s. Estimated remaining: 15m 41s. Rate: 138.2 symbols/min [2025-09-29T02:10:15.715169] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:15.747087] [INFO ] [MAIN ] AFGE: Generated 1820 derivative records from 2512 primary records. [2025-09-29T02:10:15.764695] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-29T02:10:15.990393] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1820 records). [2025-09-29T02:10:15.991443] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-29T02:10:15.993826] [INFO ] [MAIN ] Derivative Progress: 44/2211 symbols completed. AFGE took 1.1s. Estimated remaining: 15m 38s. Rate: 138.6 symbols/min [2025-09-29T02:10:16.016102] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:16.017036] [INFO ] [MAIN ] AFL: Generated 1820 derivative records from 53915 primary records. [2025-09-29T02:10:16.017128] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-29T02:10:16.034010] [DEBUG] [LOCAL ] AFL: Derivative data saved (1820 records). [2025-09-29T02:10:16.034174] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-29T02:10:16.037411] [INFO ] [MAIN ] Derivative Progress: 45/2211 symbols completed. AFL took 0.9s. Estimated remaining: 15m 19s. Rate: 141.4 symbols/min [2025-09-29T02:10:16.038129] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:16.038339] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:16.038815] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:16.069119] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-29T02:10:16.069403] [INFO ] [MAIN ] AGD: Loaded 17937 primary data records. [2025-09-29T02:10:16.254468] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-29T02:10:16.294381] [INFO ] [MAIN ] AGCO: Loaded 43086 primary data records. [2025-09-29T02:10:16.321936] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-29T02:10:16.560525] [INFO ] [MAIN ] AG: Loaded 54423 primary data records. [2025-09-29T02:10:17.445130] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:17.448680] [INFO ] [MAIN ] AGD: Generated 1820 derivative records from 17937 primary records. [2025-09-29T02:10:17.450123] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-29T02:10:17.482776] [DEBUG] [LOCAL ] AGD: Derivative data saved (1820 records). [2025-09-29T02:10:17.483244] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-29T02:10:17.486626] [INFO ] [MAIN ] Derivative Progress: 46/2211 symbols completed. AGD took 1.4s. Estimated remaining: 16m 7s. Rate: 134.3 symbols/min [2025-09-29T02:10:17.486988] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:17.505862] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:17.508174] [INFO ] [MAIN ] AGCO: Generated 1820 derivative records from 43086 primary records. [2025-09-29T02:10:17.508862] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-29T02:10:17.533812] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1820 records). [2025-09-29T02:10:17.535372] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-29T02:10:17.538523] [INFO ] [MAIN ] Derivative Progress: 47/2211 symbols completed. AGCO took 1.5s. Estimated remaining: 15m 48s. Rate: 136.9 symbols/min [2025-09-29T02:10:17.539079] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:17.555999] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:17.557064] [INFO ] [MAIN ] AG: Generated 1820 derivative records from 54423 primary records. [2025-09-29T02:10:17.557155] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-29T02:10:17.578549] [DEBUG] [LOCAL ] AG: Derivative data saved (1820 records). [2025-09-29T02:10:17.578853] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-29T02:10:17.582634] [INFO ] [MAIN ] Derivative Progress: 48/2211 symbols completed. AG took 1.5s. Estimated remaining: 15m 30s. Rate: 139.5 symbols/min [2025-09-29T02:10:17.583244] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:17.647573] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-29T02:10:17.648016] [INFO ] [MAIN ] AGI: Loaded 54195 primary data records. [2025-09-29T02:10:17.666808] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-29T02:10:17.717457] [INFO ] [MAIN ] AGM: Loaded 10125 primary data records. [2025-09-29T02:10:17.764933] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-29T02:10:17.873142] [INFO ] [MAIN ] AGL: Loaded 53191 primary data records. [2025-09-29T02:10:18.780616] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:18.786104] [INFO ] [MAIN ] AGI: Generated 1820 derivative records from 54195 primary records. [2025-09-29T02:10:18.800184] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-29T02:10:18.802502] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:18.821403] [DEBUG] [LOCAL ] AGI: Derivative data saved (1820 records). [2025-09-29T02:10:18.819513] [INFO ] [MAIN ] AGM: Generated 1820 derivative records from 10125 primary records. [2025-09-29T02:10:18.822950] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-29T02:10:18.825598] [INFO ] [MAIN ] Derivative Progress: 49/2211 symbols completed. AGI took 1.3s. Estimated remaining: 16m 6s. Rate: 134.4 symbols/min [2025-09-29T02:10:18.827381] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:18.825693] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-29T02:10:18.853261] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:18.862395] [DEBUG] [LOCAL ] AGM: Derivative data saved (1820 records). [2025-09-29T02:10:18.858840] [INFO ] [MAIN ] AGL: Generated 1820 derivative records from 53191 primary records. [2025-09-29T02:10:18.862684] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-29T02:10:18.862765] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-29T02:10:18.865236] [INFO ] [MAIN ] Derivative Progress: 50/2211 symbols completed. AGM took 1.3s. Estimated remaining: 15m 47s. Rate: 136.8 symbols/min [2025-09-29T02:10:18.865767] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:18.894454] [DEBUG] [LOCAL ] AGL: Derivative data saved (1820 records). [2025-09-29T02:10:18.905148] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-29T02:10:18.909127] [INFO ] [MAIN ] Derivative Progress: 51/2211 symbols completed. AGL took 1.4s. Estimated remaining: 15m 30s. Rate: 139.3 symbols/min [2025-09-29T02:10:18.910707] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-29T02:10:18.910873] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:18.911425] [INFO ] [MAIN ] AGO: Loaded 28356 primary data records. [2025-09-29T02:10:19.065213] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-29T02:10:19.070827] [INFO ] [MAIN ] AGRO: Loaded 34097 primary data records. [2025-09-29T02:10:19.396551] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-29T02:10:19.427699] [INFO ] [MAIN ] AGX: Loaded 33823 primary data records. [2025-09-29T02:10:20.001588] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:20.003617] [INFO ] [MAIN ] AGO: Generated 1820 derivative records from 28356 primary records. [2025-09-29T02:10:20.003981] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-29T02:10:20.026403] [DEBUG] [LOCAL ] AGO: Derivative data saved (1820 records). [2025-09-29T02:10:20.027810] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-29T02:10:20.030220] [INFO ] [MAIN ] Derivative Progress: 52/2211 symbols completed. AGO took 1.2s. Estimated remaining: 15m 59s. Rate: 135.1 symbols/min [2025-09-29T02:10:20.031015] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:20.046031] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:20.047074] [INFO ] [MAIN ] AGRO: Generated 1820 derivative records from 34097 primary records. [2025-09-29T02:10:20.047304] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-29T02:10:20.065094] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1820 records). [2025-09-29T02:10:20.065580] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-29T02:10:20.067991] [INFO ] [MAIN ] Derivative Progress: 53/2211 symbols completed. AGRO took 1.2s. Estimated remaining: 15m 42s. Rate: 137.5 symbols/min [2025-09-29T02:10:20.068492] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:20.086011] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:20.087742] [INFO ] [MAIN ] AGX: Generated 1820 derivative records from 33823 primary records. [2025-09-29T02:10:20.087973] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-29T02:10:20.115920] [DEBUG] [LOCAL ] AGX: Derivative data saved (1820 records). [2025-09-29T02:10:20.116278] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-29T02:10:20.120354] [INFO ] [MAIN ] Derivative Progress: 54/2211 symbols completed. AGX took 1.2s. Estimated remaining: 15m 26s. Rate: 139.8 symbols/min [2025-09-29T02:10:20.120823] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:20.144174] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-29T02:10:20.154963] [INFO ] [MAIN ] AHH: Loaded 41885 primary data records. [2025-09-29T02:10:20.159332] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-29T02:10:20.172477] [INFO ] [MAIN ] AHT: Loaded 6181 primary data records. [2025-09-29T02:10:20.336160] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-29T02:10:20.342232] [INFO ] [MAIN ] AHR: Loaded 49946 primary data records. [2025-09-29T02:10:21.301495] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:21.303166] [INFO ] [MAIN ] AHH: Generated 1820 derivative records from 41885 primary records. [2025-09-29T02:10:21.303567] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-29T02:10:21.324832] [DEBUG] [LOCAL ] AHH: Derivative data saved (1820 records). [2025-09-29T02:10:21.333536] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-29T02:10:21.341184] [INFO ] [MAIN ] Derivative Progress: 55/2211 symbols completed. AHH took 1.3s. Estimated remaining: 15m 56s. Rate: 135.3 symbols/min [2025-09-29T02:10:21.343353] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:21.343916] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:21.346500] [INFO ] [MAIN ] AHT: Generated 1820 derivative records from 6181 primary records. [2025-09-29T02:10:21.347679] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-29T02:10:21.375221] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:21.377565] [INFO ] [MAIN ] AHR: Generated 1820 derivative records from 49946 primary records. [2025-09-29T02:10:21.378317] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-29T02:10:21.395052] [DEBUG] [LOCAL ] AHT: Derivative data saved (1820 records). [2025-09-29T02:10:21.396854] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-29T02:10:21.399265] [INFO ] [MAIN ] Derivative Progress: 56/2211 symbols completed. AHT took 1.3s. Estimated remaining: 15m 41s. Rate: 137.4 symbols/min [2025-09-29T02:10:21.400059] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:21.403765] [DEBUG] [LOCAL ] AHR: Derivative data saved (1820 records). [2025-09-29T02:10:21.404154] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-29T02:10:21.407119] [INFO ] [MAIN ] Derivative Progress: 57/2211 symbols completed. AHR took 1.3s. Estimated remaining: 15m 24s. Rate: 139.8 symbols/min [2025-09-29T02:10:21.407404] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:21.456148] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-29T02:10:21.464574] [INFO ] [MAIN ] AI: Loaded 54529 primary data records. [2025-09-29T02:10:21.465184] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-29T02:10:21.470927] [INFO ] [MAIN ] AIN: Loaded 24906 primary data records. [2025-09-29T02:10:21.762970] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-29T02:10:21.827676] [INFO ] [MAIN ] AIG: Loaded 54254 primary data records. [2025-09-29T02:10:22.550451] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:22.552222] [INFO ] [MAIN ] AI: Generated 1820 derivative records from 54529 primary records. [2025-09-29T02:10:22.552929] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-29T02:10:22.583305] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:22.586662] [INFO ] [MAIN ] AIN: Generated 1820 derivative records from 24906 primary records. [2025-09-29T02:10:22.589634] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-29T02:10:22.594248] [DEBUG] [LOCAL ] AI: Derivative data saved (1820 records). [2025-09-29T02:10:22.607627] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-29T02:10:22.612134] [DEBUG] [LOCAL ] AIN: Derivative data saved (1820 records). [2025-09-29T02:10:22.616691] [INFO ] [MAIN ] Derivative Progress: 58/2211 symbols completed. AI took 1.3s. Estimated remaining: 15m 53s. Rate: 135.5 symbols/min [2025-09-29T02:10:22.612340] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-29T02:10:22.621425] [INFO ] [MAIN ] Derivative Progress: 59/2211 symbols completed. AIN took 1.2s. Estimated remaining: 15m 37s. Rate: 137.9 symbols/min [2025-09-29T02:10:22.635483] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:22.636267] [INFO ] [MAIN ] AIG: Generated 1820 derivative records from 54254 primary records. [2025-09-29T02:10:22.636357] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-29T02:10:22.652460] [DEBUG] [LOCAL ] AIG: Derivative data saved (1820 records). [2025-09-29T02:10:22.652587] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-29T02:10:22.656468] [INFO ] [MAIN ] Derivative Progress: 60/2211 symbols completed. AIG took 1.3s. Estimated remaining: 15m 22s. Rate: 140.0 symbols/min [2025-09-29T02:10:22.657238] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:22.657399] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:22.657158] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:22.677710] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-29T02:10:22.678021] [INFO ] [MAIN ] AIO: Loaded 13477 primary data records. [2025-09-29T02:10:22.844793] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-29T02:10:22.846245] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-29T02:10:22.851466] [INFO ] [MAIN ] AIR: Loaded 28152 primary data records. [2025-09-29T02:10:22.852400] [INFO ] [MAIN ] AIT: Loaded 28208 primary data records. [2025-09-29T02:10:23.820860] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:23.822319] [INFO ] [MAIN ] AIO: Generated 1820 derivative records from 13477 primary records. [2025-09-29T02:10:23.822451] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-29T02:10:23.843918] [DEBUG] [LOCAL ] AIO: Derivative data saved (1820 records). [2025-09-29T02:10:23.844233] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-29T02:10:23.846599] [INFO ] [MAIN ] Derivative Progress: 61/2211 symbols completed. AIO took 1.2s. Estimated remaining: 15m 48s. Rate: 136.0 symbols/min [2025-09-29T02:10:23.847348] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:23.860410] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:23.861272] [INFO ] [MAIN ] AIR: Generated 1820 derivative records from 28152 primary records. [2025-09-29T02:10:23.861713] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-29T02:10:23.882586] [DEBUG] [LOCAL ] AIR: Derivative data saved (1820 records). [2025-09-29T02:10:23.882985] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-29T02:10:23.893522] [INFO ] [MAIN ] Derivative Progress: 62/2211 symbols completed. AIR took 1.2s. Estimated remaining: 15m 34s. Rate: 138.0 symbols/min [2025-09-29T02:10:23.899036] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:23.900076] [INFO ] [MAIN ] AIT: Generated 1820 derivative records from 28208 primary records. [2025-09-29T02:10:23.899195] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:23.900291] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-29T02:10:23.930687] [DEBUG] [LOCAL ] AIT: Derivative data saved (1820 records). [2025-09-29T02:10:23.930840] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-29T02:10:23.933709] [INFO ] [MAIN ] Derivative Progress: 63/2211 symbols completed. AIT took 1.3s. Estimated remaining: 15m 20s. Rate: 140.0 symbols/min [2025-09-29T02:10:23.934257] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:23.960122] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-29T02:10:23.963966] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-29T02:10:23.964223] [INFO ] [MAIN ] AIV: Loaded 40950 primary data records. [2025-09-29T02:10:23.964490] [INFO ] [MAIN ] AIZN: Loaded 3935 primary data records. [2025-09-29T02:10:24.138725] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-29T02:10:24.194466] [INFO ] [MAIN ] AIZ: Loaded 30543 primary data records. [2025-09-29T02:10:25.087789] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:25.094689] [INFO ] [MAIN ] AIZN: Generated 1820 derivative records from 3935 primary records. [2025-09-29T02:10:25.094850] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-29T02:10:25.095388] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:25.097538] [INFO ] [MAIN ] AIV: Generated 1820 derivative records from 40950 primary records. [2025-09-29T02:10:25.098433] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-29T02:10:25.123752] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1820 records). [2025-09-29T02:10:25.131464] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-29T02:10:25.131538] [DEBUG] [LOCAL ] AIV: Derivative data saved (1820 records). [2025-09-29T02:10:25.134358] [INFO ] [MAIN ] Derivative Progress: 64/2211 symbols completed. AIZN took 1.2s. Estimated remaining: 15m 46s. Rate: 136.2 symbols/min [2025-09-29T02:10:25.134715] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-29T02:10:25.135191] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:25.138696] [INFO ] [MAIN ] Derivative Progress: 65/2211 symbols completed. AIV took 1.3s. Estimated remaining: 15m 31s. Rate: 138.3 symbols/min [2025-09-29T02:10:25.139249] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:25.157377] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:25.158348] [INFO ] [MAIN ] AIZ: Generated 1820 derivative records from 30543 primary records. [2025-09-29T02:10:25.158676] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-29T02:10:25.183054] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1820 records). [2025-09-29T02:10:25.183301] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-29T02:10:25.186552] [INFO ] [MAIN ] Derivative Progress: 66/2211 symbols completed. AIZ took 1.3s. Estimated remaining: 15m 18s. Rate: 140.2 symbols/min [2025-09-29T02:10:25.187088] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:25.247485] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-29T02:10:25.249324] [INFO ] [MAIN ] AJG: Loaded 47710 primary data records. [2025-09-29T02:10:25.292133] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-29T02:10:25.292403] [INFO ] [MAIN ] AKR: Loaded 46481 primary data records. [2025-09-29T02:10:25.526786] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-29T02:10:25.580792] [INFO ] [MAIN ] AL: Loaded 44831 primary data records. [2025-09-29T02:10:26.363291] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:26.362847] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:26.364390] [INFO ] [MAIN ] AKR: Generated 1820 derivative records from 46481 primary records. [2025-09-29T02:10:26.365764] [INFO ] [MAIN ] AJG: Generated 1820 derivative records from 47710 primary records. [2025-09-29T02:10:26.365831] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-29T02:10:26.367554] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-29T02:10:26.400503] [DEBUG] [LOCAL ] AJG: Derivative data saved (1820 records). [2025-09-29T02:10:26.401773] [DEBUG] [LOCAL ] AKR: Derivative data saved (1820 records). [2025-09-29T02:10:26.402282] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-29T02:10:26.405239] [INFO ] [MAIN ] Derivative Progress: 67/2211 symbols completed. AKR took 1.3s. Estimated remaining: 15m 43s. Rate: 136.4 symbols/min [2025-09-29T02:10:26.402187] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-29T02:10:26.408039] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:26.408454] [INFO ] [MAIN ] Derivative Progress: 68/2211 symbols completed. AJG took 1.3s. Estimated remaining: 15m 29s. Rate: 138.5 symbols/min [2025-09-29T02:10:26.409211] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:26.429170] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:26.430701] [INFO ] [MAIN ] AL: Generated 1820 derivative records from 44831 primary records. [2025-09-29T02:10:26.430916] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-29T02:10:26.449382] [DEBUG] [LOCAL ] AL: Derivative data saved (1820 records). [2025-09-29T02:10:26.449549] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-29T02:10:26.452802] [INFO ] [MAIN ] Derivative Progress: 69/2211 symbols completed. AL took 1.3s. Estimated remaining: 15m 16s. Rate: 140.3 symbols/min [2025-09-29T02:10:26.453106] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:26.510471] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-29T02:10:26.512624] [INFO ] [MAIN ] ALC: Loaded 51537 primary data records. [2025-09-29T02:10:26.622726] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-29T02:10:26.645962] [INFO ] [MAIN ] ALB: Loaded 54000 primary data records. [2025-09-29T02:10:26.655352] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-29T02:10:26.701937] [INFO ] [MAIN ] ALE: Loaded 30788 primary data records. [2025-09-29T02:10:27.629523] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:27.631995] [INFO ] [MAIN ] ALC: Generated 1820 derivative records from 51537 primary records. [2025-09-29T02:10:27.634159] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-29T02:10:27.662208] [DEBUG] [LOCAL ] ALC: Derivative data saved (1820 records). [2025-09-29T02:10:27.668019] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-29T02:10:27.670629] [INFO ] [MAIN ] Derivative Progress: 70/2211 symbols completed. ALC took 1.3s. Estimated remaining: 15m 40s. Rate: 136.7 symbols/min [2025-09-29T02:10:27.672287] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:27.671843] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:27.673935] [INFO ] [MAIN ] ALB: Generated 1820 derivative records from 54000 primary records. [2025-09-29T02:10:27.674451] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-29T02:10:27.703170] [DEBUG] [LOCAL ] ALB: Derivative data saved (1820 records). [2025-09-29T02:10:27.708581] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-29T02:10:27.708916] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:27.709813] [INFO ] [MAIN ] ALE: Generated 1820 derivative records from 30788 primary records. [2025-09-29T02:10:27.712965] [INFO ] [MAIN ] Derivative Progress: 71/2211 symbols completed. ALB took 1.3s. Estimated remaining: 15m 27s. Rate: 138.4 symbols/min [2025-09-29T02:10:27.709916] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-29T02:10:27.713179] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:27.740979] [DEBUG] [LOCAL ] ALE: Derivative data saved (1820 records). [2025-09-29T02:10:27.753343] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-29T02:10:27.756256] [INFO ] [MAIN ] Derivative Progress: 72/2211 symbols completed. ALE took 1.3s. Estimated remaining: 15m 15s. Rate: 140.2 symbols/min [2025-09-29T02:10:27.757771] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-29T02:10:27.756517] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:27.758166] [INFO ] [MAIN ] ALEX: Loaded 31769 primary data records. [2025-09-29T02:10:27.787969] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-29T02:10:27.818070] [INFO ] [MAIN ] ALG: Loaded 10562 primary data records. [2025-09-29T02:10:28.455330] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-29T02:10:28.456669] [INFO ] [MAIN ] ALIT: Loaded 53534 primary data records. [2025-09-29T02:10:28.811524] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:28.815534] [INFO ] [MAIN ] ALEX: Generated 1820 derivative records from 31769 primary records. [2025-09-29T02:10:28.829538] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:28.830369] [INFO ] [MAIN ] ALG: Generated 1820 derivative records from 10562 primary records. [2025-09-29T02:10:28.829094] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-29T02:10:28.830480] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-29T02:10:28.865104] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1820 records). [2025-09-29T02:10:28.867975] [DEBUG] [LOCAL ] ALG: Derivative data saved (1820 records). [2025-09-29T02:10:28.868236] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-29T02:10:28.870976] [INFO ] [MAIN ] Derivative Progress: 73/2211 symbols completed. ALEX took 1.2s. Estimated remaining: 15m 35s. Rate: 137.2 symbols/min [2025-09-29T02:10:28.868456] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-29T02:10:28.874437] [INFO ] [MAIN ] Derivative Progress: 74/2211 symbols completed. ALG took 1.2s. Estimated remaining: 15m 22s. Rate: 139.0 symbols/min [2025-09-29T02:10:28.891355] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:28.892130] [INFO ] [MAIN ] ALIT: Generated 1820 derivative records from 53534 primary records. [2025-09-29T02:10:28.892217] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-29T02:10:28.908306] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1820 records). [2025-09-29T02:10:28.908403] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-29T02:10:28.911512] [INFO ] [MAIN ] Derivative Progress: 75/2211 symbols completed. ALIT took 1.2s. Estimated remaining: 15m 10s. Rate: 140.8 symbols/min [2025-09-29T02:10:28.912049] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:28.912636] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:28.912214] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:29.015040] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-29T02:10:29.015521] [INFO ] [MAIN ] ALK: Loaded 53840 primary data records. [2025-09-29T02:10:29.016538] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-29T02:10:29.041268] [INFO ] [MAIN ] ALLE: Loaded 45637 primary data records. [2025-09-29T02:10:29.212996] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-29T02:10:29.264168] [INFO ] [MAIN ] ALL: Loaded 50903 primary data records. [2025-09-29T02:10:30.080894] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:30.081967] [INFO ] [MAIN ] ALK: Generated 1820 derivative records from 53840 primary records. [2025-09-29T02:10:30.094818] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-29T02:10:30.095456] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:30.097561] [INFO ] [MAIN ] ALLE: Generated 1820 derivative records from 45637 primary records. [2025-09-29T02:10:30.097922] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-29T02:10:30.131629] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1820 records). [2025-09-29T02:10:30.134341] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-29T02:10:30.137984] [INFO ] [MAIN ] Derivative Progress: 76/2211 symbols completed. ALLE took 1.2s. Estimated remaining: 15m 33s. Rate: 137.4 symbols/min [2025-09-29T02:10:30.139223] [DEBUG] [LOCAL ] ALK: Derivative data saved (1820 records). [2025-09-29T02:10:30.138730] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:30.139459] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-29T02:10:30.142279] [INFO ] [MAIN ] Derivative Progress: 77/2211 symbols completed. ALK took 1.2s. Estimated remaining: 15m 20s. Rate: 139.2 symbols/min [2025-09-29T02:10:30.155414] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:30.155820] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:30.156840] [INFO ] [MAIN ] ALL: Generated 1820 derivative records from 50903 primary records. [2025-09-29T02:10:30.157275] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-29T02:10:30.175383] [DEBUG] [LOCAL ] ALL: Derivative data saved (1820 records). [2025-09-29T02:10:30.175728] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-29T02:10:30.179725] [INFO ] [MAIN ] Derivative Progress: 78/2211 symbols completed. ALL took 1.3s. Estimated remaining: 15m 9s. Rate: 140.8 symbols/min [2025-09-29T02:10:30.180222] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:30.234284] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-29T02:10:30.234464] [INFO ] [MAIN ] ALTG: Loaded 24161 primary data records. [2025-09-29T02:10:30.334783] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-29T02:10:30.394411] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-29T02:10:30.394597] [INFO ] [MAIN ] ALSN: Loaded 43953 primary data records. [2025-09-29T02:10:30.410330] [INFO ] [MAIN ] ALLY: Loaded 53997 primary data records. [2025-09-29T02:10:31.308083] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:31.310181] [INFO ] [MAIN ] ALTG: Generated 1820 derivative records from 24161 primary records. [2025-09-29T02:10:31.310594] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-29T02:10:31.329005] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1820 records). [2025-09-29T02:10:31.329240] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-29T02:10:31.331634] [INFO ] [MAIN ] Derivative Progress: 79/2211 symbols completed. ALTG took 1.2s. Estimated remaining: 15m 28s. Rate: 137.8 symbols/min [2025-09-29T02:10:31.332484] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:31.369561] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:31.370257] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:31.371463] [INFO ] [MAIN ] ALLY: Generated 1820 derivative records from 53997 primary records. [2025-09-29T02:10:31.376483] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-29T02:10:31.377400] [INFO ] [MAIN ] ALSN: Generated 1820 derivative records from 43953 primary records. [2025-09-29T02:10:31.377955] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-29T02:10:31.379209] [INFO ] [MAIN ] ALUR: Loaded 10950 primary data records. [2025-09-29T02:10:31.379118] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-29T02:10:31.464941] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1820 records). [2025-09-29T02:10:31.470964] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-29T02:10:31.474436] [INFO ] [MAIN ] Derivative Progress: 80/2211 symbols completed. ALLY took 1.3s. Estimated remaining: 15m 20s. Rate: 139.0 symbols/min [2025-09-29T02:10:31.482184] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:31.532851] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1820 records). [2025-09-29T02:10:31.576432] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-29T02:10:31.591030] [INFO ] [MAIN ] Derivative Progress: 81/2211 symbols completed. ALSN took 1.4s. Estimated remaining: 15m 11s. Rate: 140.3 symbols/min [2025-09-29T02:10:31.613756] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:31.831687] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-29T02:10:31.831902] [INFO ] [MAIN ] ALX: Loaded 6121 primary data records. [2025-09-29T02:10:32.061932] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-29T02:10:32.184632] [INFO ] [MAIN ] ALV: Loaded 43217 primary data records. [2025-09-29T02:10:32.511876] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:32.528825] [INFO ] [MAIN ] ALUR: Generated 1820 derivative records from 10950 primary records. [2025-09-29T02:10:32.529292] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-29T02:10:32.549184] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1820 records). [2025-09-29T02:10:32.549855] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-29T02:10:32.556293] [INFO ] [MAIN ] Derivative Progress: 82/2211 symbols completed. ALUR took 1.2s. Estimated remaining: 15m 25s. Rate: 138.2 symbols/min [2025-09-29T02:10:32.557515] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:32.571706] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:32.573529] [INFO ] [MAIN ] ALX: Generated 1820 derivative records from 6121 primary records. [2025-09-29T02:10:32.573665] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-29T02:10:32.592455] [DEBUG] [LOCAL ] ALX: Derivative data saved (1820 records). [2025-09-29T02:10:32.592985] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-29T02:10:32.595841] [INFO ] [MAIN ] Derivative Progress: 83/2211 symbols completed. ALX took 1.0s. Estimated remaining: 15m 14s. Rate: 139.7 symbols/min [2025-09-29T02:10:32.596535] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:32.616439] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:32.617458] [INFO ] [MAIN ] ALV: Generated 1820 derivative records from 43217 primary records. [2025-09-29T02:10:32.617689] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-29T02:10:32.635142] [DEBUG] [LOCAL ] ALV: Derivative data saved (1820 records). [2025-09-29T02:10:32.635329] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-29T02:10:32.638401] [INFO ] [MAIN ] Derivative Progress: 84/2211 symbols completed. ALV took 1.2s. Estimated remaining: 15m 4s. Rate: 141.2 symbols/min [2025-09-29T02:10:32.638753] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:32.680600] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-29T02:10:32.696283] [INFO ] [MAIN ] AMBC: Loaded 37453 primary data records. [2025-09-29T02:10:32.711085] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-29T02:10:32.743802] [INFO ] [MAIN ] AM: Loaded 52887 primary data records. [2025-09-29T02:10:33.416419] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-29T02:10:33.418234] [INFO ] [MAIN ] AMBP: Loaded 45863 primary data records. [2025-09-29T02:10:33.839810] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:33.842675] [INFO ] [MAIN ] AMBC: Generated 1820 derivative records from 37453 primary records. [2025-09-29T02:10:33.843283] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-29T02:10:33.871397] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:33.877538] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1820 records). [2025-09-29T02:10:33.873690] [INFO ] [MAIN ] AM: Generated 1820 derivative records from 52887 primary records. [2025-09-29T02:10:33.877854] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-29T02:10:33.880540] [INFO ] [MAIN ] Derivative Progress: 85/2211 symbols completed. AMBC took 1.3s. Estimated remaining: 15m 24s. Rate: 138.1 symbols/min [2025-09-29T02:10:33.880820] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:33.881498] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-29T02:10:33.900887] [DEBUG] [LOCAL ] AM: Derivative data saved (1820 records). [2025-09-29T02:10:33.901154] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-29T02:10:33.904320] [INFO ] [MAIN ] Derivative Progress: 86/2211 symbols completed. AM took 1.3s. Estimated remaining: 15m 13s. Rate: 139.6 symbols/min [2025-09-29T02:10:33.904845] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:33.925295] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:33.926213] [INFO ] [MAIN ] AMBP: Generated 1820 derivative records from 45863 primary records. [2025-09-29T02:10:33.926300] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-29T02:10:33.942708] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1820 records). [2025-09-29T02:10:33.943002] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-29T02:10:33.945738] [INFO ] [MAIN ] Derivative Progress: 87/2211 symbols completed. AMBP took 1.3s. Estimated remaining: 15m 3s. Rate: 141.1 symbols/min [2025-09-29T02:10:33.946231] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:34.004529] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-29T02:10:34.005019] [INFO ] [MAIN ] AMC: Loaded 54539 primary data records. [2025-09-29T02:10:34.146077] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-29T02:10:34.157360] [INFO ] [MAIN ] AMCR: Loaded 54449 primary data records. [2025-09-29T02:10:34.475585] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-29T02:10:34.503475] [INFO ] [MAIN ] AME: Loaded 49252 primary data records. [2025-09-29T02:10:35.089478] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:35.091099] [INFO ] [MAIN ] AMC: Generated 1820 derivative records from 54539 primary records. [2025-09-29T02:10:35.092031] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-29T02:10:35.130113] [DEBUG] [LOCAL ] AMC: Derivative data saved (1820 records). [2025-09-29T02:10:35.131075] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:35.130679] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-29T02:10:35.132191] [INFO ] [MAIN ] AMCR: Generated 1820 derivative records from 54449 primary records. [2025-09-29T02:10:35.136198] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-29T02:10:35.135804] [INFO ] [MAIN ] Derivative Progress: 88/2211 symbols completed. AMC took 1.3s. Estimated remaining: 15m 21s. Rate: 138.2 symbols/min [2025-09-29T02:10:35.157059] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1820 records). [2025-09-29T02:10:35.157291] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-29T02:10:35.172503] [INFO ] [MAIN ] Derivative Progress: 89/2211 symbols completed. AMCR took 1.3s. Estimated remaining: 15m 11s. Rate: 139.7 symbols/min [2025-09-29T02:10:35.172923] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:35.173964] [INFO ] [MAIN ] AME: Generated 1820 derivative records from 49252 primary records. [2025-09-29T02:10:35.174060] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-29T02:10:35.190798] [DEBUG] [LOCAL ] AME: Derivative data saved (1820 records). [2025-09-29T02:10:35.190894] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-29T02:10:35.193818] [INFO ] [MAIN ] Derivative Progress: 90/2211 symbols completed. AME took 1.2s. Estimated remaining: 15m 1s. Rate: 141.2 symbols/min [2025-09-29T02:10:35.194552] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:35.194462] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:35.194349] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:35.229915] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-29T02:10:35.241098] [INFO ] [MAIN ] AMG: Loaded 21046 primary data records. [2025-09-29T02:10:35.405955] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-29T02:10:35.442419] [INFO ] [MAIN ] AMN: Loaded 42588 primary data records. [2025-09-29T02:10:35.443401] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-29T02:10:35.474792] [INFO ] [MAIN ] AMH: Loaded 52467 primary data records. [2025-09-29T02:10:36.365635] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:36.367039] [INFO ] [MAIN ] AMG: Generated 1820 derivative records from 21046 primary records. [2025-09-29T02:10:36.367718] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-29T02:10:36.389818] [DEBUG] [LOCAL ] AMG: Derivative data saved (1820 records). [2025-09-29T02:10:36.390511] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-29T02:10:36.392862] [INFO ] [MAIN ] Derivative Progress: 91/2211 symbols completed. AMG took 1.2s. Estimated remaining: 15m 19s. Rate: 138.4 symbols/min [2025-09-29T02:10:36.406062] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:36.407424] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:36.408421] [INFO ] [MAIN ] AMN: Generated 1820 derivative records from 42588 primary records. [2025-09-29T02:10:36.408624] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-29T02:10:36.429235] [DEBUG] [LOCAL ] AMN: Derivative data saved (1820 records). [2025-09-29T02:10:36.429583] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-29T02:10:36.432558] [INFO ] [MAIN ] Derivative Progress: 92/2211 symbols completed. AMN took 1.2s. Estimated remaining: 15m 10s. Rate: 139.8 symbols/min [2025-09-29T02:10:36.440749] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:36.446665] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:36.447532] [INFO ] [MAIN ] AMH: Generated 1820 derivative records from 52467 primary records. [2025-09-29T02:10:36.449233] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-29T02:10:36.475589] [DEBUG] [LOCAL ] AMH: Derivative data saved (1820 records). [2025-09-29T02:10:36.475799] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-29T02:10:36.478342] [INFO ] [MAIN ] Derivative Progress: 93/2211 symbols completed. AMH took 1.3s. Estimated remaining: 15m 0s. Rate: 141.1 symbols/min [2025-09-29T02:10:36.478754] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:36.493120] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-29T02:10:36.493572] [INFO ] [MAIN ] AMP: Loaded 32959 primary data records. [2025-09-29T02:10:36.730282] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-29T02:10:36.766172] [INFO ] [MAIN ] AMPX: Loaded 52949 primary data records. [2025-09-29T02:10:36.767222] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-29T02:10:36.912268] [INFO ] [MAIN ] AMPY: Loaded 38164 primary data records. [2025-09-29T02:10:37.595111] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:37.596429] [INFO ] [MAIN ] AMP: Generated 1820 derivative records from 32959 primary records. [2025-09-29T02:10:37.596898] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-29T02:10:37.627676] [DEBUG] [LOCAL ] AMP: Derivative data saved (1820 records). [2025-09-29T02:10:37.633718] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:37.633954] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-29T02:10:37.636972] [INFO ] [MAIN ] Derivative Progress: 94/2211 symbols completed. AMP took 1.2s. Estimated remaining: 15m 16s. Rate: 138.6 symbols/min [2025-09-29T02:10:37.638298] [INFO ] [MAIN ] AMPX: Generated 1820 derivative records from 52949 primary records. [2025-09-29T02:10:37.639119] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:37.639414] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-29T02:10:37.661156] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1820 records). [2025-09-29T02:10:37.661583] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-29T02:10:37.664767] [INFO ] [MAIN ] Derivative Progress: 95/2211 symbols completed. AMPX took 1.2s. Estimated remaining: 15m 7s. Rate: 140.0 symbols/min [2025-09-29T02:10:37.665149] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:37.679030] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:37.680131] [INFO ] [MAIN ] AMPY: Generated 1820 derivative records from 38164 primary records. [2025-09-29T02:10:37.680231] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-29T02:10:37.706517] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1820 records). [2025-09-29T02:10:37.706861] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-29T02:10:37.710039] [INFO ] [MAIN ] Derivative Progress: 96/2211 symbols completed. AMPY took 1.2s. Estimated remaining: 14m 58s. Rate: 141.3 symbols/min [2025-09-29T02:10:37.710530] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:37.725019] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-29T02:10:37.725213] [INFO ] [MAIN ] AMR: Loaded 29441 primary data records. [2025-09-29T02:10:37.913343] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-29T02:10:37.956126] [INFO ] [MAIN ] AMRC: Loaded 38981 primary data records. [2025-09-29T02:10:38.270360] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-29T02:10:38.270599] [INFO ] [MAIN ] AMT: Loaded 53212 primary data records. [2025-09-29T02:10:38.728002] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:38.860013] [INFO ] [MAIN ] AMR: Generated 1820 derivative records from 29441 primary records. [2025-09-29T02:10:38.861310] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-29T02:10:38.883036] [DEBUG] [LOCAL ] AMR: Derivative data saved (1820 records). [2025-09-29T02:10:38.884705] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-29T02:10:38.887424] [INFO ] [MAIN ] Derivative Progress: 97/2211 symbols completed. AMR took 1.2s. Estimated remaining: 15m 14s. Rate: 138.8 symbols/min [2025-09-29T02:10:38.888490] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:38.909976] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:38.911044] [INFO ] [MAIN ] AMRC: Generated 1820 derivative records from 38981 primary records. [2025-09-29T02:10:38.911460] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-29T02:10:38.943272] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1820 records). [2025-09-29T02:10:38.954588] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-29T02:10:38.955770] [INFO ] [MAIN ] AMTB: Loaded 20599 primary data records. [2025-09-29T02:10:38.955919] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-29T02:10:38.958948] [INFO ] [MAIN ] Derivative Progress: 98/2211 symbols completed. AMRC took 1.3s. Estimated remaining: 15m 6s. Rate: 139.9 symbols/min [2025-09-29T02:10:38.990072] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:39.027458] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:39.060058] [INFO ] [MAIN ] AMT: Generated 1820 derivative records from 53212 primary records. [2025-09-29T02:10:39.110791] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-29T02:10:39.121212] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-29T02:10:39.151936] [INFO ] [MAIN ] AMTD: Loaded 3622 primary data records. [2025-09-29T02:10:39.182985] [DEBUG] [LOCAL ] AMT: Derivative data saved (1820 records). [2025-09-29T02:10:39.195111] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-29T02:10:39.215049] [INFO ] [MAIN ] Derivative Progress: 99/2211 symbols completed. AMT took 1.5s. Estimated remaining: 15m 2s. Rate: 140.5 symbols/min [2025-09-29T02:10:39.409027] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:39.716945] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:39.718999] [INFO ] [MAIN ] AMTB: Generated 1820 derivative records from 20599 primary records. [2025-09-29T02:10:39.719564] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-29T02:10:39.755755] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1820 records). [2025-09-29T02:10:39.758926] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-29T02:10:39.759785] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-29T02:10:39.760016] [INFO ] [MAIN ] AMTM: Loaded 51451 primary data records. [2025-09-29T02:10:39.762777] [INFO ] [MAIN ] Derivative Progress: 100/2211 symbols completed. AMTB took 0.9s. Estimated remaining: 15m 4s. Rate: 140.1 symbols/min [2025-09-29T02:10:39.768775] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:39.823602] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:39.854001] [INFO ] [MAIN ] AMTD: Generated 1820 derivative records from 3622 primary records. [2025-09-29T02:10:39.890328] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-29T02:10:39.922312] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-29T02:10:39.926502] [INFO ] [MAIN ] AMWL: Loaded 8830 primary data records. [2025-09-29T02:10:40.208967] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1820 records). [2025-09-29T02:10:40.227526] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-29T02:10:40.230225] [INFO ] [MAIN ] Derivative Progress: 101/2211 symbols completed. AMTD took 1.2s. Estimated remaining: 15m 4s. Rate: 140.0 symbols/min [2025-09-29T02:10:40.239415] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:40.549906] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:40.551129] [INFO ] [MAIN ] AMTM: Generated 1820 derivative records from 51451 primary records. [2025-09-29T02:10:40.551945] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-29T02:10:40.589374] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1820 records). [2025-09-29T02:10:40.591235] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-29T02:10:40.591397] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-29T02:10:40.594715] [INFO ] [MAIN ] Derivative Progress: 102/2211 symbols completed. AMTM took 1.2s. Estimated remaining: 15m 3s. Rate: 140.2 symbols/min [2025-09-29T02:10:40.591753] [INFO ] [MAIN ] AMX: Loaded 49855 primary data records. [2025-09-29T02:10:40.594951] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:40.763044] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:40.805050] [INFO ] [MAIN ] AMWL: Generated 1820 derivative records from 8830 primary records. [2025-09-29T02:10:40.942392] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-29T02:10:40.969971] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-29T02:10:40.976993] [INFO ] [MAIN ] AN: Loaded 32842 primary data records. [2025-09-29T02:10:41.025831] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1820 records). [2025-09-29T02:10:41.044543] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-29T02:10:41.056614] [INFO ] [MAIN ] Derivative Progress: 103/2211 symbols completed. AMWL took 1.3s. Estimated remaining: 15m 3s. Rate: 140.1 symbols/min [2025-09-29T02:10:41.349101] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:41.351724] [INFO ] [MAIN ] AMX: Generated 1820 derivative records from 49855 primary records. [2025-09-29T02:10:41.352091] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-29T02:10:41.370308] [DEBUG] [LOCAL ] AMX: Derivative data saved (1820 records). [2025-09-29T02:10:41.370544] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-29T02:10:41.373236] [INFO ] [MAIN ] Derivative Progress: 104/2211 symbols completed. AMX took 1.1s. Estimated remaining: 15m 0s. Rate: 140.4 symbols/min [2025-09-29T02:10:41.393686] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:41.394494] [INFO ] [MAIN ] AN: Generated 1820 derivative records from 32842 primary records. [2025-09-29T02:10:41.394586] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-29T02:10:41.411777] [DEBUG] [LOCAL ] AN: Derivative data saved (1820 records). [2025-09-29T02:10:41.412025] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-29T02:10:41.415030] [INFO ] [MAIN ] Derivative Progress: 105/2211 symbols completed. AN took 0.8s. Estimated remaining: 14m 52s. Rate: 141.7 symbols/min [2025-09-29T02:10:41.415711] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:41.416025] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:41.415861] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:41.439542] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-29T02:10:41.439760] [INFO ] [MAIN ] ANRO: Loaded 19387 primary data records. [2025-09-29T02:10:41.850008] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-29T02:10:41.875674] [INFO ] [MAIN ] ANF: Loaded 52967 primary data records. [2025-09-29T02:10:41.882305] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-29T02:10:41.892405] [INFO ] [MAIN ] ANET: Loaded 54546 primary data records. [2025-09-29T02:10:42.672052] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:42.673128] [INFO ] [MAIN ] ANRO: Generated 1820 derivative records from 19387 primary records. [2025-09-29T02:10:42.674425] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-29T02:10:42.694058] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1820 records). [2025-09-29T02:10:42.694853] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-29T02:10:42.698089] [INFO ] [MAIN ] Derivative Progress: 106/2211 symbols completed. ANRO took 1.3s. Estimated remaining: 15m 9s. Rate: 139.0 symbols/min [2025-09-29T02:10:42.698975] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:42.722079] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:42.723453] [INFO ] [MAIN ] ANF: Generated 1820 derivative records from 52967 primary records. [2025-09-29T02:10:42.723710] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-29T02:10:42.763347] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:42.764259] [DEBUG] [LOCAL ] ANF: Derivative data saved (1820 records). [2025-09-29T02:10:42.765198] [INFO ] [MAIN ] ANET: Generated 1820 derivative records from 54546 primary records. [2025-09-29T02:10:42.773972] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-29T02:10:42.764409] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-29T02:10:42.777395] [INFO ] [MAIN ] Derivative Progress: 107/2211 symbols completed. ANF took 1.4s. Estimated remaining: 15m 1s. Rate: 140.1 symbols/min [2025-09-29T02:10:42.778559] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:42.774707] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-29T02:10:42.779262] [INFO ] [MAIN ] ANVS: Loaded 23508 primary data records. [2025-09-29T02:10:42.865542] [DEBUG] [LOCAL ] ANET: Derivative data saved (1820 records). [2025-09-29T02:10:42.913940] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-29T02:10:42.921477] [INFO ] [MAIN ] Derivative Progress: 108/2211 symbols completed. ANET took 1.5s. Estimated remaining: 14m 55s. Rate: 140.9 symbols/min [2025-09-29T02:10:42.927418] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:42.988554] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-29T02:10:43.018048] [INFO ] [MAIN ] AOD: Loaded 30414 primary data records. [2025-09-29T02:10:43.264446] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-29T02:10:43.265091] [INFO ] [MAIN ] AOMR: Loaded 16852 primary data records. [2025-09-29T02:10:43.873664] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:43.875123] [INFO ] [MAIN ] ANVS: Generated 1820 derivative records from 23508 primary records. [2025-09-29T02:10:43.875251] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-29T02:10:43.897257] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1820 records). [2025-09-29T02:10:43.897480] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-29T02:10:43.900274] [INFO ] [MAIN ] Derivative Progress: 109/2211 symbols completed. ANVS took 1.2s. Estimated remaining: 15m 6s. Rate: 139.3 symbols/min [2025-09-29T02:10:43.900986] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:43.925391] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:43.926892] [INFO ] [MAIN ] AOD: Generated 1820 derivative records from 30414 primary records. [2025-09-29T02:10:43.928343] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-29T02:10:43.953776] [DEBUG] [LOCAL ] AOD: Derivative data saved (1820 records). [2025-09-29T02:10:43.955588] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-29T02:10:43.958854] [INFO ] [MAIN ] Derivative Progress: 110/2211 symbols completed. AOD took 1.2s. Estimated remaining: 14m 58s. Rate: 140.4 symbols/min [2025-09-29T02:10:43.959387] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:43.973958] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:43.975343] [INFO ] [MAIN ] AOMR: Generated 1820 derivative records from 16852 primary records. [2025-09-29T02:10:43.987788] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-29T02:10:44.007053] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1820 records). [2025-09-29T02:10:44.008180] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-29T02:10:44.024301] [INFO ] [MAIN ] Derivative Progress: 111/2211 symbols completed. AOMR took 1.1s. Estimated remaining: 14m 51s. Rate: 141.5 symbols/min [2025-09-29T02:10:44.024776] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:44.026952] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-29T02:10:44.027283] [INFO ] [MAIN ] AON: Loaded 46248 primary data records. [2025-09-29T02:10:44.171087] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-29T02:10:44.192579] [INFO ] [MAIN ] AORT: Loaded 30087 primary data records. [2025-09-29T02:10:44.567014] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-29T02:10:44.616280] [INFO ] [MAIN ] AOS: Loaded 49769 primary data records. [2025-09-29T02:10:45.184621] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:45.187542] [INFO ] [MAIN ] AON: Generated 1820 derivative records from 46248 primary records. [2025-09-29T02:10:45.188367] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-29T02:10:45.211023] [DEBUG] [LOCAL ] AON: Derivative data saved (1820 records). [2025-09-29T02:10:45.212025] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-29T02:10:45.215301] [INFO ] [MAIN ] Derivative Progress: 112/2211 symbols completed. AON took 1.3s. Estimated remaining: 15m 5s. Rate: 139.2 symbols/min [2025-09-29T02:10:45.216060] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:45.230323] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:45.231846] [INFO ] [MAIN ] AORT: Generated 1820 derivative records from 30087 primary records. [2025-09-29T02:10:45.232242] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-29T02:10:45.259138] [DEBUG] [LOCAL ] AORT: Derivative data saved (1820 records). [2025-09-29T02:10:45.259304] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-29T02:10:45.262728] [INFO ] [MAIN ] Derivative Progress: 113/2211 symbols completed. AORT took 1.3s. Estimated remaining: 14m 57s. Rate: 140.3 symbols/min [2025-09-29T02:10:45.268549] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:45.269529] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-29T02:10:45.271450] [INFO ] [MAIN ] AP: Loaded 7236 primary data records. [2025-09-29T02:10:45.345970] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:45.370229] [INFO ] [MAIN ] AOS: Generated 1820 derivative records from 49769 primary records. [2025-09-29T02:10:45.381802] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-29T02:10:45.653402] [DEBUG] [LOCAL ] AOS: Derivative data saved (1820 records). [2025-09-29T02:10:45.666132] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-29T02:10:45.669955] [INFO ] [MAIN ] Derivative Progress: 114/2211 symbols completed. AOS took 1.6s. Estimated remaining: 14m 56s. Rate: 140.4 symbols/min [2025-09-29T02:10:45.670777] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:45.673134] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-29T02:10:45.673954] [INFO ] [MAIN ] APAM: Loaded 36969 primary data records. [2025-09-29T02:10:46.098416] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-29T02:10:46.099837] [INFO ] [MAIN ] APD: Loaded 46087 primary data records. [2025-09-29T02:10:46.164618] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:46.208830] [INFO ] [MAIN ] AP: Generated 1820 derivative records from 7236 primary records. [2025-09-29T02:10:46.231264] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-29T02:10:46.476416] [DEBUG] [LOCAL ] AP: Derivative data saved (1820 records). [2025-09-29T02:10:46.477300] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-29T02:10:46.480813] [INFO ] [MAIN ] Derivative Progress: 115/2211 symbols completed. AP took 1.3s. Estimated remaining: 15m 3s. Rate: 139.3 symbols/min [2025-09-29T02:10:46.481330] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:46.515967] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:46.517215] [INFO ] [MAIN ] APAM: Generated 1820 derivative records from 36969 primary records. [2025-09-29T02:10:46.517377] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-29T02:10:46.547193] [DEBUG] [LOCAL ] APAM: Derivative data saved (1820 records). [2025-09-29T02:10:46.547458] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-29T02:10:46.551416] [INFO ] [MAIN ] Derivative Progress: 116/2211 symbols completed. APAM took 1.3s. Estimated remaining: 14m 56s. Rate: 140.3 symbols/min [2025-09-29T02:10:46.551687] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:46.586244] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:46.587223] [INFO ] [MAIN ] APD: Generated 1820 derivative records from 46087 primary records. [2025-09-29T02:10:46.587365] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-29T02:10:46.624191] [DEBUG] [LOCAL ] APD: Derivative data saved (1820 records). [2025-09-29T02:10:46.625991] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-29T02:10:46.626154] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-29T02:10:46.626400] [INFO ] [MAIN ] APG: Loaded 50931 primary data records. [2025-09-29T02:10:46.629615] [INFO ] [MAIN ] Derivative Progress: 117/2211 symbols completed. APD took 1.0s. Estimated remaining: 14m 49s. Rate: 141.3 symbols/min [2025-09-29T02:10:46.635077] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:46.825891] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-29T02:10:46.886723] [INFO ] [MAIN ] APH: Loaded 54471 primary data records. [2025-09-29T02:10:47.208038] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-29T02:10:47.267272] [INFO ] [MAIN ] APLE: Loaded 52769 primary data records. [2025-09-29T02:10:47.753037] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:47.754281] [INFO ] [MAIN ] APG: Generated 1820 derivative records from 50931 primary records. [2025-09-29T02:10:47.754671] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-29T02:10:47.790968] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:47.791763] [DEBUG] [LOCAL ] APG: Derivative data saved (1820 records). [2025-09-29T02:10:47.792883] [INFO ] [MAIN ] APH: Generated 1820 derivative records from 54471 primary records. [2025-09-29T02:10:47.794152] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-29T02:10:47.798127] [INFO ] [MAIN ] Derivative Progress: 118/2211 symbols completed. APG took 1.3s. Estimated remaining: 15m 2s. Rate: 139.2 symbols/min [2025-09-29T02:10:47.794409] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-29T02:10:47.817323] [DEBUG] [LOCAL ] APH: Derivative data saved (1820 records). [2025-09-29T02:10:47.817482] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-29T02:10:47.819986] [INFO ] [MAIN ] Derivative Progress: 119/2211 symbols completed. APH took 1.3s. Estimated remaining: 14m 54s. Rate: 140.3 symbols/min [2025-09-29T02:10:47.836511] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:47.837212] [INFO ] [MAIN ] APLE: Generated 1820 derivative records from 52769 primary records. [2025-09-29T02:10:47.837300] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-29T02:10:47.853252] [DEBUG] [LOCAL ] APLE: Derivative data saved (1820 records). [2025-09-29T02:10:47.853356] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-29T02:10:47.856526] [INFO ] [MAIN ] Derivative Progress: 120/2211 symbols completed. APLE took 1.2s. Estimated remaining: 14m 47s. Rate: 141.4 symbols/min [2025-09-29T02:10:47.857145] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:47.857239] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:47.857098] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:47.872584] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-29T02:10:47.872893] [INFO ] [MAIN ] APOS: Loaded 7568 primary data records. [2025-09-29T02:10:48.252151] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-29T02:10:48.252466] [INFO ] [MAIN ] APTV: Loaded 52964 primary data records. [2025-09-29T02:10:48.373270] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-29T02:10:48.386128] [INFO ] [MAIN ] APO: Loaded 54162 primary data records. [2025-09-29T02:10:48.971506] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:48.973362] [INFO ] [MAIN ] APOS: Generated 1820 derivative records from 7568 primary records. [2025-09-29T02:10:48.974170] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-29T02:10:48.996243] [DEBUG] [LOCAL ] APOS: Derivative data saved (1820 records). [2025-09-29T02:10:48.997797] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-29T02:10:49.000697] [INFO ] [MAIN ] Derivative Progress: 121/2211 symbols completed. APOS took 1.1s. Estimated remaining: 14m 59s. Rate: 139.5 symbols/min [2025-09-29T02:10:49.002002] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:49.020915] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:49.022827] [INFO ] [MAIN ] APTV: Generated 1820 derivative records from 52964 primary records. [2025-09-29T02:10:49.023410] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-29T02:10:49.048272] [DEBUG] [LOCAL ] APTV: Derivative data saved (1820 records). [2025-09-29T02:10:49.049949] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-29T02:10:49.052826] [INFO ] [MAIN ] Derivative Progress: 122/2211 symbols completed. APTV took 1.2s. Estimated remaining: 14m 52s. Rate: 140.5 symbols/min [2025-09-29T02:10:49.053392] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:49.067460] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:49.069288] [INFO ] [MAIN ] APO: Generated 1820 derivative records from 54162 primary records. [2025-09-29T02:10:49.069448] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-29T02:10:49.090108] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-29T02:10:49.105084] [INFO ] [MAIN ] AQNB: Loaded 4228 primary data records. [2025-09-29T02:10:49.247853] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-29T02:10:49.248725] [DEBUG] [LOCAL ] APO: Derivative data saved (1820 records). [2025-09-29T02:10:49.265059] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-29T02:10:49.248144] [INFO ] [MAIN ] AQN: Loaded 52684 primary data records. [2025-09-29T02:10:49.273551] [INFO ] [MAIN ] Derivative Progress: 123/2211 symbols completed. APO took 1.4s. Estimated remaining: 14m 48s. Rate: 141.0 symbols/min [2025-09-29T02:10:49.331248] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:49.922894] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-29T02:10:49.921016] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:10:49.924073] [INFO ] [MAIN ] AQNB: Generated 1819 derivative records from 4228 primary records. [2025-09-29T02:10:49.925567] [INFO ] [MAIN ] AR: Loaded 54364 primary data records. [2025-09-29T02:10:49.926157] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-29T02:10:49.970949] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1819 records). [2025-09-29T02:10:49.978570] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-29T02:10:50.012069] [INFO ] [MAIN ] Derivative Progress: 124/2211 symbols completed. AQNB took 1.0s. Estimated remaining: 14m 53s. Rate: 140.2 symbols/min [2025-09-29T02:10:50.026339] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:50.309949] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:50.312103] [INFO ] [MAIN ] AQN: Generated 1820 derivative records from 52684 primary records. [2025-09-29T02:10:50.312319] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-29T02:10:50.343871] [DEBUG] [LOCAL ] AQN: Derivative data saved (1820 records). [2025-09-29T02:10:50.345172] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-29T02:10:50.348409] [INFO ] [MAIN ] Derivative Progress: 125/2211 symbols completed. AQN took 1.3s. Estimated remaining: 14m 51s. Rate: 140.4 symbols/min [2025-09-29T02:10:50.348709] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:50.368379] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-29T02:10:50.376114] [INFO ] [MAIN ] ARCO: Loaded 45249 primary data records. [2025-09-29T02:10:50.443812] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:50.508038] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-29T02:10:50.491201] [INFO ] [MAIN ] AR: Generated 1820 derivative records from 54364 primary records. [2025-09-29T02:10:50.513004] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-29T02:10:50.513094] [INFO ] [MAIN ] ARDC: Loaded 14821 primary data records. [2025-09-29T02:10:50.836357] [DEBUG] [LOCAL ] AR: Derivative data saved (1820 records). [2025-09-29T02:10:50.869782] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-29T02:10:50.879531] [INFO ] [MAIN ] Derivative Progress: 126/2211 symbols completed. AR took 1.5s. Estimated remaining: 14m 53s. Rate: 140.2 symbols/min [2025-09-29T02:10:50.891456] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:51.145117] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:51.146219] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-29T02:10:51.146498] [INFO ] [MAIN ] ARDT: Loaded 28513 primary data records. [2025-09-29T02:10:51.153000] [INFO ] [MAIN ] ARCO: Generated 1820 derivative records from 45249 primary records. [2025-09-29T02:10:51.197347] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-29T02:10:51.297606] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1820 records). [2025-09-29T02:10:51.319026] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:51.308368] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-29T02:10:51.342103] [INFO ] [MAIN ] ARDC: Generated 1820 derivative records from 14821 primary records. [2025-09-29T02:10:51.363730] [INFO ] [MAIN ] Derivative Progress: 127/2211 symbols completed. ARCO took 1.3s. Estimated remaining: 14m 53s. Rate: 140.0 symbols/min [2025-09-29T02:10:51.363881] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-29T02:10:51.390055] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:51.573249] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1820 records). [2025-09-29T02:10:51.573467] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-29T02:10:51.576269] [INFO ] [MAIN ] Derivative Progress: 128/2211 symbols completed. ARDC took 1.2s. Estimated remaining: 14m 49s. Rate: 140.6 symbols/min [2025-09-29T02:10:51.576637] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:51.622137] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:51.623125] [INFO ] [MAIN ] ARDT: Generated 1820 derivative records from 28513 primary records. [2025-09-29T02:10:51.623234] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-29T02:10:51.641821] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1820 records). [2025-09-29T02:10:51.668301] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-29T02:10:51.670241] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-29T02:10:51.670604] [INFO ] [MAIN ] ARE: Loaded 51319 primary data records. [2025-09-29T02:10:51.673362] [INFO ] [MAIN ] Derivative Progress: 129/2211 symbols completed. ARDT took 0.8s. Estimated remaining: 14m 43s. Rate: 141.4 symbols/min [2025-09-29T02:10:51.673852] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:51.817413] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-29T02:10:51.828622] [INFO ] [MAIN ] ARES: Loaded 50322 primary data records. [2025-09-29T02:10:52.226993] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-29T02:10:52.248598] [INFO ] [MAIN ] ARI: Loaded 44009 primary data records. [2025-09-29T02:10:52.770528] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:52.773438] [INFO ] [MAIN ] ARE: Generated 1820 derivative records from 51319 primary records. [2025-09-29T02:10:52.773913] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-29T02:10:52.793448] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:52.794473] [INFO ] [MAIN ] ARES: Generated 1820 derivative records from 50322 primary records. [2025-09-29T02:10:52.804302] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-29T02:10:52.829509] [DEBUG] [LOCAL ] ARES: Derivative data saved (1820 records). [2025-09-29T02:10:52.831114] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-29T02:10:52.833991] [INFO ] [MAIN ] Derivative Progress: 130/2211 symbols completed. ARES took 1.3s. Estimated remaining: 14m 55s. Rate: 139.6 symbols/min [2025-09-29T02:10:52.835624] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:52.836940] [DEBUG] [LOCAL ] ARE: Derivative data saved (1820 records). [2025-09-29T02:10:52.837213] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-29T02:10:52.841964] [INFO ] [MAIN ] Derivative Progress: 131/2211 symbols completed. ARE took 1.5s. Estimated remaining: 14m 48s. Rate: 140.6 symbols/min [2025-09-29T02:10:52.842292] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:52.857450] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:52.858356] [INFO ] [MAIN ] ARI: Generated 1820 derivative records from 44009 primary records. [2025-09-29T02:10:52.858591] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-29T02:10:52.875232] [DEBUG] [LOCAL ] ARI: Derivative data saved (1820 records). [2025-09-29T02:10:52.875481] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-29T02:10:52.879198] [INFO ] [MAIN ] Derivative Progress: 132/2211 symbols completed. ARI took 1.2s. Estimated remaining: 14m 41s. Rate: 141.6 symbols/min [2025-09-29T02:10:52.879582] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:52.943431] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-29T02:10:52.944208] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-29T02:10:52.944739] [INFO ] [MAIN ] ARIS: Loaded 42624 primary data records. [2025-09-29T02:10:52.944671] [INFO ] [MAIN ] ARLO: Loaded 44493 primary data records. [2025-09-29T02:10:53.312155] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-29T02:10:53.353273] [INFO ] [MAIN ] ARMK: Loaded 51112 primary data records. [2025-09-29T02:10:54.078227] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:54.079912] [INFO ] [MAIN ] ARLO: Generated 1820 derivative records from 44493 primary records. [2025-09-29T02:10:54.082059] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-29T02:10:54.103490] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1820 records). [2025-09-29T02:10:54.103871] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-29T02:10:54.122358] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:54.127315] [INFO ] [MAIN ] ARIS: Generated 1820 derivative records from 42624 primary records. [2025-09-29T02:10:54.125207] [INFO ] [MAIN ] Derivative Progress: 133/2211 symbols completed. ARLO took 1.3s. Estimated remaining: 14m 53s. Rate: 139.6 symbols/min [2025-09-29T02:10:54.127786] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-29T02:10:54.150351] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1820 records). [2025-09-29T02:10:54.150537] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-29T02:10:54.153426] [INFO ] [MAIN ] Derivative Progress: 134/2211 symbols completed. ARIS took 1.3s. Estimated remaining: 14m 47s. Rate: 140.5 symbols/min [2025-09-29T02:10:54.166904] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:54.167732] [INFO ] [MAIN ] ARMK: Generated 1820 derivative records from 51112 primary records. [2025-09-29T02:10:54.167849] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-29T02:10:54.184024] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1820 records). [2025-09-29T02:10:54.184139] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-29T02:10:54.187381] [INFO ] [MAIN ] Derivative Progress: 135/2211 symbols completed. ARMK took 1.3s. Estimated remaining: 14m 40s. Rate: 141.5 symbols/min [2025-09-29T02:10:54.187988] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:54.188089] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:54.188162] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:54.260630] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-29T02:10:54.261190] [INFO ] [MAIN ] ARW: Loaded 33660 primary data records. [2025-09-29T02:10:54.427681] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-29T02:10:54.415615] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-29T02:10:54.433058] [INFO ] [MAIN ] AROC: Loaded 49733 primary data records. [2025-09-29T02:10:54.438480] [INFO ] [MAIN ] ARR: Loaded 52809 primary data records. [2025-09-29T02:10:55.342218] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:55.344526] [INFO ] [MAIN ] ARW: Generated 1820 derivative records from 33660 primary records. [2025-09-29T02:10:55.344782] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-29T02:10:55.367193] [DEBUG] [LOCAL ] ARW: Derivative data saved (1820 records). [2025-09-29T02:10:55.370417] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-29T02:10:55.373138] [INFO ] [MAIN ] Derivative Progress: 136/2211 symbols completed. ARW took 1.2s. Estimated remaining: 14m 51s. Rate: 139.7 symbols/min [2025-09-29T02:10:55.373549] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:55.390129] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:55.391935] [INFO ] [MAIN ] AROC: Generated 1820 derivative records from 49733 primary records. [2025-09-29T02:10:55.400065] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-29T02:10:55.405725] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:55.407229] [INFO ] [MAIN ] ARR: Generated 1820 derivative records from 52809 primary records. [2025-09-29T02:10:55.414759] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-29T02:10:55.431551] [DEBUG] [LOCAL ] AROC: Derivative data saved (1820 records). [2025-09-29T02:10:55.435147] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-29T02:10:55.441060] [INFO ] [MAIN ] Derivative Progress: 137/2211 symbols completed. AROC took 1.3s. Estimated remaining: 14m 46s. Rate: 140.5 symbols/min [2025-09-29T02:10:55.442555] [DEBUG] [LOCAL ] ARR: Derivative data saved (1820 records). [2025-09-29T02:10:55.442750] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:55.443098] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-29T02:10:55.446576] [INFO ] [MAIN ] Derivative Progress: 138/2211 symbols completed. ARR took 1.3s. Estimated remaining: 14m 39s. Rate: 141.5 symbols/min [2025-09-29T02:10:55.447746] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:55.502214] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-29T02:10:55.502494] [INFO ] [MAIN ] ASA: Loaded 14109 primary data records. [2025-09-29T02:10:55.503684] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-29T02:10:55.509398] [INFO ] [MAIN ] AS: Loaded 53854 primary data records. [2025-09-29T02:10:55.887482] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-29T02:10:55.965281] [INFO ] [MAIN ] ASAN: Loaded 53512 primary data records. [2025-09-29T02:10:56.713481] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:56.715256] [INFO ] [MAIN ] ASA: Generated 1820 derivative records from 14109 primary records. [2025-09-29T02:10:56.713241] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:56.716502] [INFO ] [MAIN ] AS: Generated 1820 derivative records from 53854 primary records. [2025-09-29T02:10:56.722558] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-29T02:10:56.722712] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-29T02:10:56.757109] [DEBUG] [LOCAL ] AS: Derivative data saved (1820 records). [2025-09-29T02:10:56.760255] [DEBUG] [LOCAL ] ASA: Derivative data saved (1820 records). [2025-09-29T02:10:56.760559] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-29T02:10:56.764251] [INFO ] [MAIN ] Derivative Progress: 139/2211 symbols completed. AS took 1.4s. Estimated remaining: 14m 52s. Rate: 139.4 symbols/min [2025-09-29T02:10:56.760634] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-29T02:10:56.764936] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:56.767856] [INFO ] [MAIN ] Derivative Progress: 140/2211 symbols completed. ASA took 1.3s. Estimated remaining: 14m 45s. Rate: 140.4 symbols/min [2025-09-29T02:10:56.768201] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:56.789569] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-29T02:10:56.790342] [INFO ] [MAIN ] ASBA: Loaded 3458 primary data records. [2025-09-29T02:10:56.790222] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:56.808182] [INFO ] [MAIN ] ASAN: Generated 1820 derivative records from 53512 primary records. [2025-09-29T02:10:56.829518] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-29T02:10:57.027704] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1820 records). [2025-09-29T02:10:57.154589] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-29T02:10:57.159242] [INFO ] [MAIN ] Derivative Progress: 141/2211 symbols completed. ASAN took 1.7s. Estimated remaining: 14m 44s. Rate: 140.5 symbols/min [2025-09-29T02:10:57.174750] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:57.176309] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-29T02:10:57.177018] [INFO ] [MAIN ] ASB: Loaded 50299 primary data records. [2025-09-29T02:10:57.540439] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-29T02:10:57.542069] [INFO ] [MAIN ] ASC: Loaded 38153 primary data records. [2025-09-29T02:10:57.606777] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:57.625453] [INFO ] [MAIN ] ASBA: Generated 1820 derivative records from 3458 primary records. [2025-09-29T02:10:57.664365] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-29T02:10:57.750160] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1820 records). [2025-09-29T02:10:57.777901] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-29T02:10:57.787747] [INFO ] [MAIN ] Derivative Progress: 142/2211 symbols completed. ASBA took 1.0s. Estimated remaining: 14m 47s. Rate: 140.0 symbols/min [2025-09-29T02:10:57.910883] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:57.931961] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:57.934132] [INFO ] [MAIN ] ASB: Generated 1820 derivative records from 50299 primary records. [2025-09-29T02:10:57.934415] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-29T02:10:57.958868] [DEBUG] [LOCAL ] ASB: Derivative data saved (1820 records). [2025-09-29T02:10:57.959265] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-29T02:10:57.961833] [INFO ] [MAIN ] Derivative Progress: 143/2211 symbols completed. ASB took 1.2s. Estimated remaining: 14m 42s. Rate: 140.6 symbols/min [2025-09-29T02:10:57.962247] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:57.972983] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-29T02:10:57.973388] [INFO ] [MAIN ] ASG: Loaded 20695 primary data records. [2025-09-29T02:10:58.124822] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:58.179841] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-29T02:10:58.209933] [INFO ] [MAIN ] ASGI: Loaded 22711 primary data records. [2025-09-29T02:10:58.227695] [INFO ] [MAIN ] ASC: Generated 1820 derivative records from 38153 primary records. [2025-09-29T02:10:58.259352] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-29T02:10:58.490989] [DEBUG] [LOCAL ] ASC: Derivative data saved (1820 records). [2025-09-29T02:10:58.514942] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-29T02:10:58.517798] [INFO ] [MAIN ] Derivative Progress: 144/2211 symbols completed. ASC took 1.3s. Estimated remaining: 14m 44s. Rate: 140.3 symbols/min [2025-09-29T02:10:58.528747] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:58.773104] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:58.774324] [INFO ] [MAIN ] ASG: Generated 1820 derivative records from 20695 primary records. [2025-09-29T02:10:58.776257] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-29T02:10:58.812472] [DEBUG] [LOCAL ] ASG: Derivative data saved (1820 records). [2025-09-29T02:10:58.805388] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-29T02:10:58.812682] [INFO ] [MAIN ] ASGN: Loaded 36554 primary data records. [2025-09-29T02:10:58.812879] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-29T02:10:58.815552] [INFO ] [MAIN ] Derivative Progress: 145/2211 symbols completed. ASG took 0.9s. Estimated remaining: 14m 42s. Rate: 140.6 symbols/min [2025-09-29T02:10:58.815890] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:58.877987] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:58.901942] [INFO ] [MAIN ] ASGI: Generated 1820 derivative records from 22711 primary records. [2025-09-29T02:10:58.941839] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-29T02:10:59.198248] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1820 records). [2025-09-29T02:10:59.199125] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-29T02:10:59.202349] [INFO ] [MAIN ] Derivative Progress: 146/2211 symbols completed. ASGI took 1.2s. Estimated remaining: 14m 41s. Rate: 140.7 symbols/min [2025-09-29T02:10:59.204543] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:59.222551] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-29T02:10:59.224001] [INFO ] [MAIN ] ASH: Loaded 38339 primary data records. [2025-09-29T02:10:59.410634] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-29T02:10:59.446054] [INFO ] [MAIN ] ASIX: Loaded 22834 primary data records. [2025-09-29T02:10:59.725786] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:59.738145] [INFO ] [MAIN ] ASGN: Generated 1820 derivative records from 36554 primary records. [2025-09-29T02:10:59.759874] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-29T02:10:59.948620] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1820 records). [2025-09-29T02:10:59.952150] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-29T02:10:59.955402] [INFO ] [MAIN ] Derivative Progress: 147/2211 symbols completed. ASGN took 1.4s. Estimated remaining: 14m 45s. Rate: 140.0 symbols/min [2025-09-29T02:10:59.956234] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:59.969865] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:59.972697] [INFO ] [MAIN ] ASH: Generated 1820 derivative records from 38339 primary records. [2025-09-29T02:10:59.972912] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-29T02:10:59.991139] [DEBUG] [LOCAL ] ASH: Derivative data saved (1820 records). [2025-09-29T02:10:59.991287] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-29T02:10:59.994234] [INFO ] [MAIN ] Derivative Progress: 148/2211 symbols completed. ASH took 1.2s. Estimated remaining: 14m 39s. Rate: 140.8 symbols/min [2025-09-29T02:11:00.011865] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:00.012623] [INFO ] [MAIN ] ASIX: Generated 1820 derivative records from 22834 primary records. [2025-09-29T02:11:00.012780] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-29T02:11:00.029965] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1820 records). [2025-09-29T02:11:00.040891] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-29T02:11:00.043904] [INFO ] [MAIN ] Derivative Progress: 149/2211 symbols completed. ASIX took 0.8s. Estimated remaining: 14m 33s. Rate: 141.7 symbols/min [2025-09-29T02:11:00.069296] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-29T02:11:00.069478] [INFO ] [MAIN ] ASPN: Loaded 50293 primary data records. [2025-09-29T02:11:00.439146] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:00.439901] [INFO ] [MAIN ] ASPN: Generated 1820 derivative records from 50293 primary records. [2025-09-29T02:11:00.440020] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-29T02:11:00.455599] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1820 records). [2025-09-29T02:11:00.455742] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-29T02:11:00.458427] [INFO ] [MAIN ] Derivative Progress: 150/2211 symbols completed. ASPN took 0.5s. Estimated remaining: 14m 33s. Rate: 141.7 symbols/min [2025-09-29T02:11:00.459358] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:00.459539] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:00.459207] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:00.475524] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-29T02:11:00.476010] [INFO ] [MAIN ] ASR: Loaded 9381 primary data records. [2025-09-29T02:11:00.848970] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-29T02:11:00.865058] [INFO ] [MAIN ] ATEN: Loaded 40398 primary data records. [2025-09-29T02:11:00.866269] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-29T02:11:00.867692] [INFO ] [MAIN ] ASX: Loaded 53639 primary data records. [2025-09-29T02:11:01.555429] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:01.557021] [INFO ] [MAIN ] ASR: Generated 1820 derivative records from 9381 primary records. [2025-09-29T02:11:01.557590] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-29T02:11:01.579267] [DEBUG] [LOCAL ] ASR: Derivative data saved (1820 records). [2025-09-29T02:11:01.579892] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-29T02:11:01.583053] [INFO ] [MAIN ] Derivative Progress: 151/2211 symbols completed. ASR took 1.1s. Estimated remaining: 14m 42s. Rate: 140.2 symbols/min [2025-09-29T02:11:01.583875] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:01.606989] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:01.608905] [INFO ] [MAIN ] ASX: Generated 1820 derivative records from 53639 primary records. [2025-09-29T02:11:01.609218] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-29T02:11:01.624552] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:01.651524] [INFO ] [MAIN ] ATEN: Generated 1820 derivative records from 40398 primary records. [2025-09-29T02:11:01.653158] [DEBUG] [LOCAL ] ASX: Derivative data saved (1820 records). [2025-09-29T02:11:01.653482] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-29T02:11:01.653555] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-29T02:11:01.655931] [INFO ] [MAIN ] Derivative Progress: 152/2211 symbols completed. ASX took 1.2s. Estimated remaining: 14m 37s. Rate: 140.9 symbols/min [2025-09-29T02:11:01.656190] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:01.688318] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-29T02:11:01.691308] [INFO ] [MAIN ] ATGE: Loaded 32251 primary data records. [2025-09-29T02:11:01.690937] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1820 records). [2025-09-29T02:11:01.696997] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-29T02:11:01.708377] [INFO ] [MAIN ] Derivative Progress: 153/2211 symbols completed. ATEN took 1.2s. Estimated remaining: 14m 31s. Rate: 141.7 symbols/min [2025-09-29T02:11:01.758087] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:01.869559] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-29T02:11:01.898822] [INFO ] [MAIN ] ATHM: Loaded 33015 primary data records. [2025-09-29T02:11:01.999999] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-29T02:11:02.152180] [INFO ] [MAIN ] ATHS: Loaded 7145 primary data records. [2025-09-29T02:11:02.829474] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:02.830543] [INFO ] [MAIN ] ATGE: Generated 1820 derivative records from 32251 primary records. [2025-09-29T02:11:02.831964] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-29T02:11:02.851921] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1820 records). [2025-09-29T02:11:02.852361] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-29T02:11:02.868142] [INFO ] [MAIN ] Derivative Progress: 154/2211 symbols completed. ATGE took 1.3s. Estimated remaining: 14m 41s. Rate: 140.2 symbols/min [2025-09-29T02:11:02.869039] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:02.869333] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:02.870105] [INFO ] [MAIN ] ATHM: Generated 1820 derivative records from 33015 primary records. [2025-09-29T02:11:02.870885] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-29T02:11:02.891328] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1820 records). [2025-09-29T02:11:02.891680] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-29T02:11:02.894023] [INFO ] [MAIN ] Derivative Progress: 155/2211 symbols completed. ATHM took 1.2s. Estimated remaining: 14m 35s. Rate: 141.0 symbols/min [2025-09-29T02:11:02.907735] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:02.908597] [INFO ] [MAIN ] ATHS: Generated 1820 derivative records from 7145 primary records. [2025-09-29T02:11:02.907207] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:02.908752] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-29T02:11:02.927347] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1820 records). [2025-09-29T02:11:02.927567] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-29T02:11:02.930633] [INFO ] [MAIN ] Derivative Progress: 156/2211 symbols completed. ATHS took 1.2s. Estimated remaining: 14m 29s. Rate: 141.8 symbols/min [2025-09-29T02:11:02.930974] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:02.983482] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-29T02:11:02.984483] [INFO ] [MAIN ] ATI: Loaded 52283 primary data records. [2025-09-29T02:11:03.104194] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-29T02:11:03.126427] [INFO ] [MAIN ] ATKR: Loaded 36196 primary data records. [2025-09-29T02:11:03.314750] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-29T02:11:03.448783] [INFO ] [MAIN ] ATMU: Loaded 40274 primary data records. [2025-09-29T02:11:04.086240] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:04.087825] [INFO ] [MAIN ] ATI: Generated 1820 derivative records from 52283 primary records. [2025-09-29T02:11:04.088748] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-29T02:11:04.128688] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:04.127987] [DEBUG] [LOCAL ] ATI: Derivative data saved (1820 records). [2025-09-29T02:11:04.129952] [INFO ] [MAIN ] ATKR: Generated 1820 derivative records from 36196 primary records. [2025-09-29T02:11:04.130298] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-29T02:11:04.130034] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-29T02:11:04.135003] [INFO ] [MAIN ] Derivative Progress: 157/2211 symbols completed. ATI took 1.3s. Estimated remaining: 14m 39s. Rate: 140.2 symbols/min [2025-09-29T02:11:04.135818] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:04.155197] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1820 records). [2025-09-29T02:11:04.156363] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-29T02:11:04.159316] [INFO ] [MAIN ] Derivative Progress: 158/2211 symbols completed. ATKR took 1.3s. Estimated remaining: 14m 33s. Rate: 141.0 symbols/min [2025-09-29T02:11:04.159601] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:04.174953] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:04.175884] [INFO ] [MAIN ] ATMU: Generated 1820 derivative records from 40274 primary records. [2025-09-29T02:11:04.176019] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-29T02:11:04.196026] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1820 records). [2025-09-29T02:11:04.196195] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-29T02:11:04.199419] [INFO ] [MAIN ] Derivative Progress: 159/2211 symbols completed. ATMU took 1.3s. Estimated remaining: 14m 28s. Rate: 141.8 symbols/min [2025-09-29T02:11:04.199769] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:04.242256] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-29T02:11:04.247861] [INFO ] [MAIN ] ATO: Loaded 42489 primary data records. [2025-09-29T02:11:04.263260] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-29T02:11:04.276524] [INFO ] [MAIN ] ATR: Loaded 30839 primary data records. [2025-09-29T02:11:04.343785] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-29T02:11:04.396413] [INFO ] [MAIN ] ATS: Loaded 18145 primary data records. [2025-09-29T02:11:05.403086] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:05.417683] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:05.418787] [INFO ] [MAIN ] ATO: Generated 1820 derivative records from 42489 primary records. [2025-09-29T02:11:05.419908] [INFO ] [MAIN ] ATR: Generated 1820 derivative records from 30839 primary records. [2025-09-29T02:11:05.419997] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-29T02:11:05.420330] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-29T02:11:05.462863] [DEBUG] [LOCAL ] ATO: Derivative data saved (1820 records). [2025-09-29T02:11:05.468705] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-29T02:11:05.471510] [INFO ] [MAIN ] Derivative Progress: 160/2211 symbols completed. ATO took 1.3s. Estimated remaining: 14m 38s. Rate: 140.1 symbols/min [2025-09-29T02:11:05.472036] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:05.474365] [INFO ] [MAIN ] ATS: Generated 1820 derivative records from 18145 primary records. [2025-09-29T02:11:05.475031] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-29T02:11:05.474581] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:05.478485] [DEBUG] [LOCAL ] ATR: Derivative data saved (1820 records). [2025-09-29T02:11:05.479022] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-29T02:11:05.494188] [INFO ] [MAIN ] Derivative Progress: 161/2211 symbols completed. ATR took 1.3s. Estimated remaining: 14m 33s. Rate: 140.9 symbols/min [2025-09-29T02:11:05.497509] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:05.498917] [DEBUG] [LOCAL ] ATS: Derivative data saved (1820 records). [2025-09-29T02:11:05.499451] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-29T02:11:05.502346] [INFO ] [MAIN ] Derivative Progress: 162/2211 symbols completed. ATS took 1.3s. Estimated remaining: 14m 27s. Rate: 141.8 symbols/min [2025-09-29T02:11:05.502742] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:05.570181] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-29T02:11:05.570506] [INFO ] [MAIN ] ATUS: Loaded 49958 primary data records. [2025-09-29T02:11:05.689994] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-29T02:11:05.730202] [INFO ] [MAIN ] AUB: Loaded 47072 primary data records. [2025-09-29T02:11:05.750686] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-29T02:11:05.834081] [INFO ] [MAIN ] AU: Loaded 53715 primary data records. [2025-09-29T02:11:06.660313] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:06.662709] [INFO ] [MAIN ] ATUS: Generated 1820 derivative records from 49958 primary records. [2025-09-29T02:11:06.663177] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-29T02:11:06.684795] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1820 records). [2025-09-29T02:11:06.685344] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-29T02:11:06.694502] [INFO ] [MAIN ] Derivative Progress: 163/2211 symbols completed. ATUS took 1.2s. Estimated remaining: 14m 36s. Rate: 140.2 symbols/min [2025-09-29T02:11:06.711828] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:06.712844] [INFO ] [MAIN ] AUB: Generated 1820 derivative records from 47072 primary records. [2025-09-29T02:11:06.713112] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-29T02:11:06.730367] [DEBUG] [LOCAL ] AUB: Derivative data saved (1820 records). [2025-09-29T02:11:06.731418] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-29T02:11:06.735919] [INFO ] [MAIN ] Derivative Progress: 164/2211 symbols completed. AUB took 1.2s. Estimated remaining: 14m 31s. Rate: 141.0 symbols/min [2025-09-29T02:11:06.750418] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:06.751101] [INFO ] [MAIN ] AU: Generated 1820 derivative records from 53715 primary records. [2025-09-29T02:11:06.751187] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-29T02:11:06.766914] [DEBUG] [LOCAL ] AU: Derivative data saved (1820 records). [2025-09-29T02:11:06.767009] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-29T02:11:06.771058] [INFO ] [MAIN ] Derivative Progress: 165/2211 symbols completed. AU took 1.3s. Estimated remaining: 14m 26s. Rate: 141.8 symbols/min [2025-09-29T02:11:06.771749] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:06.771610] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:06.771824] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:06.782344] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-29T02:11:06.782712] [INFO ] [MAIN ] AUNA: Loaded 4966 primary data records. [2025-09-29T02:11:06.855999] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-29T02:11:06.873336] [INFO ] [MAIN ] AVAL: Loaded 9040 primary data records. [2025-09-29T02:11:07.364797] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-29T02:11:07.389214] [INFO ] [MAIN ] AVA: Loaded 40183 primary data records. [2025-09-29T02:11:07.886183] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:07.888419] [INFO ] [MAIN ] AUNA: Generated 1820 derivative records from 4966 primary records. [2025-09-29T02:11:07.888821] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-29T02:11:07.910107] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1820 records). [2025-09-29T02:11:07.910461] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-29T02:11:07.921437] [INFO ] [MAIN ] Derivative Progress: 166/2211 symbols completed. AUNA took 1.1s. Estimated remaining: 14m 34s. Rate: 140.3 symbols/min [2025-09-29T02:11:07.927080] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:07.927225] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:07.928290] [INFO ] [MAIN ] AVAL: Generated 1820 derivative records from 9040 primary records. [2025-09-29T02:11:07.928394] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-29T02:11:07.945285] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1820 records). [2025-09-29T02:11:07.945854] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-29T02:11:07.948664] [INFO ] [MAIN ] Derivative Progress: 167/2211 symbols completed. AVAL took 1.2s. Estimated remaining: 14m 29s. Rate: 141.1 symbols/min [2025-09-29T02:11:07.949126] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:07.967461] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:07.968345] [INFO ] [MAIN ] AVA: Generated 1820 derivative records from 40183 primary records. [2025-09-29T02:11:07.968553] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-29T02:11:08.002281] [DEBUG] [LOCAL ] AVA: Derivative data saved (1820 records). [2025-09-29T02:11:08.002680] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-29T02:11:08.005859] [INFO ] [MAIN ] Derivative Progress: 168/2211 symbols completed. AVA took 1.2s. Estimated remaining: 14m 24s. Rate: 141.8 symbols/min [2025-09-29T02:11:08.006287] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:08.031081] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-29T02:11:08.032130] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-29T02:11:08.031294] [INFO ] [MAIN ] AVD: Loaded 23030 primary data records. [2025-09-29T02:11:08.032303] [INFO ] [MAIN ] AVB: Loaded 42457 primary data records. [2025-09-29T02:11:08.260243] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-29T02:11:08.299400] [INFO ] [MAIN ] AVK: Loaded 18064 primary data records. [2025-09-29T02:11:09.311952] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:09.314562] [INFO ] [MAIN ] AVB: Generated 1820 derivative records from 42457 primary records. [2025-09-29T02:11:09.333327] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:09.338350] [INFO ] [MAIN ] AVD: Generated 1820 derivative records from 23030 primary records. [2025-09-29T02:11:09.333065] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-29T02:11:09.338757] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-29T02:11:09.396298] [DEBUG] [LOCAL ] AVD: Derivative data saved (1820 records). [2025-09-29T02:11:09.396528] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-29T02:11:09.400814] [INFO ] [MAIN ] Derivative Progress: 169/2211 symbols completed. AVD took 1.5s. Estimated remaining: 14m 35s. Rate: 139.9 symbols/min [2025-09-29T02:11:09.393987] [DEBUG] [LOCAL ] AVB: Derivative data saved (1820 records). [2025-09-29T02:11:09.402995] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-29T02:11:09.403182] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:09.407017] [INFO ] [MAIN ] Derivative Progress: 170/2211 symbols completed. AVB took 1.5s. Estimated remaining: 14m 30s. Rate: 140.8 symbols/min [2025-09-29T02:11:09.410697] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:09.435072] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:09.436366] [INFO ] [MAIN ] AVK: Generated 1820 derivative records from 18064 primary records. [2025-09-29T02:11:09.436507] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-29T02:11:09.468055] [DEBUG] [LOCAL ] AVK: Derivative data saved (1820 records). [2025-09-29T02:11:09.468594] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-29T02:11:09.471769] [INFO ] [MAIN ] Derivative Progress: 171/2211 symbols completed. AVK took 1.5s. Estimated remaining: 14m 25s. Rate: 141.5 symbols/min [2025-09-29T02:11:09.472390] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:09.519970] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-29T02:11:09.520329] [INFO ] [MAIN ] AVNS: Loaded 34132 primary data records. [2025-09-29T02:11:09.651177] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-29T02:11:09.679521] [INFO ] [MAIN ] AVNT: Loaded 39887 primary data records. [2025-09-29T02:11:09.942725] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-29T02:11:10.114909] [INFO ] [MAIN ] AVTR: Loaded 54345 primary data records. [2025-09-29T02:11:10.713129] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:10.715251] [INFO ] [MAIN ] AVNS: Generated 1820 derivative records from 34132 primary records. [2025-09-29T02:11:10.716118] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-29T02:11:10.739587] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1820 records). [2025-09-29T02:11:10.740131] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-29T02:11:10.751309] [INFO ] [MAIN ] Derivative Progress: 172/2211 symbols completed. AVNS took 1.3s. Estimated remaining: 14m 35s. Rate: 139.8 symbols/min [2025-09-29T02:11:10.757254] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:10.757529] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:10.758801] [INFO ] [MAIN ] AVNT: Generated 1820 derivative records from 39887 primary records. [2025-09-29T02:11:10.759616] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-29T02:11:10.801830] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:10.803720] [INFO ] [MAIN ] AVTR: Generated 1820 derivative records from 54345 primary records. [2025-09-29T02:11:10.805061] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-29T02:11:10.804854] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1820 records). [2025-09-29T02:11:10.805666] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-29T02:11:10.809164] [INFO ] [MAIN ] Derivative Progress: 173/2211 symbols completed. AVNT took 1.4s. Estimated remaining: 14m 30s. Rate: 140.5 symbols/min [2025-09-29T02:11:10.809730] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:10.838228] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1820 records). [2025-09-29T02:11:10.838528] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-29T02:11:10.842011] [INFO ] [MAIN ] Derivative Progress: 174/2211 symbols completed. AVTR took 1.4s. Estimated remaining: 14m 25s. Rate: 141.3 symbols/min [2025-09-29T02:11:10.842325] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:10.873007] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-29T02:11:10.874497] [INFO ] [MAIN ] AWF: Loaded 24608 primary data records. [2025-09-29T02:11:10.874310] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-29T02:11:10.886762] [INFO ] [MAIN ] AVY: Loaded 38102 primary data records. [2025-09-29T02:11:11.138186] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-29T02:11:11.236516] [INFO ] [MAIN ] AWI: Loaded 26185 primary data records. [2025-09-29T02:11:11.979346] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:11.981214] [INFO ] [MAIN ] AWF: Generated 1820 derivative records from 24608 primary records. [2025-09-29T02:11:11.981744] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-29T02:11:12.015546] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:12.017818] [INFO ] [MAIN ] AVY: Generated 1820 derivative records from 38102 primary records. [2025-09-29T02:11:12.018224] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-29T02:11:12.028375] [DEBUG] [LOCAL ] AWF: Derivative data saved (1820 records). [2025-09-29T02:11:12.034513] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-29T02:11:12.038126] [INFO ] [MAIN ] Derivative Progress: 175/2211 symbols completed. AWF took 1.2s. Estimated remaining: 14m 34s. Rate: 139.8 symbols/min [2025-09-29T02:11:12.038366] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:12.041187] [DEBUG] [LOCAL ] AVY: Derivative data saved (1820 records). [2025-09-29T02:11:12.041558] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-29T02:11:12.044806] [INFO ] [MAIN ] Derivative Progress: 176/2211 symbols completed. AVY took 1.3s. Estimated remaining: 14m 28s. Rate: 140.6 symbols/min [2025-09-29T02:11:12.045512] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:12.064238] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:12.065269] [INFO ] [MAIN ] AWI: Generated 1820 derivative records from 26185 primary records. [2025-09-29T02:11:12.065517] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-29T02:11:12.089430] [DEBUG] [LOCAL ] AWI: Derivative data saved (1820 records). [2025-09-29T02:11:12.089676] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-29T02:11:12.092614] [INFO ] [MAIN ] Derivative Progress: 177/2211 symbols completed. AWI took 1.3s. Estimated remaining: 14m 24s. Rate: 141.3 symbols/min [2025-09-29T02:11:12.100335] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:12.102360] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-29T02:11:12.102911] [INFO ] [MAIN ] AWP: Loaded 21835 primary data records. [2025-09-29T02:11:12.319441] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-29T02:11:12.320924] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-29T02:11:12.348971] [INFO ] [MAIN ] AWK: Loaded 49489 primary data records. [2025-09-29T02:11:12.349127] [INFO ] [MAIN ] AWR: Loaded 22993 primary data records. [2025-09-29T02:11:13.200785] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:13.203345] [INFO ] [MAIN ] AWP: Generated 1820 derivative records from 21835 primary records. [2025-09-29T02:11:13.203742] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-29T02:11:13.227777] [DEBUG] [LOCAL ] AWP: Derivative data saved (1820 records). [2025-09-29T02:11:13.229393] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-29T02:11:13.232294] [INFO ] [MAIN ] Derivative Progress: 178/2211 symbols completed. AWP took 1.2s. Estimated remaining: 14m 31s. Rate: 140.0 symbols/min [2025-09-29T02:11:13.247757] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:13.248837] [INFO ] [MAIN ] AWK: Generated 1820 derivative records from 49489 primary records. [2025-09-29T02:11:13.250806] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-29T02:11:13.279463] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:13.281585] [INFO ] [MAIN ] AWR: Generated 1820 derivative records from 22993 primary records. [2025-09-29T02:11:13.282713] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-29T02:11:13.284135] [DEBUG] [LOCAL ] AWK: Derivative data saved (1820 records). [2025-09-29T02:11:13.285354] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-29T02:11:13.288707] [INFO ] [MAIN ] Derivative Progress: 179/2211 symbols completed. AWK took 1.3s. Estimated remaining: 14m 27s. Rate: 140.7 symbols/min [2025-09-29T02:11:13.304665] [DEBUG] [LOCAL ] AWR: Derivative data saved (1820 records). [2025-09-29T02:11:13.304813] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-29T02:11:13.307981] [INFO ] [MAIN ] Derivative Progress: 180/2211 symbols completed. AWR took 1.2s. Estimated remaining: 14m 22s. Rate: 141.4 symbols/min [2025-09-29T02:11:13.308483] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:13.308688] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:13.308849] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:13.362484] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-29T02:11:13.362753] [INFO ] [MAIN ] AX: Loaded 28929 primary data records. [2025-09-29T02:11:13.493937] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-29T02:11:13.508125] [INFO ] [MAIN ] AXL: Loaded 51239 primary data records. [2025-09-29T02:11:13.858611] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-29T02:11:13.885092] [INFO ] [MAIN ] AXP: Loaded 53999 primary data records. [2025-09-29T02:11:14.485571] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:14.488678] [INFO ] [MAIN ] AX: Generated 1820 derivative records from 28929 primary records. [2025-09-29T02:11:14.490192] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-29T02:11:14.515195] [DEBUG] [LOCAL ] AX: Derivative data saved (1820 records). [2025-09-29T02:11:14.515482] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-29T02:11:14.518886] [INFO ] [MAIN ] Derivative Progress: 181/2211 symbols completed. AX took 1.2s. Estimated remaining: 14m 30s. Rate: 140.0 symbols/min [2025-09-29T02:11:14.527701] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:14.535565] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:14.538016] [INFO ] [MAIN ] AXL: Generated 1820 derivative records from 51239 primary records. [2025-09-29T02:11:14.539825] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-29T02:11:14.544098] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-29T02:11:14.544548] [INFO ] [MAIN ] AXR: Loaded 3220 primary data records. [2025-09-29T02:11:14.615764] [DEBUG] [LOCAL ] AXL: Derivative data saved (1820 records). [2025-09-29T02:11:14.649800] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-29T02:11:14.659187] [INFO ] [MAIN ] Derivative Progress: 182/2211 symbols completed. AXL took 1.4s. Estimated remaining: 14m 26s. Rate: 140.5 symbols/min [2025-09-29T02:11:14.659505] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:14.650270] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:14.689733] [INFO ] [MAIN ] AXP: Generated 1820 derivative records from 53999 primary records. [2025-09-29T02:11:14.703673] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-29T02:11:14.924384] [DEBUG] [LOCAL ] AXP: Derivative data saved (1820 records). [2025-09-29T02:11:14.936124] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-29T02:11:14.939788] [INFO ] [MAIN ] Derivative Progress: 183/2211 symbols completed. AXP took 1.6s. Estimated remaining: 14m 24s. Rate: 140.8 symbols/min [2025-09-29T02:11:14.940384] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:14.977336] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-29T02:11:14.978314] [INFO ] [MAIN ] AXS: Loaded 38920 primary data records. [2025-09-29T02:11:15.220610] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:11:15.357439] [INFO ] [MAIN ] AXR: Generated 1818 derivative records from 3220 primary records. [2025-09-29T02:11:15.367946] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-29T02:11:15.369389] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-29T02:11:15.369905] [INFO ] [MAIN ] AXTA: Loaded 52835 primary data records. [2025-09-29T02:11:15.475006] [DEBUG] [LOCAL ] AXR: Derivative data saved (1818 records). [2025-09-29T02:11:15.499059] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-29T02:11:15.501940] [INFO ] [MAIN ] Derivative Progress: 184/2211 symbols completed. AXR took 1.0s. Estimated remaining: 14m 25s. Rate: 140.5 symbols/min [2025-09-29T02:11:15.508059] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:15.746527] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:15.747529] [INFO ] [MAIN ] AXS: Generated 1820 derivative records from 38920 primary records. [2025-09-29T02:11:15.749261] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-29T02:11:15.760990] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-29T02:11:15.772344] [INFO ] [MAIN ] AYI: Loaded 25446 primary data records. [2025-09-29T02:11:15.799255] [DEBUG] [LOCAL ] AXS: Derivative data saved (1820 records). [2025-09-29T02:11:15.824834] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-29T02:11:15.849477] [INFO ] [MAIN ] Derivative Progress: 185/2211 symbols completed. AXS took 1.2s. Estimated remaining: 14m 24s. Rate: 140.7 symbols/min [2025-09-29T02:11:15.880928] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:16.154212] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-29T02:11:16.162508] [INFO ] [MAIN ] AZO: Loaded 11687 primary data records. [2025-09-29T02:11:16.194094] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:16.220012] [INFO ] [MAIN ] AXTA: Generated 1820 derivative records from 52835 primary records. [2025-09-29T02:11:16.220442] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-29T02:11:16.323574] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1820 records). [2025-09-29T02:11:16.355902] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-29T02:11:16.371848] [INFO ] [MAIN ] Derivative Progress: 186/2211 symbols completed. AXTA took 1.4s. Estimated remaining: 14m 25s. Rate: 140.5 symbols/min [2025-09-29T02:11:16.442310] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:16.564145] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:11:16.565625] [INFO ] [MAIN ] AYI: Generated 1819 derivative records from 25446 primary records. [2025-09-29T02:11:16.565773] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-29T02:11:16.599372] [DEBUG] [LOCAL ] AYI: Derivative data saved (1819 records). [2025-09-29T02:11:16.600638] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-29T02:11:16.601244] [INFO ] [MAIN ] AZZ: Loaded 22359 primary data records. [2025-09-29T02:11:16.601516] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-29T02:11:16.632573] [INFO ] [MAIN ] Derivative Progress: 187/2211 symbols completed. AYI took 1.1s. Estimated remaining: 14m 23s. Rate: 140.8 symbols/min [2025-09-29T02:11:16.646564] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:16.770352] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:16.834141] [INFO ] [MAIN ] AZO: Generated 1820 derivative records from 11687 primary records. [2025-09-29T02:11:16.973594] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-29T02:11:17.010379] [DEBUG] [LOCAL ] AZO: Derivative data saved (1820 records). [2025-09-29T02:11:17.011369] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-29T02:11:17.014105] [INFO ] [MAIN ] Derivative Progress: 188/2211 symbols completed. AZO took 1.1s. Estimated remaining: 14m 22s. Rate: 140.9 symbols/min [2025-09-29T02:11:17.014425] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:17.038133] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-29T02:11:17.038949] [INFO ] [MAIN ] BA: Loaded 54571 primary data records. [2025-09-29T02:11:17.400741] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:17.432124] [INFO ] [MAIN ] AZZ: Generated 1820 derivative records from 22359 primary records. [2025-09-29T02:11:17.434914] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-29T02:11:17.436134] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-29T02:11:17.437927] [INFO ] [MAIN ] BABA: Loaded 54600 primary data records. [2025-09-29T02:11:17.541391] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1820 records). [2025-09-29T02:11:17.550981] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-29T02:11:17.587043] [INFO ] [MAIN ] Derivative Progress: 189/2211 symbols completed. AZZ took 1.1s. Estimated remaining: 14m 23s. Rate: 140.6 symbols/min [2025-09-29T02:11:17.593969] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:17.829960] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:17.831726] [INFO ] [MAIN ] BA: Generated 1820 derivative records from 54571 primary records. [2025-09-29T02:11:17.832078] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-29T02:11:17.852232] [DEBUG] [LOCAL ] BA: Derivative data saved (1820 records). [2025-09-29T02:11:17.853469] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-29T02:11:17.857380] [INFO ] [MAIN ] Derivative Progress: 190/2211 symbols completed. BA took 1.2s. Estimated remaining: 14m 21s. Rate: 140.9 symbols/min [2025-09-29T02:11:17.878183] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:17.922278] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:17.924501] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-29T02:11:17.926368] [INFO ] [MAIN ] BAC: Loaded 54588 primary data records. [2025-09-29T02:11:17.926124] [INFO ] [MAIN ] BABA: Generated 1820 derivative records from 54600 primary records. [2025-09-29T02:11:17.926768] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-29T02:11:18.076013] [DEBUG] [LOCAL ] BABA: Derivative data saved (1820 records). [2025-09-29T02:11:18.112220] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-29T02:11:18.175037] [INFO ] [MAIN ] Derivative Progress: 191/2211 symbols completed. BABA took 1.2s. Estimated remaining: 14m 19s. Rate: 141.1 symbols/min [2025-09-29T02:11:18.252147] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:18.367107] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-29T02:11:18.368015] [INFO ] [MAIN ] BAH: Loaded 52477 primary data records. [2025-09-29T02:11:18.733884] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-29T02:11:18.734378] [INFO ] [MAIN ] BAK: Loaded 39413 primary data records. [2025-09-29T02:11:18.994634] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:19.089689] [INFO ] [MAIN ] BAC: Generated 1820 derivative records from 54588 primary records. [2025-09-29T02:11:19.090038] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-29T02:11:19.111329] [DEBUG] [LOCAL ] BAC: Derivative data saved (1820 records). [2025-09-29T02:11:19.112492] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-29T02:11:19.115374] [INFO ] [MAIN ] Derivative Progress: 192/2211 symbols completed. BAC took 1.5s. Estimated remaining: 14m 24s. Rate: 140.2 symbols/min [2025-09-29T02:11:19.115602] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:19.135941] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:19.141213] [INFO ] [MAIN ] BAH: Generated 1820 derivative records from 52477 primary records. [2025-09-29T02:11:19.141878] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-29T02:11:19.162171] [DEBUG] [LOCAL ] BAH: Derivative data saved (1820 records). [2025-09-29T02:11:19.165770] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-29T02:11:19.169874] [INFO ] [MAIN ] Derivative Progress: 193/2211 symbols completed. BAH took 1.3s. Estimated remaining: 14m 20s. Rate: 140.8 symbols/min [2025-09-29T02:11:19.183792] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:19.184851] [INFO ] [MAIN ] BAK: Generated 1820 derivative records from 39413 primary records. [2025-09-29T02:11:19.184946] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-29T02:11:19.216998] [DEBUG] [LOCAL ] BAK: Derivative data saved (1820 records). [2025-09-29T02:11:19.217159] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-29T02:11:19.220689] [INFO ] [MAIN ] Derivative Progress: 194/2211 symbols completed. BAK took 1.0s. Estimated remaining: 14m 15s. Rate: 141.5 symbols/min [2025-09-29T02:11:19.244469] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-29T02:11:19.244709] [INFO ] [MAIN ] BALL: Loaded 52583 primary data records. [2025-09-29T02:11:19.583203] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:19.584021] [INFO ] [MAIN ] BALL: Generated 1820 derivative records from 52583 primary records. [2025-09-29T02:11:19.584112] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-29T02:11:19.600318] [DEBUG] [LOCAL ] BALL: Derivative data saved (1820 records). [2025-09-29T02:11:19.600421] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-29T02:11:19.603155] [INFO ] [MAIN ] Derivative Progress: 195/2211 symbols completed. BALL took 0.5s. Estimated remaining: 14m 15s. Rate: 141.5 symbols/min [2025-09-29T02:11:19.603940] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:19.604115] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:19.603801] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:19.638285] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-29T02:11:19.638453] [INFO ] [MAIN ] BAP: Loaded 26635 primary data records. [2025-09-29T02:11:19.903425] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-29T02:11:20.025870] [INFO ] [MAIN ] BANC: Loaded 52019 primary data records. [2025-09-29T02:11:20.050117] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-29T02:11:20.086872] [INFO ] [MAIN ] BAM: Loaded 52779 primary data records. [2025-09-29T02:11:20.769989] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:20.772834] [INFO ] [MAIN ] BAP: Generated 1820 derivative records from 26635 primary records. [2025-09-29T02:11:20.773765] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-29T02:11:20.791616] [DEBUG] [LOCAL ] BAP: Derivative data saved (1820 records). [2025-09-29T02:11:20.792404] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-29T02:11:20.796411] [INFO ] [MAIN ] Derivative Progress: 196/2211 symbols completed. BAP took 1.2s. Estimated remaining: 14m 22s. Rate: 140.2 symbols/min [2025-09-29T02:11:20.798091] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:20.818095] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:20.819021] [INFO ] [MAIN ] BANC: Generated 1820 derivative records from 52019 primary records. [2025-09-29T02:11:20.819339] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-29T02:11:20.849598] [DEBUG] [LOCAL ] BANC: Derivative data saved (1820 records). [2025-09-29T02:11:20.854978] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-29T02:11:20.857881] [INFO ] [MAIN ] Derivative Progress: 197/2211 symbols completed. BANC took 1.3s. Estimated remaining: 14m 18s. Rate: 140.9 symbols/min [2025-09-29T02:11:20.858374] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:20.870297] [INFO ] [MAIN ] BAM: Generated 1820 derivative records from 52779 primary records. [2025-09-29T02:11:20.868890] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:20.870501] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-29T02:11:20.889305] [DEBUG] [LOCAL ] BAM: Derivative data saved (1820 records). [2025-09-29T02:11:20.889471] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-29T02:11:20.892694] [INFO ] [MAIN ] Derivative Progress: 198/2211 symbols completed. BAM took 1.3s. Estimated remaining: 14m 13s. Rate: 141.5 symbols/min [2025-09-29T02:11:20.892933] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:20.910311] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-29T02:11:20.910513] [INFO ] [MAIN ] BARK: Loaded 38893 primary data records. [2025-09-29T02:11:21.330571] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-29T02:11:21.332419] [INFO ] [MAIN ] BAX: Loaded 54273 primary data records. [2025-09-29T02:11:21.356813] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-29T02:11:21.395479] [INFO ] [MAIN ] BB: Loaded 53701 primary data records. [2025-09-29T02:11:22.009742] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:22.011118] [INFO ] [MAIN ] BARK: Generated 1820 derivative records from 38893 primary records. [2025-09-29T02:11:22.011448] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-29T02:11:22.032187] [DEBUG] [LOCAL ] BARK: Derivative data saved (1820 records). [2025-09-29T02:11:22.033029] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-29T02:11:22.036574] [INFO ] [MAIN ] Derivative Progress: 199/2211 symbols completed. BARK took 1.2s. Estimated remaining: 14m 20s. Rate: 140.3 symbols/min [2025-09-29T02:11:22.036930] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:22.061799] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:22.062986] [INFO ] [MAIN ] BAX: Generated 1820 derivative records from 54273 primary records. [2025-09-29T02:11:22.063261] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-29T02:11:22.097795] [DEBUG] [LOCAL ] BAX: Derivative data saved (1820 records). [2025-09-29T02:11:22.098063] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-29T02:11:22.095128] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:22.101581] [INFO ] [MAIN ] BB: Generated 1820 derivative records from 53701 primary records. [2025-09-29T02:11:22.101812] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-29T02:11:22.101427] [INFO ] [MAIN ] Derivative Progress: 200/2211 symbols completed. BAX took 1.2s. Estimated remaining: 14m 16s. Rate: 140.9 symbols/min [2025-09-29T02:11:22.103050] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:22.137760] [DEBUG] [LOCAL ] BB: Derivative data saved (1820 records). [2025-09-29T02:11:22.138123] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-29T02:11:22.142098] [INFO ] [MAIN ] Derivative Progress: 201/2211 symbols completed. BB took 1.2s. Estimated remaining: 14m 12s. Rate: 141.6 symbols/min [2025-09-29T02:11:22.142670] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:22.171147] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-29T02:11:22.171692] [INFO ] [MAIN ] BBAI: Loaded 54600 primary data records. [2025-09-29T02:11:22.424236] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-29T02:11:22.615167] [INFO ] [MAIN ] BBAR: Loaded 41988 primary data records. [2025-09-29T02:11:22.616455] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-29T02:11:22.622181] [INFO ] [MAIN ] BBD: Loaded 53959 primary data records. [2025-09-29T02:11:23.302917] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:23.304288] [INFO ] [MAIN ] BBAI: Generated 1820 derivative records from 54600 primary records. [2025-09-29T02:11:23.304636] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-29T02:11:23.341305] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1820 records). [2025-09-29T02:11:23.340593] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:23.341736] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-29T02:11:23.342519] [INFO ] [MAIN ] BBAR: Generated 1820 derivative records from 41988 primary records. [2025-09-29T02:11:23.348269] [INFO ] [MAIN ] Derivative Progress: 202/2211 symbols completed. BBAI took 1.3s. Estimated remaining: 14m 19s. Rate: 140.3 symbols/min [2025-09-29T02:11:23.348636] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:23.348765] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-29T02:11:23.380490] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:23.382629] [INFO ] [MAIN ] BBD: Generated 1820 derivative records from 53959 primary records. [2025-09-29T02:11:23.382847] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-29T02:11:23.394428] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1820 records). [2025-09-29T02:11:23.397195] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-29T02:11:23.400271] [INFO ] [MAIN ] Derivative Progress: 203/2211 symbols completed. BBAR took 1.3s. Estimated remaining: 14m 15s. Rate: 140.9 symbols/min [2025-09-29T02:11:23.410384] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:23.428338] [DEBUG] [LOCAL ] BBD: Derivative data saved (1820 records). [2025-09-29T02:11:23.430873] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-29T02:11:23.431033] [INFO ] [MAIN ] BBDC: Loaded 33756 primary data records. [2025-09-29T02:11:23.431453] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-29T02:11:23.463483] [INFO ] [MAIN ] Derivative Progress: 204/2211 symbols completed. BBD took 1.3s. Estimated remaining: 14m 11s. Rate: 141.5 symbols/min [2025-09-29T02:11:23.463961] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-29T02:11:23.532327] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:23.504199] [INFO ] [MAIN ] BBDO: Loaded 5051 primary data records. [2025-09-29T02:11:23.906906] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-29T02:11:23.926675] [INFO ] [MAIN ] BBN: Loaded 18193 primary data records. [2025-09-29T02:11:24.501989] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:24.505478] [INFO ] [MAIN ] BBDC: Generated 1820 derivative records from 33756 primary records. [2025-09-29T02:11:24.506277] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-29T02:11:24.532588] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:24.538374] [INFO ] [MAIN ] BBDO: Generated 1820 derivative records from 5051 primary records. [2025-09-29T02:11:24.538498] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-29T02:11:24.540673] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1820 records). [2025-09-29T02:11:24.553950] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-29T02:11:24.557249] [INFO ] [MAIN ] Derivative Progress: 205/2211 symbols completed. BBDC took 1.2s. Estimated remaining: 14m 17s. Rate: 140.4 symbols/min [2025-09-29T02:11:24.558888] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:24.561682] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1820 records). [2025-09-29T02:11:24.562556] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-29T02:11:24.565526] [INFO ] [MAIN ] Derivative Progress: 206/2211 symbols completed. BBDO took 1.2s. Estimated remaining: 14m 13s. Rate: 141.1 symbols/min [2025-09-29T02:11:24.565867] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:24.575496] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-29T02:11:24.588960] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:24.589234] [INFO ] [MAIN ] BBU: Loaded 4478 primary data records. [2025-09-29T02:11:24.595606] [INFO ] [MAIN ] BBN: Generated 1820 derivative records from 18193 primary records. [2025-09-29T02:11:24.638763] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-29T02:11:24.733000] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-29T02:11:24.746427] [INFO ] [MAIN ] BBUC: Loaded 13503 primary data records. [2025-09-29T02:11:24.752773] [DEBUG] [LOCAL ] BBN: Derivative data saved (1820 records). [2025-09-29T02:11:24.780782] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-29T02:11:24.853072] [INFO ] [MAIN ] Derivative Progress: 207/2211 symbols completed. BBN took 1.3s. Estimated remaining: 14m 11s. Rate: 141.3 symbols/min [2025-09-29T02:11:24.902116] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:25.376147] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:11:25.379355] [INFO ] [MAIN ] BBU: Generated 1819 derivative records from 4478 primary records. [2025-09-29T02:11:25.379617] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-29T02:11:25.382480] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-29T02:11:25.385771] [INFO ] [MAIN ] BBVA: Loaded 50167 primary data records. [2025-09-29T02:11:25.471585] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:25.495812] [INFO ] [MAIN ] BBUC: Generated 1820 derivative records from 13503 primary records. [2025-09-29T02:11:25.507157] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-29T02:11:25.530504] [DEBUG] [LOCAL ] BBU: Derivative data saved (1819 records). [2025-09-29T02:11:25.545313] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-29T02:11:25.547928] [INFO ] [MAIN ] Derivative Progress: 208/2211 symbols completed. BBU took 1.0s. Estimated remaining: 14m 13s. Rate: 140.8 symbols/min [2025-09-29T02:11:25.575573] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1820 records). [2025-09-29T02:11:25.600560] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-29T02:11:25.623353] [INFO ] [MAIN ] Derivative Progress: 209/2211 symbols completed. BBUC took 1.1s. Estimated remaining: 14m 9s. Rate: 141.4 symbols/min [2025-09-29T02:11:25.812535] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:25.813270] [INFO ] [MAIN ] BBVA: Generated 1820 derivative records from 50167 primary records. [2025-09-29T02:11:25.813357] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-29T02:11:25.829431] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1820 records). [2025-09-29T02:11:25.829539] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-29T02:11:25.832360] [INFO ] [MAIN ] Derivative Progress: 210/2211 symbols completed. BBVA took 0.9s. Estimated remaining: 14m 7s. Rate: 141.7 symbols/min [2025-09-29T02:11:25.833003] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:25.833108] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:25.833302] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:25.869199] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-29T02:11:25.869425] [INFO ] [MAIN ] BBW: Loaded 27177 primary data records. [2025-09-29T02:11:26.240554] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-29T02:11:26.240915] [INFO ] [MAIN ] BBWI: Loaded 54360 primary data records. [2025-09-29T02:11:26.347365] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-29T02:11:26.379154] [INFO ] [MAIN ] BBY: Loaded 54253 primary data records. [2025-09-29T02:11:27.020481] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:27.023373] [INFO ] [MAIN ] BBW: Generated 1820 derivative records from 27177 primary records. [2025-09-29T02:11:27.023538] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-29T02:11:27.045309] [DEBUG] [LOCAL ] BBW: Derivative data saved (1820 records). [2025-09-29T02:11:27.047046] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-29T02:11:27.056543] [INFO ] [MAIN ] Derivative Progress: 211/2211 symbols completed. BBW took 1.2s. Estimated remaining: 14m 14s. Rate: 140.5 symbols/min [2025-09-29T02:11:27.058021] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:27.077482] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:27.078758] [INFO ] [MAIN ] BBWI: Generated 1820 derivative records from 54360 primary records. [2025-09-29T02:11:27.079175] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-29T02:11:27.099528] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1820 records). [2025-09-29T02:11:27.100024] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-29T02:11:27.103422] [INFO ] [MAIN ] Derivative Progress: 212/2211 symbols completed. BBWI took 1.3s. Estimated remaining: 14m 10s. Rate: 141.1 symbols/min [2025-09-29T02:11:27.117332] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:27.117917] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:27.118838] [INFO ] [MAIN ] BBY: Generated 1820 derivative records from 54253 primary records. [2025-09-29T02:11:27.119129] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-29T02:11:27.160687] [DEBUG] [LOCAL ] BBY: Derivative data saved (1820 records). [2025-09-29T02:11:27.162113] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-29T02:11:27.165377] [INFO ] [MAIN ] Derivative Progress: 213/2211 symbols completed. BBY took 1.3s. Estimated remaining: 14m 6s. Rate: 141.6 symbols/min [2025-09-29T02:11:27.165742] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:27.169439] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-29T02:11:27.169775] [INFO ] [MAIN ] BC: Loaded 45020 primary data records. [2025-09-29T02:11:27.317366] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-29T02:11:27.338122] [INFO ] [MAIN ] BCAT: Loaded 34910 primary data records. [2025-09-29T02:11:27.658102] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-29T02:11:27.662441] [INFO ] [MAIN ] BCC: Loaded 28735 primary data records. [2025-09-29T02:11:28.242822] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:28.245387] [INFO ] [MAIN ] BC: Generated 1820 derivative records from 45020 primary records. [2025-09-29T02:11:28.245912] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-29T02:11:28.265225] [DEBUG] [LOCAL ] BC: Derivative data saved (1820 records). [2025-09-29T02:11:28.268633] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-29T02:11:28.272015] [INFO ] [MAIN ] Derivative Progress: 214/2211 symbols completed. BC took 1.2s. Estimated remaining: 14m 12s. Rate: 140.6 symbols/min [2025-09-29T02:11:28.274228] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:28.289734] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:28.290968] [INFO ] [MAIN ] BCAT: Generated 1820 derivative records from 34910 primary records. [2025-09-29T02:11:28.304845] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:28.305775] [INFO ] [MAIN ] BCC: Generated 1820 derivative records from 28735 primary records. [2025-09-29T02:11:28.305956] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-29T02:11:28.306047] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-29T02:11:28.345346] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1820 records). [2025-09-29T02:11:28.344069] [DEBUG] [LOCAL ] BCC: Derivative data saved (1820 records). [2025-09-29T02:11:28.345836] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-29T02:11:28.349113] [INFO ] [MAIN ] Derivative Progress: 215/2211 symbols completed. BCAT took 1.2s. Estimated remaining: 14m 9s. Rate: 141.1 symbols/min [2025-09-29T02:11:28.349418] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:28.346008] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-29T02:11:28.352802] [INFO ] [MAIN ] Derivative Progress: 216/2211 symbols completed. BCC took 1.2s. Estimated remaining: 14m 4s. Rate: 141.8 symbols/min [2025-09-29T02:11:28.353166] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:28.437380] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-29T02:11:28.439025] [DEBUG] [LOCAL ] BCH: Loaded 30039 existing records from primary storage. [2025-09-29T02:11:28.439291] [INFO ] [MAIN ] BCE: Loaded 53072 primary data records. [2025-09-29T02:11:28.438370] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-29T02:11:28.439442] [INFO ] [MAIN ] BCH: Loaded 30039 primary data records. [2025-09-29T02:11:28.439945] [INFO ] [MAIN ] BCO: Loaded 26740 primary data records. [2025-09-29T02:11:29.541361] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:29.566947] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:29.567389] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:29.568261] [INFO ] [MAIN ] BCH: Generated 1820 derivative records from 30039 primary records. [2025-09-29T02:11:29.568395] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-29T02:11:29.569104] [INFO ] [MAIN ] BCO: Generated 1820 derivative records from 26740 primary records. [2025-09-29T02:11:29.570539] [INFO ] [MAIN ] BCE: Generated 1820 derivative records from 53072 primary records. [2025-09-29T02:11:29.570677] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-29T02:11:29.570999] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-29T02:11:29.587829] [DEBUG] [LOCAL ] BCH: Derivative data saved (1820 records). [2025-09-29T02:11:29.616786] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-29T02:11:29.614600] [DEBUG] [LOCAL ] BCE: Derivative data saved (1820 records). [2025-09-29T02:11:29.617721] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-29T02:11:29.622384] [INFO ] [MAIN ] Derivative Progress: 217/2211 symbols completed. BCE took 1.3s. Estimated remaining: 14m 12s. Rate: 140.5 symbols/min [2025-09-29T02:11:29.619281] [DEBUG] [LOCAL ] BCO: Derivative data saved (1820 records). [2025-09-29T02:11:29.625634] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:29.625807] [INFO ] [MAIN ] Derivative Progress: 218/2211 symbols completed. BCH took 1.3s. Estimated remaining: 14m 7s. Rate: 141.1 symbols/min [2025-09-29T02:11:29.626265] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-29T02:11:29.628999] [INFO ] [MAIN ] Derivative Progress: 219/2211 symbols completed. BCO took 1.3s. Estimated remaining: 14m 3s. Rate: 141.8 symbols/min [2025-09-29T02:11:29.626585] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:29.629389] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:29.665762] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-29T02:11:29.666028] [INFO ] [MAIN ] BCX: Loaded 21920 primary data records. [2025-09-29T02:11:29.832048] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-29T02:11:29.892736] [INFO ] [MAIN ] BCSF: Loaded 28231 primary data records. [2025-09-29T02:11:29.892553] [DEBUG] [LOCAL ] BCS: Loaded 54242 existing records from primary storage. [2025-09-29T02:11:29.927391] [INFO ] [MAIN ] BCS: Loaded 54242 primary data records. [2025-09-29T02:11:30.773674] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:30.774700] [INFO ] [MAIN ] BCX: Generated 1820 derivative records from 21920 primary records. [2025-09-29T02:11:30.774909] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-29T02:11:30.796187] [DEBUG] [LOCAL ] BCX: Derivative data saved (1820 records). [2025-09-29T02:11:30.796803] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-29T02:11:30.799084] [INFO ] [MAIN ] Derivative Progress: 220/2211 symbols completed. BCX took 1.2s. Estimated remaining: 14m 9s. Rate: 140.6 symbols/min [2025-09-29T02:11:30.799548] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:30.813057] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:30.813991] [INFO ] [MAIN ] BCS: Generated 1820 derivative records from 54242 primary records. [2025-09-29T02:11:30.814237] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-29T02:11:30.843037] [DEBUG] [LOCAL ] BCS: Derivative data saved (1820 records). [2025-09-29T02:11:30.848979] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-29T02:11:30.852255] [INFO ] [MAIN ] Derivative Progress: 221/2211 symbols completed. BCS took 1.2s. Estimated remaining: 14m 6s. Rate: 141.2 symbols/min [2025-09-29T02:11:30.852468] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:30.848877] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:30.854160] [INFO ] [MAIN ] BCSF: Generated 1820 derivative records from 28231 primary records. [2025-09-29T02:11:30.854432] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-29T02:11:30.880137] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1820 records). [2025-09-29T02:11:30.880339] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-29T02:11:30.883136] [INFO ] [MAIN ] Derivative Progress: 222/2211 symbols completed. BCSF took 1.3s. Estimated remaining: 14m 2s. Rate: 141.8 symbols/min [2025-09-29T02:11:30.883426] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:30.896188] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-29T02:11:30.905909] [INFO ] [MAIN ] BDC: Loaded 25073 primary data records. [2025-09-29T02:11:31.030247] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-29T02:11:31.034186] [INFO ] [MAIN ] BDJ: Loaded 29325 primary data records. [2025-09-29T02:11:31.464389] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-29T02:11:31.484595] [INFO ] [MAIN ] BDN: Loaded 48230 primary data records. [2025-09-29T02:11:31.991634] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:31.993194] [INFO ] [MAIN ] BDC: Generated 1820 derivative records from 25073 primary records. [2025-09-29T02:11:31.994837] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-29T02:11:32.017802] [DEBUG] [LOCAL ] BDC: Derivative data saved (1820 records). [2025-09-29T02:11:32.018692] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-29T02:11:32.021798] [INFO ] [MAIN ] Derivative Progress: 223/2211 symbols completed. BDC took 1.2s. Estimated remaining: 14m 8s. Rate: 140.7 symbols/min [2025-09-29T02:11:32.036541] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:32.037528] [INFO ] [MAIN ] BDJ: Generated 1820 derivative records from 29325 primary records. [2025-09-29T02:11:32.038857] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-29T02:11:32.060346] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1820 records). [2025-09-29T02:11:32.060778] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-29T02:11:32.064613] [INFO ] [MAIN ] Derivative Progress: 224/2211 symbols completed. BDJ took 1.2s. Estimated remaining: 14m 4s. Rate: 141.3 symbols/min [2025-09-29T02:11:32.082203] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:32.082940] [INFO ] [MAIN ] BDN: Generated 1820 derivative records from 48230 primary records. [2025-09-29T02:11:32.083029] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-29T02:11:32.098759] [DEBUG] [LOCAL ] BDN: Derivative data saved (1820 records). [2025-09-29T02:11:32.098852] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-29T02:11:32.101798] [INFO ] [MAIN ] Derivative Progress: 225/2211 symbols completed. BDN took 1.2s. Estimated remaining: 13m 60s. Rate: 141.9 symbols/min [2025-09-29T02:11:32.102206] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:32.102389] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:32.102606] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:32.198017] [DEBUG] [LOCAL ] BEKE: Loaded 54025 existing records from primary storage. [2025-09-29T02:11:32.198294] [INFO ] [MAIN ] BEKE: Loaded 54025 primary data records. [2025-09-29T02:11:32.370755] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-29T02:11:32.383204] [INFO ] [MAIN ] BDX: Loaded 53191 primary data records. [2025-09-29T02:11:32.390234] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-29T02:11:32.395913] [INFO ] [MAIN ] BE: Loaded 54433 primary data records. [2025-09-29T02:11:33.279827] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:33.281204] [INFO ] [MAIN ] BEKE: Generated 1820 derivative records from 54025 primary records. [2025-09-29T02:11:33.281487] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-29T02:11:33.300927] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1820 records). [2025-09-29T02:11:33.303151] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-29T02:11:33.308992] [INFO ] [MAIN ] Derivative Progress: 226/2211 symbols completed. BEKE took 1.2s. Estimated remaining: 14m 6s. Rate: 140.7 symbols/min [2025-09-29T02:11:33.309348] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:33.324014] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:33.333087] [INFO ] [MAIN ] BE: Generated 1820 derivative records from 54433 primary records. [2025-09-29T02:11:33.338306] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-29T02:11:33.339080] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:33.340056] [INFO ] [MAIN ] BDX: Generated 1820 derivative records from 53191 primary records. [2025-09-29T02:11:33.340408] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-29T02:11:33.370281] [DEBUG] [LOCAL ] BE: Derivative data saved (1820 records). [2025-09-29T02:11:33.371681] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-29T02:11:33.377133] [INFO ] [MAIN ] Derivative Progress: 227/2211 symbols completed. BE took 1.3s. Estimated remaining: 14m 3s. Rate: 141.2 symbols/min [2025-09-29T02:11:33.378277] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:33.380100] [DEBUG] [LOCAL ] BDX: Derivative data saved (1820 records). [2025-09-29T02:11:33.380595] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-29T02:11:33.384119] [INFO ] [MAIN ] Derivative Progress: 228/2211 symbols completed. BDX took 1.3s. Estimated remaining: 13m 59s. Rate: 141.8 symbols/min [2025-09-29T02:11:33.384421] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:33.460792] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-29T02:11:33.461006] [INFO ] [MAIN ] BEN: Loaded 53833 primary data records. [2025-09-29T02:11:33.496485] [DEBUG] [LOCAL ] BEP: Loaded 39244 existing records from primary storage. [2025-09-29T02:11:33.529074] [INFO ] [MAIN ] BEP: Loaded 39244 primary data records. [2025-09-29T02:11:33.706470] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-29T02:11:33.753046] [INFO ] [MAIN ] BEPC: Loaded 47209 primary data records. [2025-09-29T02:11:34.587494] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:34.589078] [INFO ] [MAIN ] BEN: Generated 1820 derivative records from 53833 primary records. [2025-09-29T02:11:34.589410] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-29T02:11:34.605061] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:34.613903] [INFO ] [MAIN ] BEP: Generated 1820 derivative records from 39244 primary records. [2025-09-29T02:11:34.618160] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-29T02:11:34.624408] [DEBUG] [LOCAL ] BEN: Derivative data saved (1820 records). [2025-09-29T02:11:34.632189] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-29T02:11:34.638523] [INFO ] [MAIN ] Derivative Progress: 229/2211 symbols completed. BEN took 1.3s. Estimated remaining: 14m 6s. Rate: 140.6 symbols/min [2025-09-29T02:11:34.639631] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:34.645799] [DEBUG] [LOCAL ] BEP: Derivative data saved (1820 records). [2025-09-29T02:11:34.646200] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-29T02:11:34.649047] [INFO ] [MAIN ] Derivative Progress: 230/2211 symbols completed. BEP took 1.3s. Estimated remaining: 14m 2s. Rate: 141.2 symbols/min [2025-09-29T02:11:34.651889] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:34.671498] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-29T02:11:34.673126] [INFO ] [MAIN ] BEPH: Loaded 5208 primary data records. [2025-09-29T02:11:34.671873] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:34.706971] [INFO ] [MAIN ] BEPC: Generated 1820 derivative records from 47209 primary records. [2025-09-29T02:11:34.722504] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-29T02:11:34.727827] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-29T02:11:34.762869] [INFO ] [MAIN ] BEPI: Loaded 3487 primary data records. [2025-09-29T02:11:34.976881] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1820 records). [2025-09-29T02:11:35.128297] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-29T02:11:35.136470] [INFO ] [MAIN ] Derivative Progress: 231/2211 symbols completed. BEPC took 1.8s. Estimated remaining: 14m 2s. Rate: 141.1 symbols/min [2025-09-29T02:11:35.154043] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:35.353988] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-29T02:11:35.356512] [INFO ] [MAIN ] BEPJ: Loaded 3268 primary data records. [2025-09-29T02:11:35.764365] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:35.765538] [INFO ] [MAIN ] BEPH: Generated 1820 derivative records from 5208 primary records. [2025-09-29T02:11:35.766924] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-29T02:11:35.800796] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1820 records). [2025-09-29T02:11:35.801717] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:35.802608] [INFO ] [MAIN ] BEPI: Generated 1820 derivative records from 3487 primary records. [2025-09-29T02:11:35.802793] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-29T02:11:35.802896] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-29T02:11:35.807399] [INFO ] [MAIN ] Derivative Progress: 232/2211 symbols completed. BEPH took 1.2s. Estimated remaining: 14m 3s. Rate: 140.8 symbols/min [2025-09-29T02:11:35.818152] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:35.822267] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1820 records). [2025-09-29T02:11:35.822548] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-29T02:11:35.825715] [INFO ] [MAIN ] Derivative Progress: 233/2211 symbols completed. BEPI took 1.2s. Estimated remaining: 13m 59s. Rate: 141.4 symbols/min [2025-09-29T02:11:35.826954] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:35.849098] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:35.849956] [INFO ] [MAIN ] BEPJ: Generated 1820 derivative records from 3268 primary records. [2025-09-29T02:11:35.850075] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-29T02:11:35.864920] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1820 records). [2025-09-29T02:11:35.865108] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-29T02:11:35.868102] [INFO ] [MAIN ] Derivative Progress: 234/2211 symbols completed. BEPJ took 0.7s. Estimated remaining: 13m 56s. Rate: 141.9 symbols/min [2025-09-29T02:11:35.868380] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:35.920582] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-29T02:11:35.921085] [INFO ] [MAIN ] BFAM: Loaded 33519 primary data records. [2025-09-29T02:11:35.936269] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-29T02:11:35.942071] [INFO ] [MAIN ] BFH: Loaded 42308 primary data records. [2025-09-29T02:11:35.979011] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-29T02:11:36.009782] [INFO ] [MAIN ] BFK: Loaded 14145 primary data records. [2025-09-29T02:11:36.992541] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:36.996448] [INFO ] [MAIN ] BFAM: Generated 1820 derivative records from 33519 primary records. [2025-09-29T02:11:36.996970] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-29T02:11:37.027466] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1820 records). [2025-09-29T02:11:37.029913] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-29T02:11:37.033942] [INFO ] [MAIN ] Derivative Progress: 235/2211 symbols completed. BFAM took 1.2s. Estimated remaining: 14m 2s. Rate: 140.9 symbols/min [2025-09-29T02:11:37.034366] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:37.027748] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:37.035304] [INFO ] [MAIN ] BFH: Generated 1820 derivative records from 42308 primary records. [2025-09-29T02:11:37.049070] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:37.049800] [INFO ] [MAIN ] BFK: Generated 1820 derivative records from 14145 primary records. [2025-09-29T02:11:37.048785] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-29T02:11:37.049926] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-29T02:11:37.084096] [DEBUG] [LOCAL ] BFH: Derivative data saved (1820 records). [2025-09-29T02:11:37.079510] [DEBUG] [LOCAL ] BFK: Derivative data saved (1820 records). [2025-09-29T02:11:37.084334] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-29T02:11:37.087424] [INFO ] [MAIN ] Derivative Progress: 236/2211 symbols completed. BFK took 1.2s. Estimated remaining: 13m 58s. Rate: 141.4 symbols/min [2025-09-29T02:11:37.087715] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:37.088663] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-29T02:11:37.091706] [INFO ] [MAIN ] Derivative Progress: 237/2211 symbols completed. BFH took 1.3s. Estimated remaining: 13m 54s. Rate: 142.0 symbols/min [2025-09-29T02:11:37.092332] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:37.104741] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-29T02:11:37.104932] [INFO ] [MAIN ] BFS: Loaded 9240 primary data records. [2025-09-29T02:11:37.250084] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-29T02:11:37.272635] [INFO ] [MAIN ] BFZ: Loaded 12223 primary data records. [2025-09-29T02:11:37.287197] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-29T02:11:37.320231] [INFO ] [MAIN ] BFLY: Loaded 52590 primary data records. [2025-09-29T02:11:38.233131] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:38.234217] [INFO ] [MAIN ] BFS: Generated 1820 derivative records from 9240 primary records. [2025-09-29T02:11:38.234445] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-29T02:11:38.255201] [DEBUG] [LOCAL ] BFS: Derivative data saved (1820 records). [2025-09-29T02:11:38.269412] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-29T02:11:38.272325] [INFO ] [MAIN ] Derivative Progress: 238/2211 symbols completed. BFS took 1.2s. Estimated remaining: 14m 0s. Rate: 140.9 symbols/min [2025-09-29T02:11:38.273020] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:38.275964] [INFO ] [MAIN ] BFLY: Generated 1820 derivative records from 52590 primary records. [2025-09-29T02:11:38.276217] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-29T02:11:38.289944] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:38.290929] [INFO ] [MAIN ] BFZ: Generated 1820 derivative records from 12223 primary records. [2025-09-29T02:11:38.299217] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-29T02:11:38.307508] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1820 records). [2025-09-29T02:11:38.314848] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-29T02:11:38.318038] [INFO ] [MAIN ] Derivative Progress: 239/2211 symbols completed. BFLY took 1.3s. Estimated remaining: 13m 56s. Rate: 141.5 symbols/min [2025-09-29T02:11:38.326483] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1820 records). [2025-09-29T02:11:38.326681] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-29T02:11:38.329962] [INFO ] [MAIN ] Derivative Progress: 240/2211 symbols completed. BFZ took 1.2s. Estimated remaining: 13m 53s. Rate: 142.0 symbols/min [2025-09-29T02:11:38.330669] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:38.330731] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:38.330792] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:38.361196] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-29T02:11:38.361425] [INFO ] [MAIN ] BGH: Loaded 16728 primary data records. [2025-09-29T02:11:38.402851] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-29T02:11:38.421237] [INFO ] [MAIN ] BGB: Loaded 17621 primary data records. [2025-09-29T02:11:38.894576] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-29T02:11:38.905423] [INFO ] [MAIN ] BG: Loaded 51118 primary data records. [2025-09-29T02:11:39.466866] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:39.471553] [INFO ] [MAIN ] BGH: Generated 1820 derivative records from 16728 primary records. [2025-09-29T02:11:39.472458] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-29T02:11:39.496000] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:39.497876] [INFO ] [MAIN ] BGB: Generated 1820 derivative records from 17621 primary records. [2025-09-29T02:11:39.498107] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-29T02:11:39.523222] [DEBUG] [LOCAL ] BGH: Derivative data saved (1820 records). [2025-09-29T02:11:39.524813] [DEBUG] [LOCAL ] BGB: Derivative data saved (1820 records). [2025-09-29T02:11:39.525356] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-29T02:11:39.525282] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-29T02:11:39.529239] [INFO ] [MAIN ] Derivative Progress: 241/2211 symbols completed. BGH took 1.2s. Estimated remaining: 13m 59s. Rate: 141.0 symbols/min [2025-09-29T02:11:39.532874] [INFO ] [MAIN ] Derivative Progress: 242/2211 symbols completed. BGB took 1.2s. Estimated remaining: 13m 55s. Rate: 141.5 symbols/min [2025-09-29T02:11:39.532743] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:39.533532] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:39.554791] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:39.555967] [INFO ] [MAIN ] BG: Generated 1820 derivative records from 51118 primary records. [2025-09-29T02:11:39.556091] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-29T02:11:39.577310] [DEBUG] [LOCAL ] BG: Derivative data saved (1820 records). [2025-09-29T02:11:39.577698] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-29T02:11:39.580626] [INFO ] [MAIN ] Derivative Progress: 243/2211 symbols completed. BG took 1.2s. Estimated remaining: 13m 51s. Rate: 142.1 symbols/min [2025-09-29T02:11:39.588860] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-29T02:11:39.589180] [INFO ] [MAIN ] BGR: Loaded 13658 primary data records. [2025-09-29T02:11:39.589329] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:39.734909] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-29T02:11:39.767093] [INFO ] [MAIN ] BGSF: Loaded 7050 primary data records. [2025-09-29T02:11:40.034835] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-29T02:11:40.051931] [INFO ] [MAIN ] BGS: Loaded 51183 primary data records. [2025-09-29T02:11:40.711602] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:40.713016] [INFO ] [MAIN ] BGR: Generated 1820 derivative records from 13658 primary records. [2025-09-29T02:11:40.715237] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-29T02:11:40.734899] [DEBUG] [LOCAL ] BGR: Derivative data saved (1820 records). [2025-09-29T02:11:40.735254] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-29T02:11:40.739558] [INFO ] [MAIN ] Derivative Progress: 244/2211 symbols completed. BGR took 1.2s. Estimated remaining: 13m 57s. Rate: 141.0 symbols/min [2025-09-29T02:11:40.741455] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:40.758471] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:11:40.759386] [INFO ] [MAIN ] BGSF: Generated 1818 derivative records from 7050 primary records. [2025-09-29T02:11:40.759493] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-29T02:11:40.784331] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1818 records). [2025-09-29T02:11:40.790444] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-29T02:11:40.791843] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-29T02:11:40.792152] [INFO ] [MAIN ] BGT: Loaded 16793 primary data records. [2025-09-29T02:11:40.796869] [INFO ] [MAIN ] Derivative Progress: 245/2211 symbols completed. BGSF took 1.2s. Estimated remaining: 13m 53s. Rate: 141.5 symbols/min [2025-09-29T02:11:40.858117] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:40.888814] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:40.911158] [INFO ] [MAIN ] BGS: Generated 1820 derivative records from 51183 primary records. [2025-09-29T02:11:40.933053] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-29T02:11:41.044193] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-29T02:11:41.045003] [DEBUG] [LOCAL ] BGS: Derivative data saved (1820 records). [2025-09-29T02:11:41.045188] [INFO ] [MAIN ] BGX: Loaded 10900 primary data records. [2025-09-29T02:11:41.052529] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-29T02:11:41.056127] [INFO ] [MAIN ] Derivative Progress: 246/2211 symbols completed. BGS took 1.5s. Estimated remaining: 13m 52s. Rate: 141.8 symbols/min [2025-09-29T02:11:41.061494] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:41.549169] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-29T02:11:41.550240] [INFO ] [MAIN ] BGY: Loaded 22790 primary data records. [2025-09-29T02:11:41.887452] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:41.898479] [INFO ] [MAIN ] BGT: Generated 1820 derivative records from 16793 primary records. [2025-09-29T02:11:41.898949] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-29T02:11:41.922467] [DEBUG] [LOCAL ] BGT: Derivative data saved (1820 records). [2025-09-29T02:11:41.936471] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-29T02:11:41.936266] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:41.938054] [INFO ] [MAIN ] BGX: Generated 1820 derivative records from 10900 primary records. [2025-09-29T02:11:41.938169] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-29T02:11:41.941090] [INFO ] [MAIN ] Derivative Progress: 247/2211 symbols completed. BGT took 1.2s. Estimated remaining: 13m 55s. Rate: 141.1 symbols/min [2025-09-29T02:11:41.942678] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:41.961638] [DEBUG] [LOCAL ] BGX: Derivative data saved (1820 records). [2025-09-29T02:11:41.961843] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-29T02:11:41.964547] [INFO ] [MAIN ] Derivative Progress: 248/2211 symbols completed. BGX took 1.1s. Estimated remaining: 13m 51s. Rate: 141.7 symbols/min [2025-09-29T02:11:41.964931] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:41.989559] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:41.990343] [INFO ] [MAIN ] BGY: Generated 1820 derivative records from 22790 primary records. [2025-09-29T02:11:41.990538] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-29T02:11:42.010503] [DEBUG] [LOCAL ] BH: Loaded 15938 existing records from primary storage. [2025-09-29T02:11:42.012292] [INFO ] [MAIN ] BH: Loaded 15938 primary data records. [2025-09-29T02:11:42.061672] [DEBUG] [LOCAL ] BGY: Derivative data saved (1820 records). [2025-09-29T02:11:42.078542] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-29T02:11:42.134755] [INFO ] [MAIN ] Derivative Progress: 249/2211 symbols completed. BGY took 1.1s. Estimated remaining: 13m 49s. Rate: 142.0 symbols/min [2025-09-29T02:11:42.149452] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:42.292690] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-29T02:11:42.450293] [INFO ] [MAIN ] BHC: Loaded 47495 primary data records. [2025-09-29T02:11:42.517864] [DEBUG] [LOCAL ] BHE: Loaded 25353 existing records from primary storage. [2025-09-29T02:11:42.532752] [INFO ] [MAIN ] BHE: Loaded 25353 primary data records. [2025-09-29T02:11:43.158561] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:43.160403] [INFO ] [MAIN ] BH: Generated 1820 derivative records from 15938 primary records. [2025-09-29T02:11:43.160966] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-29T02:11:43.184499] [DEBUG] [LOCAL ] BH: Derivative data saved (1820 records). [2025-09-29T02:11:43.193383] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-29T02:11:43.202562] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:43.203506] [INFO ] [MAIN ] BHC: Generated 1820 derivative records from 47495 primary records. [2025-09-29T02:11:43.203628] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-29T02:11:43.202100] [INFO ] [MAIN ] Derivative Progress: 250/2211 symbols completed. BH took 1.3s. Estimated remaining: 13m 53s. Rate: 141.2 symbols/min [2025-09-29T02:11:43.204145] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:43.236393] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:43.238591] [INFO ] [MAIN ] BHE: Generated 1820 derivative records from 25353 primary records. [2025-09-29T02:11:43.239903] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-29T02:11:43.241617] [DEBUG] [LOCAL ] BHC: Derivative data saved (1820 records). [2025-09-29T02:11:43.242425] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-29T02:11:43.245437] [INFO ] [MAIN ] Derivative Progress: 251/2211 symbols completed. BHC took 1.3s. Estimated remaining: 13m 50s. Rate: 141.7 symbols/min [2025-09-29T02:11:43.259106] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:43.277591] [DEBUG] [LOCAL ] BHE: Derivative data saved (1820 records). [2025-09-29T02:11:43.277982] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-29T02:11:43.278847] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-29T02:11:43.282099] [INFO ] [MAIN ] Derivative Progress: 252/2211 symbols completed. BHE took 1.1s. Estimated remaining: 13m 47s. Rate: 142.2 symbols/min [2025-09-29T02:11:43.282544] [INFO ] [MAIN ] BHK: Loaded 22922 primary data records. [2025-09-29T02:11:43.282682] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:43.479601] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-29T02:11:43.487602] [INFO ] [MAIN ] BHR: Loaded 21771 primary data records. [2025-09-29T02:11:43.771001] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-29T02:11:43.783389] [INFO ] [MAIN ] BHP: Loaded 54153 primary data records. [2025-09-29T02:11:44.410923] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:44.413335] [INFO ] [MAIN ] BHK: Generated 1820 derivative records from 22922 primary records. [2025-09-29T02:11:44.413940] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-29T02:11:44.433719] [DEBUG] [LOCAL ] BHK: Derivative data saved (1820 records). [2025-09-29T02:11:44.434317] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-29T02:11:44.437831] [INFO ] [MAIN ] Derivative Progress: 253/2211 symbols completed. BHK took 1.2s. Estimated remaining: 13m 52s. Rate: 141.2 symbols/min [2025-09-29T02:11:44.455775] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:44.456908] [INFO ] [MAIN ] BHR: Generated 1820 derivative records from 21771 primary records. [2025-09-29T02:11:44.457246] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-29T02:11:44.475695] [DEBUG] [LOCAL ] BHR: Derivative data saved (1820 records). [2025-09-29T02:11:44.477508] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-29T02:11:44.481082] [INFO ] [MAIN ] Derivative Progress: 254/2211 symbols completed. BHR took 1.2s. Estimated remaining: 13m 49s. Rate: 141.7 symbols/min [2025-09-29T02:11:44.493746] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:44.494424] [INFO ] [MAIN ] BHP: Generated 1820 derivative records from 54153 primary records. [2025-09-29T02:11:44.494508] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-29T02:11:44.514495] [DEBUG] [LOCAL ] BHP: Derivative data saved (1820 records). [2025-09-29T02:11:44.514587] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-29T02:11:44.517808] [INFO ] [MAIN ] Derivative Progress: 255/2211 symbols completed. BHP took 1.3s. Estimated remaining: 13m 45s. Rate: 142.2 symbols/min [2025-09-29T02:11:44.518372] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:44.518529] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:44.518264] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:44.564761] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-29T02:11:44.565163] [INFO ] [MAIN ] BIO: Loaded 25533 primary data records. [2025-09-29T02:11:44.741373] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-29T02:11:44.788372] [INFO ] [MAIN ] BHVN: Loaded 50401 primary data records. [2025-09-29T02:11:44.808402] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-29T02:11:44.937477] [INFO ] [MAIN ] BILL: Loaded 53105 primary data records. [2025-09-29T02:11:45.637242] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:45.639479] [INFO ] [MAIN ] BIO: Generated 1820 derivative records from 25533 primary records. [2025-09-29T02:11:45.639977] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-29T02:11:45.658105] [DEBUG] [LOCAL ] BIO: Derivative data saved (1820 records). [2025-09-29T02:11:45.658903] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-29T02:11:45.661558] [INFO ] [MAIN ] Derivative Progress: 256/2211 symbols completed. BIO took 1.1s. Estimated remaining: 13m 50s. Rate: 141.3 symbols/min [2025-09-29T02:11:45.662743] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:45.683426] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:45.697416] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:45.697152] [INFO ] [MAIN ] BHVN: Generated 1820 derivative records from 50401 primary records. [2025-09-29T02:11:45.699236] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-29T02:11:45.699081] [INFO ] [MAIN ] BILL: Generated 1820 derivative records from 53105 primary records. [2025-09-29T02:11:45.700487] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-29T02:11:45.730895] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1820 records). [2025-09-29T02:11:45.734626] [DEBUG] [LOCAL ] BILL: Derivative data saved (1820 records). [2025-09-29T02:11:45.733362] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-29T02:11:45.738301] [INFO ] [MAIN ] Derivative Progress: 257/2211 symbols completed. BHVN took 1.2s. Estimated remaining: 13m 47s. Rate: 141.7 symbols/min [2025-09-29T02:11:45.734801] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-29T02:11:45.738668] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:45.742150] [INFO ] [MAIN ] Derivative Progress: 258/2211 symbols completed. BILL took 1.2s. Estimated remaining: 13m 44s. Rate: 142.3 symbols/min [2025-09-29T02:11:45.742997] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:45.758533] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-29T02:11:45.758765] [INFO ] [MAIN ] BIPH: Loaded 2632 primary data records. [2025-09-29T02:11:45.896917] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-29T02:11:45.919047] [INFO ] [MAIN ] BIP: Loaded 40240 primary data records. [2025-09-29T02:11:46.299816] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-29T02:11:46.336594] [INFO ] [MAIN ] BIPC: Loaded 42317 primary data records. [2025-09-29T02:11:46.896175] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:46.897903] [INFO ] [MAIN ] BIPH: Generated 1820 derivative records from 2632 primary records. [2025-09-29T02:11:46.898145] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-29T02:11:46.927800] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1820 records). [2025-09-29T02:11:46.933865] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:46.933317] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-29T02:11:46.934725] [INFO ] [MAIN ] BIP: Generated 1820 derivative records from 40240 primary records. [2025-09-29T02:11:46.937150] [INFO ] [MAIN ] Derivative Progress: 259/2211 symbols completed. BIPH took 1.2s. Estimated remaining: 13m 49s. Rate: 141.3 symbols/min [2025-09-29T02:11:46.937427] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:46.937618] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-29T02:11:46.958095] [DEBUG] [LOCAL ] BIP: Derivative data saved (1820 records). [2025-09-29T02:11:46.961092] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-29T02:11:46.964809] [INFO ] [MAIN ] Derivative Progress: 260/2211 symbols completed. BIP took 1.3s. Estimated remaining: 13m 46s. Rate: 141.8 symbols/min [2025-09-29T02:11:46.965387] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:46.961334] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-29T02:11:46.966474] [INFO ] [MAIN ] BIPI: Loaded 3282 primary data records. [2025-09-29T02:11:47.056965] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-29T02:11:47.072760] [INFO ] [MAIN ] BIPJ: Loaded 3026 primary data records. [2025-09-29T02:11:47.138269] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:47.161961] [INFO ] [MAIN ] BIPC: Generated 1820 derivative records from 42317 primary records. [2025-09-29T02:11:47.162130] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-29T02:11:47.268179] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1820 records). [2025-09-29T02:11:47.477820] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-29T02:11:47.487296] [INFO ] [MAIN ] Derivative Progress: 261/2211 symbols completed. BIPC took 1.7s. Estimated remaining: 13m 46s. Rate: 141.7 symbols/min [2025-09-29T02:11:47.519975] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:47.726747] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:47.727685] [INFO ] [MAIN ] BIPI: Generated 1820 derivative records from 3282 primary records. [2025-09-29T02:11:47.727841] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-29T02:11:47.744502] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1820 records). [2025-09-29T02:11:47.759531] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-29T02:11:47.762119] [INFO ] [MAIN ] Derivative Progress: 262/2211 symbols completed. BIPI took 0.8s. Estimated remaining: 13m 44s. Rate: 141.9 symbols/min [2025-09-29T02:11:47.762772] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:47.798195] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:47.799133] [INFO ] [MAIN ] BIPJ: Generated 1820 derivative records from 3026 primary records. [2025-09-29T02:11:47.800618] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-29T02:11:47.801075] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-29T02:11:47.801315] [INFO ] [MAIN ] BIRK: Loaded 51674 primary data records. [2025-09-29T02:11:47.910121] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-29T02:11:47.929734] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1820 records). [2025-09-29T02:11:47.935018] [INFO ] [MAIN ] BIT: Loaded 22765 primary data records. [2025-09-29T02:11:47.961388] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-29T02:11:48.014088] [INFO ] [MAIN ] Derivative Progress: 263/2211 symbols completed. BIPJ took 1.0s. Estimated remaining: 13m 43s. Rate: 142.1 symbols/min [2025-09-29T02:11:48.079054] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:48.543616] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:48.545024] [INFO ] [MAIN ] BIRK: Generated 1820 derivative records from 51674 primary records. [2025-09-29T02:11:48.545315] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-29T02:11:48.578788] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:48.596267] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1820 records). [2025-09-29T02:11:48.599456] [INFO ] [MAIN ] BIT: Generated 1820 derivative records from 22765 primary records. [2025-09-29T02:11:48.599906] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-29T02:11:48.600016] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-29T02:11:48.604173] [INFO ] [MAIN ] Derivative Progress: 264/2211 symbols completed. BIRK took 1.1s. Estimated remaining: 13m 44s. Rate: 141.9 symbols/min [2025-09-29T02:11:48.604414] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:48.607143] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-29T02:11:48.614770] [INFO ] [MAIN ] BJ: Loaded 52156 primary data records. [2025-09-29T02:11:48.744263] [DEBUG] [LOCAL ] BIT: Derivative data saved (1820 records). [2025-09-29T02:11:48.768548] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-29T02:11:48.771202] [INFO ] [MAIN ] Derivative Progress: 265/2211 symbols completed. BIT took 1.0s. Estimated remaining: 13m 41s. Rate: 142.2 symbols/min [2025-09-29T02:11:48.771424] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:49.062307] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-29T02:11:49.063509] [INFO ] [MAIN ] BK: Loaded 54319 primary data records. [2025-09-29T02:11:49.420395] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-29T02:11:49.435738] [INFO ] [MAIN ] BKD: Loaded 50889 primary data records. [2025-09-29T02:11:49.779007] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:49.796353] [INFO ] [MAIN ] BJ: Generated 1820 derivative records from 52156 primary records. [2025-09-29T02:11:49.796742] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-29T02:11:49.820717] [DEBUG] [LOCAL ] BJ: Derivative data saved (1820 records). [2025-09-29T02:11:49.821227] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-29T02:11:49.825226] [INFO ] [MAIN ] Derivative Progress: 266/2211 symbols completed. BJ took 1.7s. Estimated remaining: 13m 45s. Rate: 141.4 symbols/min [2025-09-29T02:11:49.825968] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:49.840391] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:49.841450] [INFO ] [MAIN ] BK: Generated 1820 derivative records from 54319 primary records. [2025-09-29T02:11:49.842025] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-29T02:11:49.864040] [DEBUG] [LOCAL ] BK: Derivative data saved (1820 records). [2025-09-29T02:11:49.865878] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-29T02:11:49.869014] [INFO ] [MAIN ] Derivative Progress: 267/2211 symbols completed. BK took 1.3s. Estimated remaining: 13m 42s. Rate: 141.9 symbols/min [2025-09-29T02:11:49.869320] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:49.884454] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:49.885405] [INFO ] [MAIN ] BKD: Generated 1820 derivative records from 50889 primary records. [2025-09-29T02:11:49.894687] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-29T02:11:49.923379] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-29T02:11:49.924448] [INFO ] [MAIN ] BKE: Loaded 35206 primary data records. [2025-09-29T02:11:49.930461] [DEBUG] [LOCAL ] BKD: Derivative data saved (1820 records). [2025-09-29T02:11:49.973232] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-29T02:11:50.017791] [INFO ] [MAIN ] Derivative Progress: 268/2211 symbols completed. BKD took 1.2s. Estimated remaining: 13m 40s. Rate: 142.2 symbols/min [2025-09-29T02:11:50.094673] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-29T02:11:50.110282] [INFO ] [MAIN ] BKH: Loaded 37133 primary data records. [2025-09-29T02:11:50.656039] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:50.657487] [INFO ] [MAIN ] BKE: Generated 1820 derivative records from 35206 primary records. [2025-09-29T02:11:50.657585] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-29T02:11:50.677364] [DEBUG] [LOCAL ] BKE: Derivative data saved (1820 records). [2025-09-29T02:11:50.677787] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-29T02:11:50.680762] [INFO ] [MAIN ] Derivative Progress: 269/2211 symbols completed. BKE took 0.9s. Estimated remaining: 13m 41s. Rate: 141.9 symbols/min [2025-09-29T02:11:50.697391] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:50.698139] [INFO ] [MAIN ] BKH: Generated 1820 derivative records from 37133 primary records. [2025-09-29T02:11:50.698243] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-29T02:11:50.713908] [DEBUG] [LOCAL ] BKH: Derivative data saved (1820 records). [2025-09-29T02:11:50.713996] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-29T02:11:50.717076] [INFO ] [MAIN ] Derivative Progress: 270/2211 symbols completed. BKH took 0.8s. Estimated remaining: 13m 38s. Rate: 142.4 symbols/min [2025-09-29T02:11:50.717813] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:50.717930] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:50.718119] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:50.733503] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-29T02:11:50.733876] [INFO ] [MAIN ] BKN: Loaded 7853 primary data records. [2025-09-29T02:11:50.947998] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-29T02:11:51.036069] [INFO ] [MAIN ] BKKT: Loaded 35164 primary data records. [2025-09-29T02:11:51.149390] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-29T02:11:51.160864] [INFO ] [MAIN ] BKSY: Loaded 48993 primary data records. [2025-09-29T02:11:51.847265] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:51.849364] [INFO ] [MAIN ] BKN: Generated 1820 derivative records from 7853 primary records. [2025-09-29T02:11:51.849526] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-29T02:11:51.869330] [DEBUG] [LOCAL ] BKN: Derivative data saved (1820 records). [2025-09-29T02:11:51.869755] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-29T02:11:51.873863] [INFO ] [MAIN ] Derivative Progress: 271/2211 symbols completed. BKN took 1.2s. Estimated remaining: 13m 43s. Rate: 141.5 symbols/min [2025-09-29T02:11:51.874794] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:51.901194] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:51.919712] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-29T02:11:51.920759] [INFO ] [MAIN ] BKKT: Generated 1820 derivative records from 35164 primary records. [2025-09-29T02:11:51.921387] [INFO ] [MAIN ] BKT: Loaded 11125 primary data records. [2025-09-29T02:11:51.921157] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:51.946093] [INFO ] [MAIN ] BKSY: Generated 1820 derivative records from 48993 primary records. [2025-09-29T02:11:51.933499] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-29T02:11:51.957976] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-29T02:11:52.078844] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1820 records). [2025-09-29T02:11:52.079321] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-29T02:11:52.078946] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1820 records). [2025-09-29T02:11:52.082854] [INFO ] [MAIN ] Derivative Progress: 272/2211 symbols completed. BKSY took 1.4s. Estimated remaining: 13m 41s. Rate: 141.7 symbols/min [2025-09-29T02:11:52.088324] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:52.093696] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-29T02:11:52.117865] [INFO ] [MAIN ] Derivative Progress: 273/2211 symbols completed. BKKT took 1.4s. Estimated remaining: 13m 38s. Rate: 142.2 symbols/min [2025-09-29T02:11:52.141355] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:52.338259] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-29T02:11:52.338786] [INFO ] [MAIN ] BKV: Loaded 30278 primary data records. [2025-09-29T02:11:52.469025] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-29T02:11:52.470940] [INFO ] [MAIN ] BKU: Loaded 42412 primary data records. [2025-09-29T02:11:52.555901] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:52.625840] [INFO ] [MAIN ] BKT: Generated 1820 derivative records from 11125 primary records. [2025-09-29T02:11:52.733189] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-29T02:11:52.945715] [DEBUG] [LOCAL ] BKT: Derivative data saved (1820 records). [2025-09-29T02:11:53.110022] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-29T02:11:53.114011] [INFO ] [MAIN ] Derivative Progress: 274/2211 symbols completed. BKT took 1.2s. Estimated remaining: 13m 41s. Rate: 141.5 symbols/min [2025-09-29T02:11:53.116148] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:53.142878] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:53.144544] [INFO ] [MAIN ] BKV: Generated 1820 derivative records from 30278 primary records. [2025-09-29T02:11:53.144917] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-29T02:11:53.171241] [DEBUG] [LOCAL ] BKV: Derivative data saved (1820 records). [2025-09-29T02:11:53.171588] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-29T02:11:53.176786] [INFO ] [MAIN ] Derivative Progress: 275/2211 symbols completed. BKV took 1.0s. Estimated remaining: 13m 38s. Rate: 142.0 symbols/min [2025-09-29T02:11:53.178107] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:53.193009] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:53.204273] [INFO ] [MAIN ] BKU: Generated 1820 derivative records from 42412 primary records. [2025-09-29T02:11:53.204416] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-29T02:11:53.215015] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-29T02:11:53.215309] [INFO ] [MAIN ] BLCO: Loaded 36110 primary data records. [2025-09-29T02:11:53.236362] [DEBUG] [LOCAL ] BKU: Derivative data saved (1820 records). [2025-09-29T02:11:53.267673] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-29T02:11:53.283912] [INFO ] [MAIN ] Derivative Progress: 276/2211 symbols completed. BKU took 1.2s. Estimated remaining: 13m 36s. Rate: 142.3 symbols/min [2025-09-29T02:11:53.312532] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:53.362973] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-29T02:11:53.363146] [INFO ] [MAIN ] BLD: Loaded 28408 primary data records. [2025-09-29T02:11:53.958315] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-29T02:11:53.960533] [INFO ] [MAIN ] BLDR: Loaded 52403 primary data records. [2025-09-29T02:11:54.121213] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:54.148921] [INFO ] [MAIN ] BLCO: Generated 1820 derivative records from 36110 primary records. [2025-09-29T02:11:54.308614] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-29T02:11:54.351017] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:54.354417] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1820 records). [2025-09-29T02:11:54.355926] [INFO ] [MAIN ] BLD: Generated 1820 derivative records from 28408 primary records. [2025-09-29T02:11:54.356047] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-29T02:11:54.359375] [INFO ] [MAIN ] Derivative Progress: 277/2211 symbols completed. BLCO took 1.2s. Estimated remaining: 13m 40s. Rate: 141.5 symbols/min [2025-09-29T02:11:54.359586] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-29T02:11:54.360416] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:54.379072] [DEBUG] [LOCAL ] BLD: Derivative data saved (1820 records). [2025-09-29T02:11:54.379717] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-29T02:11:54.382547] [INFO ] [MAIN ] Derivative Progress: 278/2211 symbols completed. BLD took 1.2s. Estimated remaining: 13m 37s. Rate: 142.0 symbols/min [2025-09-29T02:11:54.383192] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:54.416468] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-29T02:11:54.417237] [INFO ] [MAIN ] BLE: Loaded 14718 primary data records. [2025-09-29T02:11:54.416917] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:54.430428] [INFO ] [MAIN ] BLDR: Generated 1820 derivative records from 52403 primary records. [2025-09-29T02:11:54.465541] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-29T02:11:54.777442] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-29T02:11:54.793177] [INFO ] [MAIN ] BLK: Loaded 35240 primary data records. [2025-09-29T02:11:54.794219] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1820 records). [2025-09-29T02:11:54.807974] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-29T02:11:54.840991] [INFO ] [MAIN ] Derivative Progress: 279/2211 symbols completed. BLDR took 1.5s. Estimated remaining: 13m 36s. Rate: 142.0 symbols/min [2025-09-29T02:11:54.856129] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:55.214351] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:55.229462] [INFO ] [MAIN ] BLE: Generated 1820 derivative records from 14718 primary records. [2025-09-29T02:11:55.229706] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-29T02:11:55.246569] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-29T02:11:55.247365] [INFO ] [MAIN ] BLND: Loaded 50107 primary data records. [2025-09-29T02:11:55.265420] [DEBUG] [LOCAL ] BLE: Derivative data saved (1820 records). [2025-09-29T02:11:55.288130] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-29T02:11:55.330426] [INFO ] [MAIN ] Derivative Progress: 280/2211 symbols completed. BLE took 1.0s. Estimated remaining: 13m 36s. Rate: 141.9 symbols/min [2025-09-29T02:11:55.363004] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:55.486679] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:55.617934] [INFO ] [MAIN ] BLK: Generated 1820 derivative records from 35240 primary records. [2025-09-29T02:11:55.618326] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-29T02:11:55.618683] [INFO ] [MAIN ] BLW: Loaded 13044 primary data records. [2025-09-29T02:11:55.618606] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-29T02:11:55.726242] [DEBUG] [LOCAL ] BLK: Derivative data saved (1820 records). [2025-09-29T02:11:55.739732] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-29T02:11:55.755530] [INFO ] [MAIN ] Derivative Progress: 281/2211 symbols completed. BLK took 1.4s. Estimated remaining: 13m 36s. Rate: 141.9 symbols/min [2025-09-29T02:11:55.798913] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:55.991985] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-29T02:11:56.005480] [INFO ] [MAIN ] BLX: Loaded 15880 primary data records. [2025-09-29T02:11:56.011362] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:56.029934] [INFO ] [MAIN ] BLND: Generated 1820 derivative records from 50107 primary records. [2025-09-29T02:11:56.060442] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-29T02:11:56.163047] [DEBUG] [LOCAL ] BLND: Derivative data saved (1820 records). [2025-09-29T02:11:56.213618] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-29T02:11:56.329340] [INFO ] [MAIN ] Derivative Progress: 282/2211 symbols completed. BLND took 1.5s. Estimated remaining: 13m 37s. Rate: 141.7 symbols/min [2025-09-29T02:11:56.349734] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:56.370434] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:56.371318] [INFO ] [MAIN ] BLW: Generated 1820 derivative records from 13044 primary records. [2025-09-29T02:11:56.371958] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-29T02:11:56.410448] [DEBUG] [LOCAL ] BLW: Derivative data saved (1820 records). [2025-09-29T02:11:56.410834] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-29T02:11:56.414786] [INFO ] [MAIN ] Derivative Progress: 283/2211 symbols completed. BLW took 1.1s. Estimated remaining: 13m 34s. Rate: 142.1 symbols/min [2025-09-29T02:11:56.431357] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-29T02:11:56.444961] [INFO ] [MAIN ] BMA: Loaded 35645 primary data records. [2025-09-29T02:11:56.444682] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:56.451255] [INFO ] [MAIN ] BLX: Generated 1820 derivative records from 15880 primary records. [2025-09-29T02:11:56.492777] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-29T02:11:56.601715] [DEBUG] [LOCAL ] BLX: Derivative data saved (1820 records). [2025-09-29T02:11:56.628878] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-29T02:11:56.642480] [INFO ] [MAIN ] Derivative Progress: 284/2211 symbols completed. BLX took 0.8s. Estimated remaining: 13m 32s. Rate: 142.4 symbols/min [2025-09-29T02:11:56.816440] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:56.817250] [INFO ] [MAIN ] BMA: Generated 1820 derivative records from 35645 primary records. [2025-09-29T02:11:56.817340] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-29T02:11:56.833090] [DEBUG] [LOCAL ] BMA: Derivative data saved (1820 records). [2025-09-29T02:11:56.833198] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-29T02:11:56.835951] [INFO ] [MAIN ] Derivative Progress: 285/2211 symbols completed. BMA took 0.5s. Estimated remaining: 13m 30s. Rate: 142.6 symbols/min [2025-09-29T02:11:56.836571] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:56.836744] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:56.836684] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:56.865778] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-29T02:11:56.866105] [INFO ] [MAIN ] BME: Loaded 10968 primary data records. [2025-09-29T02:11:56.982226] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-29T02:11:56.996697] [INFO ] [MAIN ] BMI: Loaded 24611 primary data records. [2025-09-29T02:11:56.988341] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-29T02:11:57.021781] [INFO ] [MAIN ] BMEZ: Loaded 26421 primary data records. [2025-09-29T02:11:57.955416] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:57.957170] [INFO ] [MAIN ] BME: Generated 1820 derivative records from 10968 primary records. [2025-09-29T02:11:57.957802] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-29T02:11:57.981040] [DEBUG] [LOCAL ] BME: Derivative data saved (1820 records). [2025-09-29T02:11:57.983044] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-29T02:11:57.986446] [INFO ] [MAIN ] Derivative Progress: 286/2211 symbols completed. BME took 1.1s. Estimated remaining: 13m 35s. Rate: 141.8 symbols/min [2025-09-29T02:11:58.000333] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:58.001144] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:58.016051] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:58.018223] [INFO ] [MAIN ] BMEZ: Generated 1820 derivative records from 26421 primary records. [2025-09-29T02:11:58.016960] [INFO ] [MAIN ] BMI: Generated 1820 derivative records from 24611 primary records. [2025-09-29T02:11:58.018500] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-29T02:11:58.019515] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-29T02:11:58.043275] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-29T02:11:58.047874] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1820 records). [2025-09-29T02:11:58.052502] [INFO ] [MAIN ] BMN: Loaded 2548 primary data records. [2025-09-29T02:11:58.077890] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-29T02:11:58.081551] [INFO ] [MAIN ] Derivative Progress: 287/2211 symbols completed. BMEZ took 1.2s. Estimated remaining: 13m 32s. Rate: 142.2 symbols/min [2025-09-29T02:11:58.107978] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:58.114260] [DEBUG] [LOCAL ] BMI: Derivative data saved (1820 records). [2025-09-29T02:11:58.144738] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-29T02:11:58.153119] [INFO ] [MAIN ] Derivative Progress: 288/2211 symbols completed. BMI took 1.3s. Estimated remaining: 13m 29s. Rate: 142.6 symbols/min [2025-09-29T02:11:58.177228] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:58.422512] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-29T02:11:58.440165] [INFO ] [MAIN ] BMO: Loaded 41940 primary data records. [2025-09-29T02:11:58.597908] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:58.591156] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-29T02:11:58.619600] [INFO ] [MAIN ] BMN: Generated 1820 derivative records from 2548 primary records. [2025-09-29T02:11:58.644408] [INFO ] [MAIN ] BMY: Loaded 54537 primary data records. [2025-09-29T02:11:58.673122] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-29T02:11:58.880687] [DEBUG] [LOCAL ] BMN: Derivative data saved (1820 records). [2025-09-29T02:11:58.919589] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-29T02:11:58.947827] [INFO ] [MAIN ] Derivative Progress: 289/2211 symbols completed. BMN took 0.9s. Estimated remaining: 13m 31s. Rate: 142.1 symbols/min [2025-09-29T02:11:58.976675] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:59.209396] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:59.210982] [INFO ] [MAIN ] BMO: Generated 1820 derivative records from 41940 primary records. [2025-09-29T02:11:59.211165] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-29T02:11:59.230969] [DEBUG] [LOCAL ] BMO: Derivative data saved (1820 records). [2025-09-29T02:11:59.231369] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-29T02:11:59.234294] [INFO ] [MAIN ] Derivative Progress: 290/2211 symbols completed. BMO took 1.1s. Estimated remaining: 13m 30s. Rate: 142.3 symbols/min [2025-09-29T02:11:59.249876] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:59.271242] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:59.273162] [INFO ] [MAIN ] BMY: Generated 1820 derivative records from 54537 primary records. [2025-09-29T02:11:59.288325] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-29T02:11:59.291795] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-29T02:11:59.299772] [INFO ] [MAIN ] BN: Loaded 53774 primary data records. [2025-09-29T02:11:59.320840] [DEBUG] [LOCAL ] BMY: Derivative data saved (1820 records). [2025-09-29T02:11:59.353428] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-29T02:11:59.383711] [INFO ] [MAIN ] Derivative Progress: 291/2211 symbols completed. BMY took 1.2s. Estimated remaining: 13m 28s. Rate: 142.6 symbols/min [2025-09-29T02:11:59.413769] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:59.463991] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-29T02:11:59.469517] [INFO ] [MAIN ] BNED: Loaded 30226 primary data records. [2025-09-29T02:11:59.608219] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-29T02:11:59.788340] [INFO ] [MAIN ] BNH: Loaded 4926 primary data records. [2025-09-29T02:12:00.400581] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:00.401675] [INFO ] [MAIN ] BN: Generated 1820 derivative records from 53774 primary records. [2025-09-29T02:12:00.402457] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-29T02:12:00.424127] [DEBUG] [LOCAL ] BN: Derivative data saved (1820 records). [2025-09-29T02:12:00.427427] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-29T02:12:00.431291] [INFO ] [MAIN ] Derivative Progress: 292/2211 symbols completed. BN took 1.5s. Estimated remaining: 13m 32s. Rate: 141.9 symbols/min [2025-09-29T02:12:00.431932] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:00.445514] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:00.448445] [INFO ] [MAIN ] BNED: Generated 1820 derivative records from 30226 primary records. [2025-09-29T02:12:00.449718] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-29T02:12:00.464916] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:00.478776] [INFO ] [MAIN ] BNH: Generated 1820 derivative records from 4926 primary records. [2025-09-29T02:12:00.479063] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-29T02:12:00.481685] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-29T02:12:00.482080] [INFO ] [MAIN ] BNJ: Loaded 2631 primary data records. [2025-09-29T02:12:00.573553] [DEBUG] [LOCAL ] BNH: Derivative data saved (1820 records). [2025-09-29T02:12:00.591865] [DEBUG] [LOCAL ] BNED: Derivative data saved (1820 records). [2025-09-29T02:12:00.592131] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-29T02:12:00.592280] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-29T02:12:00.607637] [INFO ] [MAIN ] Derivative Progress: 293/2211 symbols completed. BNH took 1.2s. Estimated remaining: 13m 30s. Rate: 142.2 symbols/min [2025-09-29T02:12:00.623802] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:00.624541] [INFO ] [MAIN ] Derivative Progress: 294/2211 symbols completed. BNED took 1.4s. Estimated remaining: 13m 26s. Rate: 142.6 symbols/min [2025-09-29T02:12:00.640794] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:00.877596] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:00.880498] [INFO ] [MAIN ] BNJ: Generated 1820 derivative records from 2631 primary records. [2025-09-29T02:12:00.912438] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-29T02:12:00.912681] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-29T02:12:00.912866] [INFO ] [MAIN ] BNL: Loaded 47577 primary data records. [2025-09-29T02:12:01.049970] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-29T02:12:01.077196] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1820 records). [2025-09-29T02:12:01.077482] [INFO ] [MAIN ] BNS: Loaded 52212 primary data records. [2025-09-29T02:12:01.077873] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-29T02:12:01.116272] [INFO ] [MAIN ] Derivative Progress: 295/2211 symbols completed. BNJ took 0.7s. Estimated remaining: 13m 26s. Rate: 142.5 symbols/min [2025-09-29T02:12:01.151065] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:01.503913] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-29T02:12:01.530973] [INFO ] [MAIN ] BNT: Loaded 3473 primary data records. [2025-09-29T02:12:01.770268] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:01.771401] [INFO ] [MAIN ] BNL: Generated 1820 derivative records from 47577 primary records. [2025-09-29T02:12:01.771512] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-29T02:12:01.838076] [DEBUG] [LOCAL ] BNL: Derivative data saved (1820 records). [2025-09-29T02:12:01.846748] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-29T02:12:01.852095] [INFO ] [MAIN ] Derivative Progress: 296/2211 symbols completed. BNL took 1.2s. Estimated remaining: 13m 28s. Rate: 142.2 symbols/min [2025-09-29T02:12:01.857863] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:02.182768] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-29T02:12:02.208225] [INFO ] [MAIN ] BNY: Loaded 7446 primary data records. [2025-09-29T02:12:02.785103] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:02.788033] [INFO ] [MAIN ] BNS: Generated 1820 derivative records from 52212 primary records. [2025-09-29T02:12:02.788581] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-29T02:12:02.820131] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:02.824040] [INFO ] [MAIN ] BNT: Generated 1820 derivative records from 3473 primary records. [2025-09-29T02:12:02.825233] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-29T02:12:02.826748] [DEBUG] [LOCAL ] BNS: Derivative data saved (1820 records). [2025-09-29T02:12:02.828170] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-29T02:12:02.830971] [INFO ] [MAIN ] Derivative Progress: 297/2211 symbols completed. BNS took 2.2s. Estimated remaining: 13m 31s. Rate: 141.6 symbols/min [2025-09-29T02:12:02.831317] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:02.847375] [DEBUG] [LOCAL ] BNT: Derivative data saved (1820 records). [2025-09-29T02:12:02.847616] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-29T02:12:02.851869] [INFO ] [MAIN ] Derivative Progress: 298/2211 symbols completed. BNT took 1.7s. Estimated remaining: 13m 28s. Rate: 142.0 symbols/min [2025-09-29T02:12:02.867148] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:02.867969] [INFO ] [MAIN ] BNY: Generated 1820 derivative records from 7446 primary records. [2025-09-29T02:12:02.868059] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-29T02:12:02.890929] [DEBUG] [LOCAL ] BNY: Derivative data saved (1820 records). [2025-09-29T02:12:02.891173] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-29T02:12:02.893896] [INFO ] [MAIN ] Derivative Progress: 299/2211 symbols completed. BNY took 1.0s. Estimated remaining: 13m 25s. Rate: 142.4 symbols/min [2025-09-29T02:12:02.901827] [DEBUG] [LOCAL ] BOC: Loaded 18626 existing records from primary storage. [2025-09-29T02:12:02.901992] [INFO ] [MAIN ] BOC: Loaded 18626 primary data records. [2025-09-29T02:12:03.239112] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:03.239901] [INFO ] [MAIN ] BOC: Generated 1820 derivative records from 18626 primary records. [2025-09-29T02:12:03.239989] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-29T02:12:03.256300] [DEBUG] [LOCAL ] BOC: Derivative data saved (1820 records). [2025-09-29T02:12:03.256450] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-29T02:12:03.259190] [INFO ] [MAIN ] Derivative Progress: 300/2211 symbols completed. BOC took 0.4s. Estimated remaining: 13m 25s. Rate: 142.5 symbols/min [2025-09-29T02:12:03.260014] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:03.259874] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:03.260682] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:03.292796] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-29T02:12:03.293157] [INFO ] [MAIN ] BOE: Loaded 17816 primary data records. [2025-09-29T02:12:03.399792] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-29T02:12:03.436426] [INFO ] [MAIN ] BOND: Loaded 32554 primary data records. [2025-09-29T02:12:03.443421] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-29T02:12:03.477072] [INFO ] [MAIN ] BOH: Loaded 31676 primary data records. [2025-09-29T02:12:04.445103] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:04.447721] [INFO ] [MAIN ] BOE: Generated 1820 derivative records from 17816 primary records. [2025-09-29T02:12:04.449573] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-29T02:12:04.482506] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:04.483432] [INFO ] [MAIN ] BOND: Generated 1820 derivative records from 32554 primary records. [2025-09-29T02:12:04.481911] [DEBUG] [LOCAL ] BOE: Derivative data saved (1820 records). [2025-09-29T02:12:04.483591] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-29T02:12:04.483722] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-29T02:12:04.486928] [INFO ] [MAIN ] Derivative Progress: 301/2211 symbols completed. BOE took 1.2s. Estimated remaining: 13m 29s. Rate: 141.6 symbols/min [2025-09-29T02:12:04.487184] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:04.519277] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:04.521568] [INFO ] [MAIN ] BOH: Generated 1820 derivative records from 31676 primary records. [2025-09-29T02:12:04.522494] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-29T02:12:04.536899] [DEBUG] [LOCAL ] BOND: Derivative data saved (1820 records). [2025-09-29T02:12:04.540211] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-29T02:12:04.543858] [INFO ] [MAIN ] Derivative Progress: 302/2211 symbols completed. BOND took 1.3s. Estimated remaining: 13m 27s. Rate: 142.0 symbols/min [2025-09-29T02:12:04.544946] [DEBUG] [LOCAL ] BOH: Derivative data saved (1820 records). [2025-09-29T02:12:04.544840] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:04.545203] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-29T02:12:04.549252] [INFO ] [MAIN ] Derivative Progress: 303/2211 symbols completed. BOH took 1.3s. Estimated remaining: 13m 24s. Rate: 142.5 symbols/min [2025-09-29T02:12:04.549771] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:04.583700] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-29T02:12:04.584142] [INFO ] [MAIN ] BOOT: Loaded 41409 primary data records. [2025-09-29T02:12:04.739553] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-29T02:12:04.750512] [INFO ] [MAIN ] BOW: Loaded 23974 primary data records. [2025-09-29T02:12:05.060139] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-29T02:12:05.078068] [INFO ] [MAIN ] BORR: Loaded 51902 primary data records. [2025-09-29T02:12:05.678362] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:05.679768] [INFO ] [MAIN ] BOOT: Generated 1820 derivative records from 41409 primary records. [2025-09-29T02:12:05.680040] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-29T02:12:05.700394] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1820 records). [2025-09-29T02:12:05.700975] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-29T02:12:05.705063] [INFO ] [MAIN ] Derivative Progress: 304/2211 symbols completed. BOOT took 1.2s. Estimated remaining: 13m 28s. Rate: 141.7 symbols/min [2025-09-29T02:12:05.705548] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:05.725863] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:05.727564] [INFO ] [MAIN ] BOW: Generated 1820 derivative records from 23974 primary records. [2025-09-29T02:12:05.728690] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-29T02:12:05.753525] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:05.759342] [INFO ] [MAIN ] BORR: Generated 1820 derivative records from 51902 primary records. [2025-09-29T02:12:05.763027] [DEBUG] [LOCAL ] BOW: Derivative data saved (1820 records). [2025-09-29T02:12:05.763265] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-29T02:12:05.764312] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-29T02:12:05.767163] [INFO ] [MAIN ] Derivative Progress: 305/2211 symbols completed. BOW took 1.2s. Estimated remaining: 13m 25s. Rate: 142.1 symbols/min [2025-09-29T02:12:05.780744] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:05.785265] [DEBUG] [LOCAL ] BORR: Derivative data saved (1820 records). [2025-09-29T02:12:05.785584] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-29T02:12:05.788894] [INFO ] [MAIN ] Derivative Progress: 306/2211 symbols completed. BORR took 1.2s. Estimated remaining: 13m 22s. Rate: 142.5 symbols/min [2025-09-29T02:12:05.789378] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:05.832406] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-29T02:12:05.832674] [INFO ] [MAIN ] BOX: Loaded 51017 primary data records. [2025-09-29T02:12:06.049819] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-29T02:12:06.076955] [INFO ] [MAIN ] BR: Loaded 35251 primary data records. [2025-09-29T02:12:06.364485] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-29T02:12:06.378161] [INFO ] [MAIN ] BP: Loaded 54491 primary data records. [2025-09-29T02:12:06.955930] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:06.957169] [INFO ] [MAIN ] BOX: Generated 1820 derivative records from 51017 primary records. [2025-09-29T02:12:06.958613] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-29T02:12:06.981683] [DEBUG] [LOCAL ] BOX: Derivative data saved (1820 records). [2025-09-29T02:12:06.994419] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-29T02:12:06.997958] [INFO ] [MAIN ] Derivative Progress: 307/2211 symbols completed. BOX took 1.3s. Estimated remaining: 13m 27s. Rate: 141.6 symbols/min [2025-09-29T02:12:06.998260] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:07.000016] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:07.001379] [INFO ] [MAIN ] BR: Generated 1820 derivative records from 35251 primary records. [2025-09-29T02:12:07.001634] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-29T02:12:07.019926] [DEBUG] [LOCAL ] BR: Derivative data saved (1820 records). [2025-09-29T02:12:07.020127] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-29T02:12:07.023208] [INFO ] [MAIN ] Derivative Progress: 308/2211 symbols completed. BR took 1.2s. Estimated remaining: 13m 24s. Rate: 142.1 symbols/min [2025-09-29T02:12:07.023514] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:07.040212] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:07.041033] [INFO ] [MAIN ] BP: Generated 1820 derivative records from 54491 primary records. [2025-09-29T02:12:07.041208] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-29T02:12:07.063946] [DEBUG] [LOCAL ] BP: Derivative data saved (1820 records). [2025-09-29T02:12:07.064116] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-29T02:12:07.068269] [INFO ] [MAIN ] Derivative Progress: 309/2211 symbols completed. BP took 1.3s. Estimated remaining: 13m 21s. Rate: 142.5 symbols/min [2025-09-29T02:12:07.068556] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:07.091718] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-29T02:12:07.091996] [INFO ] [MAIN ] BRC: Loaded 19567 primary data records. [2025-09-29T02:12:07.261487] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-29T02:12:07.314619] [INFO ] [MAIN ] BRBR: Loaded 51987 primary data records. [2025-09-29T02:12:07.458951] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-29T02:12:07.496399] [INFO ] [MAIN ] BRCC: Loaded 40896 primary data records. [2025-09-29T02:12:08.144081] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:08.145395] [INFO ] [MAIN ] BRC: Generated 1820 derivative records from 19567 primary records. [2025-09-29T02:12:08.146292] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-29T02:12:08.165332] [DEBUG] [LOCAL ] BRC: Derivative data saved (1820 records). [2025-09-29T02:12:08.166927] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-29T02:12:08.169981] [INFO ] [MAIN ] Derivative Progress: 310/2211 symbols completed. BRC took 1.1s. Estimated remaining: 13m 25s. Rate: 141.7 symbols/min [2025-09-29T02:12:08.170354] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:08.191253] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:08.194130] [INFO ] [MAIN ] BRBR: Generated 1820 derivative records from 51987 primary records. [2025-09-29T02:12:08.195249] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-29T02:12:08.217876] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:08.222767] [INFO ] [MAIN ] BRCC: Generated 1820 derivative records from 40896 primary records. [2025-09-29T02:12:08.222928] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-29T02:12:08.240274] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1820 records). [2025-09-29T02:12:08.241834] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-29T02:12:08.244448] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1820 records). [2025-09-29T02:12:08.247447] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-29T02:12:08.247313] [INFO ] [MAIN ] Derivative Progress: 311/2211 symbols completed. BRBR took 1.2s. Estimated remaining: 13m 22s. Rate: 142.1 symbols/min [2025-09-29T02:12:08.251178] [INFO ] [MAIN ] Derivative Progress: 312/2211 symbols completed. BRCC took 1.2s. Estimated remaining: 13m 19s. Rate: 142.6 symbols/min [2025-09-29T02:12:08.251081] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:08.251626] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:08.307481] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-29T02:12:08.308042] [INFO ] [MAIN ] BRO: Loaded 52664 primary data records. [2025-09-29T02:12:08.481199] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-29T02:12:08.486536] [INFO ] [MAIN ] BRSP: Loaded 37442 primary data records. [2025-09-29T02:12:08.590549] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-29T02:12:08.808503] [INFO ] [MAIN ] BROS: Loaded 54067 primary data records. [2025-09-29T02:12:09.419946] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:09.421343] [INFO ] [MAIN ] BRO: Generated 1820 derivative records from 52664 primary records. [2025-09-29T02:12:09.422508] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-29T02:12:09.453948] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:09.455606] [INFO ] [MAIN ] BRSP: Generated 1820 derivative records from 37442 primary records. [2025-09-29T02:12:09.455787] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-29T02:12:09.458457] [DEBUG] [LOCAL ] BRO: Derivative data saved (1820 records). [2025-09-29T02:12:09.459718] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-29T02:12:09.463771] [INFO ] [MAIN ] Derivative Progress: 313/2211 symbols completed. BRO took 1.3s. Estimated remaining: 13m 24s. Rate: 141.7 symbols/min [2025-09-29T02:12:09.483005] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1820 records). [2025-09-29T02:12:09.483208] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-29T02:12:09.486218] [INFO ] [MAIN ] Derivative Progress: 314/2211 symbols completed. BRSP took 1.2s. Estimated remaining: 13m 21s. Rate: 142.1 symbols/min [2025-09-29T02:12:09.499911] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:09.500680] [INFO ] [MAIN ] BROS: Generated 1820 derivative records from 54067 primary records. [2025-09-29T02:12:09.500769] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-29T02:12:09.516752] [DEBUG] [LOCAL ] BROS: Derivative data saved (1820 records). [2025-09-29T02:12:09.516866] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-29T02:12:09.520238] [INFO ] [MAIN ] Derivative Progress: 315/2211 symbols completed. BROS took 1.3s. Estimated remaining: 13m 18s. Rate: 142.6 symbols/min [2025-09-29T02:12:09.520910] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:09.520991] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:09.521361] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:09.533914] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-29T02:12:09.534113] [INFO ] [MAIN ] BRT: Loaded 5034 primary data records. [2025-09-29T02:12:09.654353] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-29T02:12:09.667173] [INFO ] [MAIN ] BRW: Loaded 19862 primary data records. [2025-09-29T02:12:10.060882] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-29T02:12:10.095871] [INFO ] [MAIN ] BRX: Loaded 52462 primary data records. [2025-09-29T02:12:10.715011] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:10.714140] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:10.717602] [INFO ] [MAIN ] BRT: Generated 1820 derivative records from 5034 primary records. [2025-09-29T02:12:10.718587] [INFO ] [MAIN ] BRW: Generated 1820 derivative records from 19862 primary records. [2025-09-29T02:12:10.718959] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-29T02:12:10.719504] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-29T02:12:10.752983] [DEBUG] [LOCAL ] BRT: Derivative data saved (1820 records). [2025-09-29T02:12:10.754970] [DEBUG] [LOCAL ] BRW: Derivative data saved (1820 records). [2025-09-29T02:12:10.755476] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-29T02:12:10.755685] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-29T02:12:10.758783] [INFO ] [MAIN ] Derivative Progress: 316/2211 symbols completed. BRW took 1.2s. Estimated remaining: 13m 22s. Rate: 141.7 symbols/min [2025-09-29T02:12:10.762323] [INFO ] [MAIN ] Derivative Progress: 317/2211 symbols completed. BRT took 1.2s. Estimated remaining: 13m 20s. Rate: 142.1 symbols/min [2025-09-29T02:12:10.759225] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:10.762972] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:10.780878] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:10.781694] [INFO ] [MAIN ] BRX: Generated 1820 derivative records from 52462 primary records. [2025-09-29T02:12:10.781814] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-29T02:12:10.799421] [DEBUG] [LOCAL ] BRX: Derivative data saved (1820 records). [2025-09-29T02:12:10.799774] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-29T02:12:10.802891] [INFO ] [MAIN ] Derivative Progress: 318/2211 symbols completed. BRX took 1.3s. Estimated remaining: 13m 17s. Rate: 142.5 symbols/min [2025-09-29T02:12:10.811983] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:10.855299] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-29T02:12:10.862066] [INFO ] [MAIN ] BSBR: Loaded 35731 primary data records. [2025-09-29T02:12:10.861951] [DEBUG] [LOCAL ] BSL: Loaded 8196 existing records from primary storage. [2025-09-29T02:12:10.861450] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-29T02:12:10.862442] [INFO ] [MAIN ] BSL: Loaded 8196 primary data records. [2025-09-29T02:12:10.862715] [INFO ] [MAIN ] BSAC: Loaded 33389 primary data records. [2025-09-29T02:12:11.903339] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:11.931409] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:11.930478] [INFO ] [MAIN ] BSL: Generated 1820 derivative records from 8196 primary records. [2025-09-29T02:12:11.932244] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-29T02:12:11.933242] [INFO ] [MAIN ] BSBR: Generated 1820 derivative records from 35731 primary records. [2025-09-29T02:12:11.932112] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:11.934202] [INFO ] [MAIN ] BSAC: Generated 1820 derivative records from 33389 primary records. [2025-09-29T02:12:11.934279] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-29T02:12:11.934395] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-29T02:12:11.985410] [DEBUG] [LOCAL ] BSL: Derivative data saved (1820 records). [2025-09-29T02:12:11.986155] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1820 records). [2025-09-29T02:12:11.987735] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-29T02:12:11.988274] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-29T02:12:11.987609] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1820 records). [2025-09-29T02:12:11.991088] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-29T02:12:11.990885] [INFO ] [MAIN ] Derivative Progress: 319/2211 symbols completed. BSBR took 1.2s. Estimated remaining: 13m 21s. Rate: 141.7 symbols/min [2025-09-29T02:12:11.997905] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:11.998171] [INFO ] [MAIN ] Derivative Progress: 320/2211 symbols completed. BSL took 1.2s. Estimated remaining: 13m 18s. Rate: 142.2 symbols/min [2025-09-29T02:12:11.998738] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:11.998978] [INFO ] [MAIN ] Derivative Progress: 321/2211 symbols completed. BSAC took 1.2s. Estimated remaining: 13m 15s. Rate: 142.6 symbols/min [2025-09-29T02:12:11.999525] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:12.035491] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-29T02:12:12.045240] [INFO ] [MAIN ] BST: Loaded 19385 primary data records. [2025-09-29T02:12:12.067261] [DEBUG] [LOCAL ] BSTZ: Loaded 25188 existing records from primary storage. [2025-09-29T02:12:12.096620] [INFO ] [MAIN ] BSTZ: Loaded 25188 primary data records. [2025-09-29T02:12:12.218737] [DEBUG] [LOCAL ] BSM: Loaded 32809 existing records from primary storage. [2025-09-29T02:12:12.248247] [INFO ] [MAIN ] BSM: Loaded 32809 primary data records. [2025-09-29T02:12:13.165978] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:13.167317] [INFO ] [MAIN ] BST: Generated 1820 derivative records from 19385 primary records. [2025-09-29T02:12:13.167626] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-29T02:12:13.188540] [DEBUG] [LOCAL ] BST: Derivative data saved (1820 records). [2025-09-29T02:12:13.190831] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-29T02:12:13.195292] [INFO ] [MAIN ] Derivative Progress: 322/2211 symbols completed. BST took 1.2s. Estimated remaining: 13m 19s. Rate: 141.8 symbols/min [2025-09-29T02:12:13.196040] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:13.210671] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:13.213587] [INFO ] [MAIN ] BSTZ: Generated 1820 derivative records from 25188 primary records. [2025-09-29T02:12:13.215488] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-29T02:12:13.237798] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:13.244254] [INFO ] [MAIN ] BSM: Generated 1820 derivative records from 32809 primary records. [2025-09-29T02:12:13.245235] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-29T02:12:13.262915] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1820 records). [2025-09-29T02:12:13.263821] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-29T02:12:13.268625] [INFO ] [MAIN ] Derivative Progress: 323/2211 symbols completed. BSTZ took 1.3s. Estimated remaining: 13m 17s. Rate: 142.2 symbols/min [2025-09-29T02:12:13.269170] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:13.273487] [DEBUG] [LOCAL ] BSM: Derivative data saved (1820 records). [2025-09-29T02:12:13.274016] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-29T02:12:13.277208] [INFO ] [MAIN ] Derivative Progress: 324/2211 symbols completed. BSM took 1.3s. Estimated remaining: 13m 14s. Rate: 142.6 symbols/min [2025-09-29T02:12:13.277484] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:13.298973] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-29T02:12:13.299176] [INFO ] [MAIN ] BTA: Loaded 5464 primary data records. [2025-09-29T02:12:13.440726] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-29T02:12:13.457821] [INFO ] [MAIN ] BSX: Loaded 54468 primary data records. [2025-09-29T02:12:13.500439] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-29T02:12:13.556098] [INFO ] [MAIN ] BTCM: Loaded 15122 primary data records. [2025-09-29T02:12:14.370194] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:14.371992] [INFO ] [MAIN ] BTA: Generated 1820 derivative records from 5464 primary records. [2025-09-29T02:12:14.372423] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-29T02:12:14.394871] [DEBUG] [LOCAL ] BTA: Derivative data saved (1820 records). [2025-09-29T02:12:14.397082] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-29T02:12:14.401270] [INFO ] [MAIN ] Derivative Progress: 325/2211 symbols completed. BTA took 1.1s. Estimated remaining: 13m 18s. Rate: 141.9 symbols/min [2025-09-29T02:12:14.415267] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:14.415786] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:14.417405] [INFO ] [MAIN ] BSX: Generated 1820 derivative records from 54468 primary records. [2025-09-29T02:12:14.417800] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-29T02:12:14.456128] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:14.456333] [DEBUG] [LOCAL ] BSX: Derivative data saved (1820 records). [2025-09-29T02:12:14.456714] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-29T02:12:14.460729] [INFO ] [MAIN ] Derivative Progress: 326/2211 symbols completed. BSX took 1.3s. Estimated remaining: 13m 15s. Rate: 142.2 symbols/min [2025-09-29T02:12:14.461734] [INFO ] [MAIN ] BTCM: Generated 1820 derivative records from 15122 primary records. [2025-09-29T02:12:14.461920] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:14.462133] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-29T02:12:14.479373] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1820 records). [2025-09-29T02:12:14.479578] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-29T02:12:14.482831] [INFO ] [MAIN ] Derivative Progress: 327/2211 symbols completed. BTCM took 1.2s. Estimated remaining: 13m 12s. Rate: 142.6 symbols/min [2025-09-29T02:12:14.483599] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:14.513783] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-29T02:12:14.517975] [INFO ] [MAIN ] BTO: Loaded 8982 primary data records. [2025-09-29T02:12:14.585796] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-29T02:12:14.591295] [INFO ] [MAIN ] BTE: Loaded 53505 primary data records. [2025-09-29T02:12:14.810495] [DEBUG] [LOCAL ] BTI: Loaded 54335 existing records from primary storage. [2025-09-29T02:12:14.874697] [INFO ] [MAIN ] BTI: Loaded 54335 primary data records. [2025-09-29T02:12:15.682065] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:15.684239] [INFO ] [MAIN ] BTO: Generated 1820 derivative records from 8982 primary records. [2025-09-29T02:12:15.686352] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-29T02:12:15.715912] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:15.729182] [INFO ] [MAIN ] BTE: Generated 1820 derivative records from 53505 primary records. [2025-09-29T02:12:15.727497] [DEBUG] [LOCAL ] BTO: Derivative data saved (1820 records). [2025-09-29T02:12:15.730774] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-29T02:12:15.730933] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-29T02:12:15.735405] [INFO ] [MAIN ] Derivative Progress: 328/2211 symbols completed. BTO took 1.3s. Estimated remaining: 13m 17s. Rate: 141.8 symbols/min [2025-09-29T02:12:15.769692] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:15.771328] [INFO ] [MAIN ] BTI: Generated 1820 derivative records from 54335 primary records. [2025-09-29T02:12:15.773203] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-29T02:12:15.786615] [DEBUG] [LOCAL ] BTE: Derivative data saved (1820 records). [2025-09-29T02:12:15.789623] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-29T02:12:15.794165] [INFO ] [MAIN ] Derivative Progress: 329/2211 symbols completed. BTE took 1.4s. Estimated remaining: 13m 14s. Rate: 142.2 symbols/min [2025-09-29T02:12:15.798425] [DEBUG] [LOCAL ] BTI: Derivative data saved (1820 records). [2025-09-29T02:12:15.798515] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-29T02:12:15.802357] [INFO ] [MAIN ] Derivative Progress: 330/2211 symbols completed. BTI took 1.3s. Estimated remaining: 13m 11s. Rate: 142.6 symbols/min [2025-09-29T02:12:15.802903] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:15.802984] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:15.803035] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:15.824379] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-29T02:12:15.824799] [INFO ] [MAIN ] BTT: Loaded 16126 primary data records. [2025-09-29T02:12:15.978362] [DEBUG] [LOCAL ] BTZ: Loaded 23002 existing records from primary storage. [2025-09-29T02:12:15.989670] [INFO ] [MAIN ] BTZ: Loaded 23002 primary data records. [2025-09-29T02:12:16.259003] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-29T02:12:16.273835] [INFO ] [MAIN ] BTU: Loaded 54082 primary data records. [2025-09-29T02:12:16.911525] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:16.913262] [INFO ] [MAIN ] BTT: Generated 1820 derivative records from 16126 primary records. [2025-09-29T02:12:16.913673] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-29T02:12:16.933226] [DEBUG] [LOCAL ] BTT: Derivative data saved (1820 records). [2025-09-29T02:12:16.934582] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-29T02:12:16.939117] [INFO ] [MAIN ] Derivative Progress: 331/2211 symbols completed. BTT took 1.1s. Estimated remaining: 13m 15s. Rate: 141.9 symbols/min [2025-09-29T02:12:16.939959] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:16.954534] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:16.955593] [INFO ] [MAIN ] BTZ: Generated 1820 derivative records from 23002 primary records. [2025-09-29T02:12:16.955888] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-29T02:12:16.987096] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:16.990197] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1820 records). [2025-09-29T02:12:16.991306] [INFO ] [MAIN ] BTU: Generated 1820 derivative records from 54082 primary records. [2025-09-29T02:12:16.991421] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-29T02:12:16.991457] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-29T02:12:16.995260] [INFO ] [MAIN ] Derivative Progress: 332/2211 symbols completed. BTZ took 1.2s. Estimated remaining: 13m 13s. Rate: 142.2 symbols/min [2025-09-29T02:12:17.003339] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:17.012920] [DEBUG] [LOCAL ] BTU: Derivative data saved (1820 records). [2025-09-29T02:12:17.013049] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-29T02:12:17.016022] [INFO ] [MAIN ] Derivative Progress: 333/2211 symbols completed. BTU took 1.2s. Estimated remaining: 13m 10s. Rate: 142.6 symbols/min [2025-09-29T02:12:17.016277] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:17.044502] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-29T02:12:17.044701] [INFO ] [MAIN ] BUI: Loaded 11615 primary data records. [2025-09-29T02:12:17.186031] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-29T02:12:17.191218] [INFO ] [MAIN ] BUD: Loaded 53504 primary data records. [2025-09-29T02:12:17.576807] [DEBUG] [LOCAL ] BUR: Loaded 45700 existing records from primary storage. [2025-09-29T02:12:17.594151] [INFO ] [MAIN ] BUR: Loaded 45700 primary data records. [2025-09-29T02:12:18.153178] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:18.154360] [INFO ] [MAIN ] BUI: Generated 1820 derivative records from 11615 primary records. [2025-09-29T02:12:18.154621] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-29T02:12:18.174145] [DEBUG] [LOCAL ] BUI: Derivative data saved (1820 records). [2025-09-29T02:12:18.178385] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-29T02:12:18.181832] [INFO ] [MAIN ] Derivative Progress: 334/2211 symbols completed. BUI took 1.2s. Estimated remaining: 13m 14s. Rate: 141.9 symbols/min [2025-09-29T02:12:18.182388] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:18.197783] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:18.198902] [INFO ] [MAIN ] BUD: Generated 1820 derivative records from 53504 primary records. [2025-09-29T02:12:18.199298] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-29T02:12:18.221093] [DEBUG] [LOCAL ] BUD: Derivative data saved (1820 records). [2025-09-29T02:12:18.221376] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-29T02:12:18.225584] [INFO ] [MAIN ] Derivative Progress: 335/2211 symbols completed. BUD took 1.3s. Estimated remaining: 13m 11s. Rate: 142.3 symbols/min [2025-09-29T02:12:18.239026] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:18.239347] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:18.240967] [INFO ] [MAIN ] BUR: Generated 1820 derivative records from 45700 primary records. [2025-09-29T02:12:18.241191] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-29T02:12:18.270391] [DEBUG] [LOCAL ] BUR: Derivative data saved (1820 records). [2025-09-29T02:12:18.270802] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-29T02:12:18.274866] [INFO ] [MAIN ] Derivative Progress: 336/2211 symbols completed. BUR took 1.3s. Estimated remaining: 13m 9s. Rate: 142.6 symbols/min [2025-09-29T02:12:18.279022] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:18.289412] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-29T02:12:18.302026] [INFO ] [MAIN ] BUXX: Loaded 15364 primary data records. [2025-09-29T02:12:18.328687] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-29T02:12:18.352413] [INFO ] [MAIN ] BURL: Loaded 46896 primary data records. [2025-09-29T02:12:18.687459] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-29T02:12:18.856515] [INFO ] [MAIN ] BV: Loaded 39048 primary data records. [2025-09-29T02:12:19.442320] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:19.442001] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:12:19.445518] [INFO ] [MAIN ] BURL: Generated 1820 derivative records from 46896 primary records. [2025-09-29T02:12:19.445986] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-29T02:12:19.444457] [INFO ] [MAIN ] BUXX: Generated 1819 derivative records from 15364 primary records. [2025-09-29T02:12:19.447248] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-29T02:12:19.477774] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1819 records). [2025-09-29T02:12:19.481594] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-29T02:12:19.483370] [DEBUG] [LOCAL ] BURL: Derivative data saved (1820 records). [2025-09-29T02:12:19.483559] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-29T02:12:19.486942] [INFO ] [MAIN ] Derivative Progress: 337/2211 symbols completed. BUXX took 1.2s. Estimated remaining: 13m 13s. Rate: 141.9 symbols/min [2025-09-29T02:12:19.487392] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:19.491953] [INFO ] [MAIN ] Derivative Progress: 338/2211 symbols completed. BURL took 1.3s. Estimated remaining: 13m 10s. Rate: 142.3 symbols/min [2025-09-29T02:12:19.492338] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:19.510629] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:19.511666] [INFO ] [MAIN ] BV: Generated 1820 derivative records from 39048 primary records. [2025-09-29T02:12:19.511772] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-29T02:12:19.535505] [DEBUG] [LOCAL ] BV: Derivative data saved (1820 records). [2025-09-29T02:12:19.535767] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-29T02:12:19.539489] [INFO ] [MAIN ] Derivative Progress: 339/2211 symbols completed. BV took 1.3s. Estimated remaining: 13m 7s. Rate: 142.6 symbols/min [2025-09-29T02:12:19.539914] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:19.600188] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-29T02:12:19.601687] [INFO ] [MAIN ] BVN: Loaded 44520 primary data records. [2025-09-29T02:12:19.601357] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-29T02:12:19.601852] [INFO ] [MAIN ] BW: Loaded 40297 primary data records. [2025-09-29T02:12:19.835274] [DEBUG] [LOCAL ] BWA: Loaded 52976 existing records from primary storage. [2025-09-29T02:12:19.905310] [INFO ] [MAIN ] BWA: Loaded 52976 primary data records. [2025-09-29T02:12:20.698334] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:20.712034] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:20.713115] [INFO ] [MAIN ] BVN: Generated 1820 derivative records from 44520 primary records. [2025-09-29T02:12:20.713415] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-29T02:12:20.715210] [INFO ] [MAIN ] BW: Generated 1820 derivative records from 40297 primary records. [2025-09-29T02:12:20.715414] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-29T02:12:20.750140] [DEBUG] [LOCAL ] BW: Derivative data saved (1820 records). [2025-09-29T02:12:20.751562] [DEBUG] [LOCAL ] BVN: Derivative data saved (1820 records). [2025-09-29T02:12:20.765349] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:20.764574] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-29T02:12:20.766709] [INFO ] [MAIN ] BWA: Generated 1820 derivative records from 52976 primary records. [2025-09-29T02:12:20.765705] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-29T02:12:20.769832] [INFO ] [MAIN ] Derivative Progress: 340/2211 symbols completed. BW took 1.3s. Estimated remaining: 13m 11s. Rate: 141.8 symbols/min [2025-09-29T02:12:20.770371] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:20.773591] [INFO ] [MAIN ] Derivative Progress: 341/2211 symbols completed. BVN took 1.3s. Estimated remaining: 13m 9s. Rate: 142.3 symbols/min [2025-09-29T02:12:20.770123] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-29T02:12:20.774008] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:20.794665] [DEBUG] [LOCAL ] BWA: Derivative data saved (1820 records). [2025-09-29T02:12:20.794978] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-29T02:12:20.798639] [INFO ] [MAIN ] Derivative Progress: 342/2211 symbols completed. BWA took 1.3s. Estimated remaining: 13m 6s. Rate: 142.6 symbols/min [2025-09-29T02:12:20.799053] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:20.811323] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-29T02:12:20.811730] [INFO ] [MAIN ] BWG: Loaded 12478 primary data records. [2025-09-29T02:12:20.888167] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-29T02:12:20.924307] [INFO ] [MAIN ] BWMX: Loaded 7676 primary data records. [2025-09-29T02:12:20.977582] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-29T02:12:21.017369] [INFO ] [MAIN ] BWLP: Loaded 33185 primary data records. [2025-09-29T02:12:21.952822] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:21.954514] [INFO ] [MAIN ] BWG: Generated 1820 derivative records from 12478 primary records. [2025-09-29T02:12:21.963071] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-29T02:12:21.969564] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:21.978499] [INFO ] [MAIN ] BWMX: Generated 1820 derivative records from 7676 primary records. [2025-09-29T02:12:21.984913] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-29T02:12:21.988989] [DEBUG] [LOCAL ] BWG: Derivative data saved (1820 records). [2025-09-29T02:12:21.989507] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-29T02:12:22.001422] [INFO ] [MAIN ] Derivative Progress: 343/2211 symbols completed. BWG took 1.2s. Estimated remaining: 13m 10s. Rate: 141.9 symbols/min [2025-09-29T02:12:22.024035] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1820 records). [2025-09-29T02:12:22.024948] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-29T02:12:22.024858] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:22.028033] [INFO ] [MAIN ] Derivative Progress: 344/2211 symbols completed. BWMX took 1.2s. Estimated remaining: 13m 7s. Rate: 142.3 symbols/min [2025-09-29T02:12:22.029015] [INFO ] [MAIN ] BWLP: Generated 1820 derivative records from 33185 primary records. [2025-09-29T02:12:22.029115] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-29T02:12:22.045529] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1820 records). [2025-09-29T02:12:22.045682] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-29T02:12:22.048946] [INFO ] [MAIN ] Derivative Progress: 345/2211 symbols completed. BWLP took 1.3s. Estimated remaining: 13m 5s. Rate: 142.7 symbols/min [2025-09-29T02:12:22.049497] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:22.049608] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:22.049690] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:22.065203] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-29T02:12:22.068290] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-29T02:12:22.068627] [INFO ] [MAIN ] BWSN: Loaded 5130 primary data records. [2025-09-29T02:12:22.068539] [INFO ] [MAIN ] BWNB: Loaded 4468 primary data records. [2025-09-29T02:12:22.736552] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-29T02:12:22.737173] [INFO ] [MAIN ] BWXT: Loaded 47442 primary data records. [2025-09-29T02:12:23.097896] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:12:23.099445] [INFO ] [MAIN ] BWNB: Generated 1819 derivative records from 4468 primary records. [2025-09-29T02:12:23.099963] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-29T02:12:23.127377] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:23.132293] [INFO ] [MAIN ] BWSN: Generated 1820 derivative records from 5130 primary records. [2025-09-29T02:12:23.131189] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1819 records). [2025-09-29T02:12:23.132863] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-29T02:12:23.132972] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-29T02:12:23.136949] [INFO ] [MAIN ] Derivative Progress: 346/2211 symbols completed. BWNB took 1.1s. Estimated remaining: 13m 8s. Rate: 142.0 symbols/min [2025-09-29T02:12:23.137962] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:23.153156] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1820 records). [2025-09-29T02:12:23.153408] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-29T02:12:23.157814] [INFO ] [MAIN ] Derivative Progress: 347/2211 symbols completed. BWSN took 1.1s. Estimated remaining: 13m 5s. Rate: 142.4 symbols/min [2025-09-29T02:12:23.158396] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:23.176637] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:23.181693] [INFO ] [MAIN ] BWXT: Generated 1820 derivative records from 47442 primary records. [2025-09-29T02:12:23.181804] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-29T02:12:23.206689] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-29T02:12:23.206850] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1820 records). [2025-09-29T02:12:23.207213] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-29T02:12:23.207118] [INFO ] [MAIN ] BXC: Loaded 13880 primary data records. [2025-09-29T02:12:23.210675] [INFO ] [MAIN ] Derivative Progress: 348/2211 symbols completed. BWXT took 1.2s. Estimated remaining: 13m 3s. Rate: 142.8 symbols/min [2025-09-29T02:12:23.211109] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:23.496940] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-29T02:12:23.627091] [INFO ] [MAIN ] BX: Loaded 54270 primary data records. [2025-09-29T02:12:23.806639] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-29T02:12:23.807570] [INFO ] [MAIN ] BXMT: Loaded 47994 primary data records. [2025-09-29T02:12:24.233496] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:24.373596] [INFO ] [MAIN ] BXC: Generated 1820 derivative records from 13880 primary records. [2025-09-29T02:12:24.374258] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-29T02:12:24.397638] [DEBUG] [LOCAL ] BXC: Derivative data saved (1820 records). [2025-09-29T02:12:24.398547] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-29T02:12:24.401217] [INFO ] [MAIN ] Derivative Progress: 349/2211 symbols completed. BXC took 1.2s. Estimated remaining: 13m 7s. Rate: 142.0 symbols/min [2025-09-29T02:12:24.401751] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:24.421003] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:24.422256] [INFO ] [MAIN ] BX: Generated 1820 derivative records from 54270 primary records. [2025-09-29T02:12:24.422383] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-29T02:12:24.445443] [DEBUG] [LOCAL ] BX: Derivative data saved (1820 records). [2025-09-29T02:12:24.445982] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-29T02:12:24.449183] [INFO ] [MAIN ] Derivative Progress: 350/2211 symbols completed. BX took 1.3s. Estimated remaining: 13m 4s. Rate: 142.4 symbols/min [2025-09-29T02:12:24.449910] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:24.461611] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-29T02:12:24.462187] [INFO ] [MAIN ] BXMX: Loaded 19855 primary data records. [2025-09-29T02:12:24.510193] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:24.537352] [INFO ] [MAIN ] BXMT: Generated 1820 derivative records from 47994 primary records. [2025-09-29T02:12:24.565821] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-29T02:12:24.841939] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1820 records). [2025-09-29T02:12:24.842451] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-29T02:12:24.845789] [INFO ] [MAIN ] Derivative Progress: 351/2211 symbols completed. BXMT took 1.6s. Estimated remaining: 13m 4s. Rate: 142.4 symbols/min [2025-09-29T02:12:24.846121] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:24.868198] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-29T02:12:24.868909] [INFO ] [MAIN ] BXP: Loaded 50577 primary data records. [2025-09-29T02:12:25.239406] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-29T02:12:25.239982] [INFO ] [MAIN ] BXSL: Loaded 48276 primary data records. [2025-09-29T02:12:25.315591] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:25.339010] [INFO ] [MAIN ] BXMX: Generated 1820 derivative records from 19855 primary records. [2025-09-29T02:12:25.365139] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-29T02:12:25.477332] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1820 records). [2025-09-29T02:12:25.590995] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-29T02:12:25.604438] [INFO ] [MAIN ] Derivative Progress: 352/2211 symbols completed. BXMX took 1.2s. Estimated remaining: 13m 5s. Rate: 142.1 symbols/min [2025-09-29T02:12:25.605219] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:25.627457] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:25.629235] [INFO ] [MAIN ] BXP: Generated 1820 derivative records from 50577 primary records. [2025-09-29T02:12:25.629669] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-29T02:12:25.671064] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-29T02:12:25.672103] [INFO ] [MAIN ] BY: Loaded 21895 primary data records. [2025-09-29T02:12:25.674805] [DEBUG] [LOCAL ] BXP: Derivative data saved (1820 records). [2025-09-29T02:12:25.703227] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-29T02:12:25.727807] [INFO ] [MAIN ] Derivative Progress: 353/2211 symbols completed. BXP took 1.3s. Estimated remaining: 13m 3s. Rate: 142.4 symbols/min [2025-09-29T02:12:25.748700] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:25.844984] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:25.908755] [INFO ] [MAIN ] BXSL: Generated 1820 derivative records from 48276 primary records. [2025-09-29T02:12:26.081967] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-29T02:12:26.109676] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1820 records). [2025-09-29T02:12:26.110564] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-29T02:12:26.114077] [INFO ] [MAIN ] Derivative Progress: 354/2211 symbols completed. BXSL took 1.3s. Estimated remaining: 13m 3s. Rate: 142.4 symbols/min [2025-09-29T02:12:26.115201] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:26.168602] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-29T02:12:26.174489] [INFO ] [MAIN ] BYD: Loaded 45804 primary data records. [2025-09-29T02:12:26.174935] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:26.175611] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-29T02:12:26.176869] [INFO ] [MAIN ] BY: Generated 1820 derivative records from 21895 primary records. [2025-09-29T02:12:26.177135] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-29T02:12:26.177197] [INFO ] [MAIN ] BYM: Loaded 12225 primary data records. [2025-09-29T02:12:26.464693] [DEBUG] [LOCAL ] BY: Derivative data saved (1820 records). [2025-09-29T02:12:26.505100] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-29T02:12:26.739889] [INFO ] [MAIN ] Derivative Progress: 355/2211 symbols completed. BY took 1.1s. Estimated remaining: 13m 3s. Rate: 142.2 symbols/min [2025-09-29T02:12:26.757336] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:26.952289] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-29T02:12:26.946262] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:26.953013] [INFO ] [MAIN ] BZH: Loaded 33088 primary data records. [2025-09-29T02:12:26.952959] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:26.953859] [INFO ] [MAIN ] BYD: Generated 1820 derivative records from 45804 primary records. [2025-09-29T02:12:26.965588] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-29T02:12:26.971523] [INFO ] [MAIN ] BYM: Generated 1820 derivative records from 12225 primary records. [2025-09-29T02:12:26.991206] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-29T02:12:27.125751] [DEBUG] [LOCAL ] BYD: Derivative data saved (1820 records). [2025-09-29T02:12:27.142110] [DEBUG] [LOCAL ] BYM: Derivative data saved (1820 records). [2025-09-29T02:12:27.171174] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-29T02:12:27.167039] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-29T02:12:27.318554] [INFO ] [MAIN ] Derivative Progress: 356/2211 symbols completed. BYM took 1.2s. Estimated remaining: 13m 4s. Rate: 142.0 symbols/min [2025-09-29T02:12:27.338381] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:27.338502] [INFO ] [MAIN ] Derivative Progress: 357/2211 symbols completed. BYD took 1.6s. Estimated remaining: 13m 1s. Rate: 142.4 symbols/min [2025-09-29T02:12:27.338976] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:27.371442] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-29T02:12:27.372128] [INFO ] [MAIN ] CAAP: Loaded 20021 primary data records. [2025-09-29T02:12:27.542464] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:27.613463] [INFO ] [MAIN ] BZH: Generated 1820 derivative records from 33088 primary records. [2025-09-29T02:12:27.754012] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-29T02:12:27.743284] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-29T02:12:27.755082] [INFO ] [MAIN ] C: Loaded 54521 primary data records. [2025-09-29T02:12:27.867961] [DEBUG] [LOCAL ] BZH: Derivative data saved (1820 records). [2025-09-29T02:12:27.888174] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-29T02:12:27.891855] [INFO ] [MAIN ] Derivative Progress: 358/2211 symbols completed. BZH took 1.1s. Estimated remaining: 13m 1s. Rate: 142.3 symbols/min [2025-09-29T02:12:28.166696] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:28.172168] [INFO ] [MAIN ] CAAP: Generated 1820 derivative records from 20021 primary records. [2025-09-29T02:12:28.172319] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-29T02:12:28.194417] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1820 records). [2025-09-29T02:12:28.194635] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-29T02:12:28.198296] [INFO ] [MAIN ] Derivative Progress: 359/2211 symbols completed. CAAP took 0.9s. Estimated remaining: 13m 0s. Rate: 142.4 symbols/min [2025-09-29T02:12:28.219158] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:28.219952] [INFO ] [MAIN ] C: Generated 1820 derivative records from 54521 primary records. [2025-09-29T02:12:28.220056] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-29T02:12:28.235866] [DEBUG] [LOCAL ] C: Derivative data saved (1820 records). [2025-09-29T02:12:28.235987] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-29T02:12:28.239943] [INFO ] [MAIN ] Derivative Progress: 360/2211 symbols completed. C took 0.9s. Estimated remaining: 12m 58s. Rate: 142.8 symbols/min [2025-09-29T02:12:28.240550] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:28.240762] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:28.240462] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:28.282194] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-29T02:12:28.292429] [INFO ] [MAIN ] CABO: Loaded 17549 primary data records. [2025-09-29T02:12:28.435804] [DEBUG] [LOCAL ] CADE: Loaded 49496 existing records from primary storage. [2025-09-29T02:12:28.420251] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-29T02:12:28.436184] [INFO ] [MAIN ] CADE: Loaded 49496 primary data records. [2025-09-29T02:12:28.436322] [INFO ] [MAIN ] CACI: Loaded 25384 primary data records. [2025-09-29T02:12:29.382331] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:29.384445] [INFO ] [MAIN ] CABO: Generated 1820 derivative records from 17549 primary records. [2025-09-29T02:12:29.384815] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-29T02:12:29.422018] [DEBUG] [LOCAL ] CABO: Derivative data saved (1820 records). [2025-09-29T02:12:29.422526] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:29.424992] [INFO ] [MAIN ] CADE: Generated 1820 derivative records from 49496 primary records. [2025-09-29T02:12:29.425141] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-29T02:12:29.423956] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-29T02:12:29.442233] [INFO ] [MAIN ] Derivative Progress: 361/2211 symbols completed. CABO took 1.2s. Estimated remaining: 13m 2s. Rate: 142.0 symbols/min [2025-09-29T02:12:29.442874] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:29.452422] [INFO ] [MAIN ] CACI: Generated 1820 derivative records from 25384 primary records. [2025-09-29T02:12:29.443383] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:29.457387] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-29T02:12:29.479977] [DEBUG] [LOCAL ] CADE: Derivative data saved (1820 records). [2025-09-29T02:12:29.479794] [DEBUG] [LOCAL ] CACI: Derivative data saved (1820 records). [2025-09-29T02:12:29.480299] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-29T02:12:29.480380] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-29T02:12:29.483667] [INFO ] [MAIN ] Derivative Progress: 362/2211 symbols completed. CADE took 1.2s. Estimated remaining: 12m 59s. Rate: 142.4 symbols/min [2025-09-29T02:12:29.487767] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:29.487977] [INFO ] [MAIN ] Derivative Progress: 363/2211 symbols completed. CACI took 1.2s. Estimated remaining: 12m 57s. Rate: 142.8 symbols/min [2025-09-29T02:12:29.488787] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:29.496574] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-29T02:12:29.497067] [INFO ] [MAIN ] CAF: Loaded 3471 primary data records. [2025-09-29T02:12:29.662095] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-29T02:12:29.672762] [INFO ] [MAIN ] CAE: Loaded 39622 primary data records. [2025-09-29T02:12:30.045512] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-29T02:12:30.079860] [INFO ] [MAIN ] CAG: Loaded 54439 primary data records. [2025-09-29T02:12:30.667955] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:30.669973] [INFO ] [MAIN ] CAF: Generated 1820 derivative records from 3471 primary records. [2025-09-29T02:12:30.670721] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-29T02:12:30.688587] [DEBUG] [LOCAL ] CAF: Derivative data saved (1820 records). [2025-09-29T02:12:30.688825] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-29T02:12:30.691498] [INFO ] [MAIN ] Derivative Progress: 364/2211 symbols completed. CAF took 1.2s. Estimated remaining: 13m 0s. Rate: 142.1 symbols/min [2025-09-29T02:12:30.691960] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:30.714224] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:30.715897] [INFO ] [MAIN ] CAE: Generated 1820 derivative records from 39622 primary records. [2025-09-29T02:12:30.716299] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-29T02:12:30.736846] [DEBUG] [LOCAL ] CAE: Derivative data saved (1820 records). [2025-09-29T02:12:30.737025] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-29T02:12:30.740055] [INFO ] [MAIN ] Derivative Progress: 365/2211 symbols completed. CAE took 1.3s. Estimated remaining: 12m 58s. Rate: 142.4 symbols/min [2025-09-29T02:12:30.748512] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:30.754509] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:30.755859] [INFO ] [MAIN ] CAG: Generated 1820 derivative records from 54439 primary records. [2025-09-29T02:12:30.756141] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-29T02:12:30.774008] [DEBUG] [LOCAL ] CAG: Derivative data saved (1820 records). [2025-09-29T02:12:30.788279] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-29T02:12:30.791386] [INFO ] [MAIN ] Derivative Progress: 366/2211 symbols completed. CAG took 1.3s. Estimated remaining: 12m 56s. Rate: 142.7 symbols/min [2025-09-29T02:12:30.791919] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:30.817821] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-29T02:12:30.818196] [INFO ] [MAIN ] CAH: Loaded 52209 primary data records. [2025-09-29T02:12:31.042920] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-29T02:12:31.072801] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-29T02:12:31.078955] [INFO ] [MAIN ] CAL: Loaded 43833 primary data records. [2025-09-29T02:12:31.193213] [INFO ] [MAIN ] CALX: Loaded 38931 primary data records. [2025-09-29T02:12:31.901298] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:31.903712] [INFO ] [MAIN ] CAH: Generated 1820 derivative records from 52209 primary records. [2025-09-29T02:12:31.904220] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-29T02:12:31.928621] [DEBUG] [LOCAL ] CAH: Derivative data saved (1820 records). [2025-09-29T02:12:31.930039] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-29T02:12:31.933334] [INFO ] [MAIN ] Derivative Progress: 367/2211 symbols completed. CAH took 1.2s. Estimated remaining: 12m 59s. Rate: 142.1 symbols/min [2025-09-29T02:12:31.934085] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:31.957352] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:31.958715] [INFO ] [MAIN ] CAL: Generated 1820 derivative records from 43833 primary records. [2025-09-29T02:12:31.959038] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-29T02:12:31.981827] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:31.987909] [INFO ] [MAIN ] CALX: Generated 1820 derivative records from 38931 primary records. [2025-09-29T02:12:31.998178] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-29T02:12:32.033712] [DEBUG] [LOCAL ] CALX: Derivative data saved (1820 records). [2025-09-29T02:12:32.034693] [DEBUG] [LOCAL ] CAL: Derivative data saved (1820 records). [2025-09-29T02:12:32.036321] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-29T02:12:32.036548] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-29T02:12:32.036801] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-29T02:12:32.040855] [INFO ] [MAIN ] Derivative Progress: 368/2211 symbols completed. CAL took 1.3s. Estimated remaining: 12m 57s. Rate: 142.4 symbols/min [2025-09-29T02:12:32.036670] [INFO ] [MAIN ] CANG: Loaded 27132 primary data records. [2025-09-29T02:12:32.044897] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:32.050422] [INFO ] [MAIN ] Derivative Progress: 369/2211 symbols completed. CALX took 1.3s. Estimated remaining: 12m 54s. Rate: 142.7 symbols/min [2025-09-29T02:12:32.065903] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:32.162136] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-29T02:12:32.190054] [INFO ] [MAIN ] CAPL: Loaded 5930 primary data records. [2025-09-29T02:12:32.691502] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-29T02:12:32.699250] [INFO ] [MAIN ] CARR: Loaded 54374 primary data records. [2025-09-29T02:12:33.197890] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:33.199437] [INFO ] [MAIN ] CANG: Generated 1820 derivative records from 27132 primary records. [2025-09-29T02:12:33.199778] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-29T02:12:33.223431] [DEBUG] [LOCAL ] CANG: Derivative data saved (1820 records). [2025-09-29T02:12:33.238027] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-29T02:12:33.238965] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:33.243461] [INFO ] [MAIN ] Derivative Progress: 370/2211 symbols completed. CANG took 1.3s. Estimated remaining: 12m 58s. Rate: 142.0 symbols/min [2025-09-29T02:12:33.244088] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:33.245203] [INFO ] [MAIN ] CAPL: Generated 1820 derivative records from 5930 primary records. [2025-09-29T02:12:33.247866] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-29T02:12:33.267742] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1820 records). [2025-09-29T02:12:33.268288] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-29T02:12:33.271721] [INFO ] [MAIN ] Derivative Progress: 371/2211 symbols completed. CAPL took 1.2s. Estimated remaining: 12m 55s. Rate: 142.4 symbols/min [2025-09-29T02:12:33.271970] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:33.290585] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:33.291454] [INFO ] [MAIN ] CARR: Generated 1820 derivative records from 54374 primary records. [2025-09-29T02:12:33.291612] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-29T02:12:33.318396] [DEBUG] [LOCAL ] CARR: Derivative data saved (1820 records). [2025-09-29T02:12:33.318692] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-29T02:12:33.322372] [INFO ] [MAIN ] Derivative Progress: 372/2211 symbols completed. CARR took 1.3s. Estimated remaining: 12m 53s. Rate: 142.7 symbols/min [2025-09-29T02:12:33.322974] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:33.339115] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-29T02:12:33.339370] [INFO ] [MAIN ] CARS: Loaded 40616 primary data records. [2025-09-29T02:12:33.437086] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-29T02:12:33.444903] [INFO ] [MAIN ] CATO: Loaded 7286 primary data records. [2025-09-29T02:12:33.660443] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-29T02:12:33.822777] [INFO ] [MAIN ] CAT: Loaded 53693 primary data records. [2025-09-29T02:12:34.490952] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:34.491840] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:34.493609] [INFO ] [MAIN ] CARS: Generated 1820 derivative records from 40616 primary records. [2025-09-29T02:12:34.495492] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-29T02:12:34.494844] [INFO ] [MAIN ] CATO: Generated 1820 derivative records from 7286 primary records. [2025-09-29T02:12:34.508338] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-29T02:12:34.539413] [DEBUG] [LOCAL ] CARS: Derivative data saved (1820 records). [2025-09-29T02:12:34.541754] [DEBUG] [LOCAL ] CATO: Derivative data saved (1820 records). [2025-09-29T02:12:34.542338] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-29T02:12:34.542053] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-29T02:12:34.546086] [INFO ] [MAIN ] Derivative Progress: 373/2211 symbols completed. CARS took 1.3s. Estimated remaining: 12m 57s. Rate: 142.0 symbols/min [2025-09-29T02:12:34.562108] [INFO ] [MAIN ] Derivative Progress: 374/2211 symbols completed. CATO took 1.2s. Estimated remaining: 12m 54s. Rate: 142.4 symbols/min [2025-09-29T02:12:34.569729] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:34.570564] [INFO ] [MAIN ] CAT: Generated 1820 derivative records from 53693 primary records. [2025-09-29T02:12:34.570692] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-29T02:12:34.587582] [DEBUG] [LOCAL ] CAT: Derivative data saved (1820 records). [2025-09-29T02:12:34.587805] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-29T02:12:34.591708] [INFO ] [MAIN ] Derivative Progress: 375/2211 symbols completed. CAT took 1.3s. Estimated remaining: 12m 52s. Rate: 142.7 symbols/min [2025-09-29T02:12:34.592186] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:34.592313] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:34.592709] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:34.611777] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-29T02:12:34.611939] [INFO ] [MAIN ] CBAN: Loaded 11141 primary data records. [2025-09-29T02:12:35.053125] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-29T02:12:35.051413] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-29T02:12:35.054974] [INFO ] [MAIN ] CB: Loaded 50773 primary data records. [2025-09-29T02:12:35.055388] [INFO ] [MAIN ] CAVA: Loaded 54330 primary data records. [2025-09-29T02:12:35.740524] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:35.742116] [INFO ] [MAIN ] CBAN: Generated 1820 derivative records from 11141 primary records. [2025-09-29T02:12:35.743403] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-29T02:12:35.763916] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1820 records). [2025-09-29T02:12:35.764674] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-29T02:12:35.768367] [INFO ] [MAIN ] Derivative Progress: 376/2211 symbols completed. CBAN took 1.2s. Estimated remaining: 12m 55s. Rate: 142.0 symbols/min [2025-09-29T02:12:35.769111] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:35.791916] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:35.798336] [INFO ] [MAIN ] CAVA: Generated 1820 derivative records from 54330 primary records. [2025-09-29T02:12:35.799569] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-29T02:12:35.820225] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-29T02:12:35.828759] [INFO ] [MAIN ] CBL: Loaded 16862 primary data records. [2025-09-29T02:12:35.859101] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:35.878449] [INFO ] [MAIN ] CB: Generated 1820 derivative records from 50773 primary records. [2025-09-29T02:12:35.904106] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1820 records). [2025-09-29T02:12:35.919556] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-29T02:12:35.962726] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-29T02:12:35.966909] [INFO ] [MAIN ] Derivative Progress: 377/2211 symbols completed. CAVA took 1.4s. Estimated remaining: 12m 54s. Rate: 142.2 symbols/min [2025-09-29T02:12:35.979468] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:36.082725] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-29T02:12:36.066308] [DEBUG] [LOCAL ] CB: Derivative data saved (1820 records). [2025-09-29T02:12:36.188918] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-29T02:12:36.202107] [INFO ] [MAIN ] Derivative Progress: 378/2211 symbols completed. CB took 1.6s. Estimated remaining: 12m 52s. Rate: 142.4 symbols/min [2025-09-29T02:12:36.197602] [INFO ] [MAIN ] CBNA: Loaded 2923 primary data records. [2025-09-29T02:12:36.202481] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:36.607423] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:36.611385] [INFO ] [MAIN ] CBL: Generated 1820 derivative records from 16862 primary records. [2025-09-29T02:12:36.625534] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-29T02:12:36.630589] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-29T02:12:36.631014] [INFO ] [MAIN ] CBRE: Loaded 51366 primary data records. [2025-09-29T02:12:36.708472] [DEBUG] [LOCAL ] CBL: Derivative data saved (1820 records). [2025-09-29T02:12:36.723782] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-29T02:12:36.761545] [INFO ] [MAIN ] Derivative Progress: 379/2211 symbols completed. CBL took 1.0s. Estimated remaining: 12m 53s. Rate: 142.3 symbols/min [2025-09-29T02:12:36.766051] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:37.066801] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:37.067904] [INFO ] [MAIN ] CBNA: Generated 1820 derivative records from 2923 primary records. [2025-09-29T02:12:37.068247] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-29T02:12:37.094825] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-29T02:12:37.098331] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1820 records). [2025-09-29T02:12:37.098585] [INFO ] [MAIN ] CBT: Loaded 31567 primary data records. [2025-09-29T02:12:37.099097] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-29T02:12:37.116092] [INFO ] [MAIN ] Derivative Progress: 380/2211 symbols completed. CBNA took 1.1s. Estimated remaining: 12m 52s. Rate: 142.3 symbols/min [2025-09-29T02:12:37.141240] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:37.370004] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-29T02:12:37.375378] [INFO ] [MAIN ] CBU: Loaded 23130 primary data records. [2025-09-29T02:12:37.388633] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:37.544054] [INFO ] [MAIN ] CBRE: Generated 1820 derivative records from 51366 primary records. [2025-09-29T02:12:37.564585] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-29T02:12:37.871261] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1820 records). [2025-09-29T02:12:37.899744] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-29T02:12:37.904128] [INFO ] [MAIN ] Derivative Progress: 381/2211 symbols completed. CBRE took 1.7s. Estimated remaining: 12m 53s. Rate: 142.0 symbols/min [2025-09-29T02:12:37.904806] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:37.930260] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:37.931634] [INFO ] [MAIN ] CBT: Generated 1820 derivative records from 31567 primary records. [2025-09-29T02:12:37.932258] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-29T02:12:37.962467] [DEBUG] [LOCAL ] CBT: Derivative data saved (1820 records). [2025-09-29T02:12:37.962839] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-29T02:12:37.967847] [INFO ] [MAIN ] Derivative Progress: 382/2211 symbols completed. CBT took 1.2s. Estimated remaining: 12m 51s. Rate: 142.3 symbols/min [2025-09-29T02:12:37.968420] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:37.997260] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:37.998128] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-29T02:12:37.999136] [INFO ] [MAIN ] CBZ: Loaded 34130 primary data records. [2025-09-29T02:12:37.998970] [INFO ] [MAIN ] CBU: Generated 1820 derivative records from 23130 primary records. [2025-09-29T02:12:38.004732] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-29T02:12:38.148897] [DEBUG] [LOCAL ] CBU: Derivative data saved (1820 records). [2025-09-29T02:12:38.165117] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-29T02:12:38.169215] [INFO ] [MAIN ] Derivative Progress: 383/2211 symbols completed. CBU took 1.0s. Estimated remaining: 12m 50s. Rate: 142.5 symbols/min [2025-09-29T02:12:38.169400] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:38.397126] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-29T02:12:38.398559] [INFO ] [MAIN ] CC: Loaded 53801 primary data records. [2025-09-29T02:12:38.770307] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-29T02:12:38.771368] [INFO ] [MAIN ] CCI: Loaded 53922 primary data records. [2025-09-29T02:12:38.884515] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:38.910375] [INFO ] [MAIN ] CBZ: Generated 1820 derivative records from 34130 primary records. [2025-09-29T02:12:38.942745] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-29T02:12:39.212176] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1820 records). [2025-09-29T02:12:39.212947] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-29T02:12:39.216804] [INFO ] [MAIN ] Derivative Progress: 384/2211 symbols completed. CBZ took 1.3s. Estimated remaining: 12m 52s. Rate: 142.0 symbols/min [2025-09-29T02:12:39.217089] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:39.233296] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:39.234768] [INFO ] [MAIN ] CC: Generated 1820 derivative records from 53801 primary records. [2025-09-29T02:12:39.235204] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-29T02:12:39.268592] [DEBUG] [LOCAL ] CC: Derivative data saved (1820 records). [2025-09-29T02:12:39.269806] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-29T02:12:39.278163] [INFO ] [MAIN ] CCIF: Loaded 15698 primary data records. [2025-09-29T02:12:39.270515] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-29T02:12:39.325739] [INFO ] [MAIN ] Derivative Progress: 385/2211 symbols completed. CC took 1.3s. Estimated remaining: 12m 50s. Rate: 142.3 symbols/min [2025-09-29T02:12:39.331197] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:39.313355] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:39.363120] [INFO ] [MAIN ] CCI: Generated 1820 derivative records from 53922 primary records. [2025-09-29T02:12:39.386410] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-29T02:12:39.651713] [DEBUG] [LOCAL ] CCI: Derivative data saved (1820 records). [2025-09-29T02:12:39.652462] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-29T02:12:39.656357] [INFO ] [MAIN ] Derivative Progress: 386/2211 symbols completed. CCI took 1.5s. Estimated remaining: 12m 49s. Rate: 142.3 symbols/min [2025-09-29T02:12:39.673866] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:39.707688] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-29T02:12:39.708332] [INFO ] [MAIN ] CCJ: Loaded 54453 primary data records. [2025-09-29T02:12:39.857118] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:39.900569] [INFO ] [MAIN ] CCIF: Generated 1820 derivative records from 15698 primary records. [2025-09-29T02:12:39.943404] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-29T02:12:40.098933] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-29T02:12:40.101441] [INFO ] [MAIN ] CCK: Loaded 47083 primary data records. [2025-09-29T02:12:40.118732] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1820 records). [2025-09-29T02:12:40.142208] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-29T02:12:40.165135] [INFO ] [MAIN ] Derivative Progress: 387/2211 symbols completed. CCIF took 0.9s. Estimated remaining: 12m 49s. Rate: 142.3 symbols/min [2025-09-29T02:12:40.165516] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:40.461086] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:40.478834] [INFO ] [MAIN ] CCJ: Generated 1820 derivative records from 54453 primary records. [2025-09-29T02:12:40.479780] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-29T02:12:40.498232] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1820 records). [2025-09-29T02:12:40.498427] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-29T02:12:40.501668] [INFO ] [MAIN ] Derivative Progress: 388/2211 symbols completed. CCJ took 1.2s. Estimated remaining: 12m 48s. Rate: 142.3 symbols/min [2025-09-29T02:12:40.528267] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-29T02:12:40.529237] [INFO ] [MAIN ] CCL: Loaded 54580 primary data records. [2025-09-29T02:12:40.619434] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:40.646974] [INFO ] [MAIN ] CCK: Generated 1820 derivative records from 47083 primary records. [2025-09-29T02:12:40.659505] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-29T02:12:40.708519] [DEBUG] [LOCAL ] CCK: Derivative data saved (1820 records). [2025-09-29T02:12:40.731680] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-29T02:12:40.746220] [INFO ] [MAIN ] Derivative Progress: 389/2211 symbols completed. CCK took 1.1s. Estimated remaining: 12m 47s. Rate: 142.5 symbols/min [2025-09-29T02:12:40.916542] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:40.917386] [INFO ] [MAIN ] CCL: Generated 1820 derivative records from 54580 primary records. [2025-09-29T02:12:40.917475] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-29T02:12:40.933343] [DEBUG] [LOCAL ] CCL: Derivative data saved (1820 records). [2025-09-29T02:12:40.933479] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-29T02:12:40.937667] [INFO ] [MAIN ] Derivative Progress: 390/2211 symbols completed. CCL took 0.8s. Estimated remaining: 12m 46s. Rate: 142.7 symbols/min [2025-09-29T02:12:40.938323] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:40.938468] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:40.938711] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:40.956405] [DEBUG] [LOCAL ] CCRD: Loaded 9100 existing records from primary storage. [2025-09-29T02:12:40.956632] [INFO ] [MAIN ] CCRD: Loaded 9100 primary data records. [2025-09-29T02:12:41.372965] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-29T02:12:41.373392] [INFO ] [MAIN ] CCS: Loaded 31155 primary data records. [2025-09-29T02:12:41.400808] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-29T02:12:41.432444] [INFO ] [MAIN ] CCO: Loaded 48387 primary data records. [2025-09-29T02:12:42.062746] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:42.064326] [INFO ] [MAIN ] CCRD: Generated 1820 derivative records from 9100 primary records. [2025-09-29T02:12:42.065000] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-29T02:12:42.084205] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1820 records). [2025-09-29T02:12:42.084442] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-29T02:12:42.087416] [INFO ] [MAIN ] Derivative Progress: 391/2211 symbols completed. CCRD took 1.1s. Estimated remaining: 12m 49s. Rate: 142.1 symbols/min [2025-09-29T02:12:42.087978] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:42.115943] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:42.117561] [INFO ] [MAIN ] CCS: Generated 1820 derivative records from 31155 primary records. [2025-09-29T02:12:42.117933] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-29T02:12:42.154968] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:42.157270] [INFO ] [MAIN ] CCO: Generated 1820 derivative records from 48387 primary records. [2025-09-29T02:12:42.157704] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-29T02:12:42.173610] [DEBUG] [LOCAL ] CCS: Derivative data saved (1820 records). [2025-09-29T02:12:42.186075] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-29T02:12:42.189197] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-29T02:12:42.190880] [INFO ] [MAIN ] CCU: Loaded 23800 primary data records. [2025-09-29T02:12:42.193699] [INFO ] [MAIN ] Derivative Progress: 392/2211 symbols completed. CCS took 1.3s. Estimated remaining: 12m 47s. Rate: 142.3 symbols/min [2025-09-29T02:12:42.211974] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:42.232850] [DEBUG] [LOCAL ] CCO: Derivative data saved (1820 records). [2025-09-29T02:12:42.242058] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-29T02:12:42.250724] [INFO ] [MAIN ] Derivative Progress: 393/2211 symbols completed. CCO took 1.3s. Estimated remaining: 12m 45s. Rate: 142.6 symbols/min [2025-09-29T02:12:42.268025] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:42.415482] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-29T02:12:42.446889] [INFO ] [MAIN ] CDLR: Loaded 9966 primary data records. [2025-09-29T02:12:42.752209] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-29T02:12:42.762967] [INFO ] [MAIN ] CDE: Loaded 54421 primary data records. [2025-09-29T02:12:43.325160] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:43.326483] [INFO ] [MAIN ] CCU: Generated 1820 derivative records from 23800 primary records. [2025-09-29T02:12:43.326798] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-29T02:12:43.347903] [DEBUG] [LOCAL ] CCU: Derivative data saved (1820 records). [2025-09-29T02:12:43.348297] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-29T02:12:43.351158] [INFO ] [MAIN ] Derivative Progress: 394/2211 symbols completed. CCU took 1.3s. Estimated remaining: 12m 47s. Rate: 142.1 symbols/min [2025-09-29T02:12:43.353611] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:43.371137] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:43.373105] [INFO ] [MAIN ] CDLR: Generated 1820 derivative records from 9966 primary records. [2025-09-29T02:12:43.373476] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-29T02:12:43.392949] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1820 records). [2025-09-29T02:12:43.395250] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-29T02:12:43.398716] [INFO ] [MAIN ] Derivative Progress: 395/2211 symbols completed. CDLR took 1.1s. Estimated remaining: 12m 45s. Rate: 142.4 symbols/min [2025-09-29T02:12:43.398999] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:43.413900] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:43.427092] [INFO ] [MAIN ] CDE: Generated 1820 derivative records from 54421 primary records. [2025-09-29T02:12:43.427375] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-29T02:12:43.445195] [DEBUG] [LOCAL ] CDE: Derivative data saved (1820 records). [2025-09-29T02:12:43.447037] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-29T02:12:43.463762] [INFO ] [MAIN ] Derivative Progress: 396/2211 symbols completed. CDE took 1.3s. Estimated remaining: 12m 43s. Rate: 142.7 symbols/min [2025-09-29T02:12:43.471783] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-29T02:12:43.472248] [INFO ] [MAIN ] CDP: Loaded 43357 primary data records. [2025-09-29T02:12:43.472043] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:43.583744] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-29T02:12:43.597618] [INFO ] [MAIN ] CDRE: Loaded 25747 primary data records. [2025-09-29T02:12:44.179619] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-29T02:12:44.203324] [INFO ] [MAIN ] CE: Loaded 52316 primary data records. [2025-09-29T02:12:44.599438] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:44.601149] [INFO ] [MAIN ] CDP: Generated 1820 derivative records from 43357 primary records. [2025-09-29T02:12:44.602006] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-29T02:12:44.624888] [DEBUG] [LOCAL ] CDP: Derivative data saved (1820 records). [2025-09-29T02:12:44.626690] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-29T02:12:44.629854] [INFO ] [MAIN ] Derivative Progress: 397/2211 symbols completed. CDP took 1.3s. Estimated remaining: 12m 46s. Rate: 142.1 symbols/min [2025-09-29T02:12:44.645227] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:44.645672] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:44.646924] [INFO ] [MAIN ] CDRE: Generated 1820 derivative records from 25747 primary records. [2025-09-29T02:12:44.647176] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-29T02:12:44.670986] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-29T02:12:44.671849] [INFO ] [MAIN ] CEE: Loaded 6697 primary data records. [2025-09-29T02:12:44.697312] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1820 records). [2025-09-29T02:12:44.735990] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-29T02:12:44.780319] [INFO ] [MAIN ] Derivative Progress: 398/2211 symbols completed. CDRE took 1.4s. Estimated remaining: 12m 45s. Rate: 142.3 symbols/min [2025-09-29T02:12:44.799316] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:44.837101] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:44.866557] [INFO ] [MAIN ] CE: Generated 1820 derivative records from 52316 primary records. [2025-09-29T02:12:44.866780] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-29T02:12:45.063203] [DEBUG] [LOCAL ] CE: Derivative data saved (1820 records). [2025-09-29T02:12:45.064223] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-29T02:12:45.065738] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-29T02:12:45.065949] [INFO ] [MAIN ] CEPU: Loaded 26454 primary data records. [2025-09-29T02:12:45.069281] [INFO ] [MAIN ] Derivative Progress: 399/2211 symbols completed. CE took 1.6s. Estimated remaining: 12m 44s. Rate: 142.4 symbols/min [2025-09-29T02:12:45.069461] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:45.317143] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:45.445709] [INFO ] [MAIN ] CEE: Generated 1820 derivative records from 6697 primary records. [2025-09-29T02:12:45.445934] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-29T02:12:45.481369] [DEBUG] [LOCAL ] CEE: Derivative data saved (1820 records). [2025-09-29T02:12:45.484744] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-29T02:12:45.484392] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-29T02:12:45.488605] [INFO ] [MAIN ] CF: Loaded 52983 primary data records. [2025-09-29T02:12:45.488070] [INFO ] [MAIN ] Derivative Progress: 400/2211 symbols completed. CEE took 0.8s. Estimated remaining: 12m 43s. Rate: 142.4 symbols/min [2025-09-29T02:12:45.489163] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:45.876400] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:45.877460] [INFO ] [MAIN ] CEPU: Generated 1820 derivative records from 26454 primary records. [2025-09-29T02:12:45.877875] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-29T02:12:45.912968] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1820 records). [2025-09-29T02:12:45.913698] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-29T02:12:45.917496] [INFO ] [MAIN ] Derivative Progress: 401/2211 symbols completed. CEPU took 1.1s. Estimated remaining: 12m 43s. Rate: 142.4 symbols/min [2025-09-29T02:12:45.917877] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:45.940751] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-29T02:12:45.941420] [INFO ] [MAIN ] CFG: Loaded 54404 primary data records. [2025-09-29T02:12:46.122391] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:46.155864] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-29T02:12:46.175591] [INFO ] [MAIN ] CFR: Loaded 33971 primary data records. [2025-09-29T02:12:46.176794] [INFO ] [MAIN ] CF: Generated 1820 derivative records from 52983 primary records. [2025-09-29T02:12:46.307171] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-29T02:12:46.429108] [DEBUG] [LOCAL ] CF: Derivative data saved (1820 records). [2025-09-29T02:12:46.441749] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-29T02:12:46.445790] [INFO ] [MAIN ] Derivative Progress: 402/2211 symbols completed. CF took 1.4s. Estimated remaining: 12m 43s. Rate: 142.3 symbols/min [2025-09-29T02:12:46.462502] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:46.675990] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:46.677781] [INFO ] [MAIN ] CFG: Generated 1820 derivative records from 54404 primary records. [2025-09-29T02:12:46.678282] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-29T02:12:46.697928] [DEBUG] [LOCAL ] CFG: Derivative data saved (1820 records). [2025-09-29T02:12:46.708286] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-29T02:12:46.711301] [INFO ] [MAIN ] Derivative Progress: 403/2211 symbols completed. CFG took 1.2s. Estimated remaining: 12m 42s. Rate: 142.4 symbols/min [2025-09-29T02:12:46.732023] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-29T02:12:46.732382] [INFO ] [MAIN ] CGAU: Loaded 43406 primary data records. [2025-09-29T02:12:46.779083] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:46.819530] [INFO ] [MAIN ] CFR: Generated 1820 derivative records from 33971 primary records. [2025-09-29T02:12:46.830729] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-29T02:12:46.952959] [DEBUG] [LOCAL ] CFR: Derivative data saved (1820 records). [2025-09-29T02:12:47.071687] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-29T02:12:47.084053] [INFO ] [MAIN ] Derivative Progress: 404/2211 symbols completed. CFR took 1.2s. Estimated remaining: 12m 41s. Rate: 142.5 symbols/min [2025-09-29T02:12:47.110518] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:47.111325] [INFO ] [MAIN ] CGAU: Generated 1820 derivative records from 43406 primary records. [2025-09-29T02:12:47.111412] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-29T02:12:47.127061] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1820 records). [2025-09-29T02:12:47.127149] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-29T02:12:47.129883] [INFO ] [MAIN ] Derivative Progress: 405/2211 symbols completed. CGAU took 0.7s. Estimated remaining: 12m 39s. Rate: 142.8 symbols/min [2025-09-29T02:12:47.130488] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:47.130572] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:47.130762] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:47.135521] [DEBUG] [LOCAL ] CGV: Loaded 1431 existing records from primary storage. [2025-09-29T02:12:47.135900] [INFO ] [MAIN ] CGV: Loaded 1431 primary data records. [2025-09-29T02:12:47.310441] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-29T02:12:47.356861] [INFO ] [MAIN ] CHCT: Loaded 24309 primary data records. [2025-09-29T02:12:47.640184] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-29T02:12:47.641207] [INFO ] [MAIN ] CHD: Loaded 52767 primary data records. [2025-09-29T02:12:48.259888] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:12:48.262671] [INFO ] [MAIN ] CGV: Generated 1819 derivative records from 1431 primary records. [2025-09-29T02:12:48.263664] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-29T02:12:48.281447] [DEBUG] [LOCAL ] CGV: Derivative data saved (1819 records). [2025-09-29T02:12:48.281687] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-29T02:12:48.284354] [INFO ] [MAIN ] Derivative Progress: 406/2211 symbols completed. CGV took 1.2s. Estimated remaining: 12m 42s. Rate: 142.2 symbols/min [2025-09-29T02:12:48.284837] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:48.303595] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:48.305162] [INFO ] [MAIN ] CHCT: Generated 1820 derivative records from 24309 primary records. [2025-09-29T02:12:48.305305] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-29T02:12:48.328497] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1820 records). [2025-09-29T02:12:48.337507] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-29T02:12:48.341526] [INFO ] [MAIN ] Derivative Progress: 407/2211 symbols completed. CHCT took 1.2s. Estimated remaining: 12m 40s. Rate: 142.5 symbols/min [2025-09-29T02:12:48.342252] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-29T02:12:48.342836] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:48.342936] [INFO ] [MAIN ] CHE: Loaded 14983 primary data records. [2025-09-29T02:12:48.397446] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:48.430698] [INFO ] [MAIN ] CHD: Generated 1820 derivative records from 52767 primary records. [2025-09-29T02:12:48.462611] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-29T02:12:48.691781] [DEBUG] [LOCAL ] CHD: Derivative data saved (1820 records). [2025-09-29T02:12:48.711836] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-29T02:12:48.715567] [INFO ] [MAIN ] Derivative Progress: 408/2211 symbols completed. CHD took 1.6s. Estimated remaining: 12m 39s. Rate: 142.5 symbols/min [2025-09-29T02:12:48.716100] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:48.745048] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-29T02:12:48.745620] [INFO ] [MAIN ] CHGG: Loaded 48434 primary data records. [2025-09-29T02:12:48.882026] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-29T02:12:48.888778] [INFO ] [MAIN ] CHH: Loaded 32744 primary data records. [2025-09-29T02:12:49.203451] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:49.233947] [INFO ] [MAIN ] CHE: Generated 1820 derivative records from 14983 primary records. [2025-09-29T02:12:49.239265] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-29T02:12:49.454585] [DEBUG] [LOCAL ] CHE: Derivative data saved (1820 records). [2025-09-29T02:12:49.469305] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-29T02:12:49.474619] [INFO ] [MAIN ] Derivative Progress: 409/2211 symbols completed. CHE took 1.2s. Estimated remaining: 12m 40s. Rate: 142.2 symbols/min [2025-09-29T02:12:49.475362] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:49.507144] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:49.510208] [INFO ] [MAIN ] CHGG: Generated 1820 derivative records from 48434 primary records. [2025-09-29T02:12:49.510488] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-29T02:12:49.536622] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-29T02:12:49.538426] [INFO ] [MAIN ] CHMI: Loaded 22359 primary data records. [2025-09-29T02:12:49.539677] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1820 records). [2025-09-29T02:12:49.539892] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-29T02:12:49.565127] [INFO ] [MAIN ] Derivative Progress: 410/2211 symbols completed. CHGG took 1.2s. Estimated remaining: 12m 38s. Rate: 142.5 symbols/min [2025-09-29T02:12:49.565584] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:49.664315] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-29T02:12:49.665275] [INFO ] [MAIN ] CHN: Loaded 4900 primary data records. [2025-09-29T02:12:49.809885] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:49.982263] [INFO ] [MAIN ] CHH: Generated 1820 derivative records from 32744 primary records. [2025-09-29T02:12:50.051797] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-29T02:12:50.142870] [DEBUG] [LOCAL ] CHH: Derivative data saved (1820 records). [2025-09-29T02:12:50.165915] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-29T02:12:50.171367] [INFO ] [MAIN ] Derivative Progress: 411/2211 symbols completed. CHH took 1.5s. Estimated remaining: 12m 39s. Rate: 142.4 symbols/min [2025-09-29T02:12:50.305985] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:50.348569] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:50.349606] [INFO ] [MAIN ] CHMI: Generated 1820 derivative records from 22359 primary records. [2025-09-29T02:12:50.349894] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-29T02:12:50.368299] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1820 records). [2025-09-29T02:12:50.368512] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-29T02:12:50.371426] [INFO ] [MAIN ] Derivative Progress: 412/2211 symbols completed. CHMI took 0.9s. Estimated remaining: 12m 37s. Rate: 142.5 symbols/min [2025-09-29T02:12:50.372089] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:50.401985] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:50.402847] [INFO ] [MAIN ] CHN: Generated 1820 derivative records from 4900 primary records. [2025-09-29T02:12:50.403070] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-29T02:12:50.437232] [DEBUG] [LOCAL ] CHN: Derivative data saved (1820 records). [2025-09-29T02:12:50.443963] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-29T02:12:50.447673] [INFO ] [MAIN ] Derivative Progress: 413/2211 symbols completed. CHN took 0.9s. Estimated remaining: 12m 35s. Rate: 142.8 symbols/min [2025-09-29T02:12:50.448326] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-29T02:12:50.449711] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-29T02:12:50.449890] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:50.450228] [INFO ] [MAIN ] CHPT: Loaded 49765 primary data records. [2025-09-29T02:12:50.450136] [INFO ] [MAIN ] CHT: Loaded 19816 primary data records. [2025-09-29T02:12:51.128762] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-29T02:12:51.130624] [INFO ] [MAIN ] CHWY: Loaded 54434 primary data records. [2025-09-29T02:12:51.494915] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:51.496454] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:51.496103] [INFO ] [MAIN ] CHT: Generated 1820 derivative records from 19816 primary records. [2025-09-29T02:12:51.497620] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-29T02:12:51.498399] [INFO ] [MAIN ] CHPT: Generated 1820 derivative records from 49765 primary records. [2025-09-29T02:12:51.499465] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-29T02:12:51.529142] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1820 records). [2025-09-29T02:12:51.530446] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-29T02:12:51.534282] [INFO ] [MAIN ] Derivative Progress: 414/2211 symbols completed. CHPT took 1.2s. Estimated remaining: 12m 38s. Rate: 142.3 symbols/min [2025-09-29T02:12:51.535662] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:51.538258] [DEBUG] [LOCAL ] CHT: Derivative data saved (1820 records). [2025-09-29T02:12:51.540227] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-29T02:12:51.543179] [INFO ] [MAIN ] Derivative Progress: 415/2211 symbols completed. CHT took 1.2s. Estimated remaining: 12m 36s. Rate: 142.6 symbols/min [2025-09-29T02:12:51.543400] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:51.561772] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:51.562719] [INFO ] [MAIN ] CHWY: Generated 1820 derivative records from 54434 primary records. [2025-09-29T02:12:51.562851] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-29T02:12:51.584589] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1820 records). [2025-09-29T02:12:51.591836] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-29T02:12:51.594956] [INFO ] [MAIN ] Derivative Progress: 416/2211 symbols completed. CHWY took 1.1s. Estimated remaining: 12m 34s. Rate: 142.9 symbols/min [2025-09-29T02:12:51.595485] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-29T02:12:51.596122] [INFO ] [MAIN ] CIA: Loaded 17213 primary data records. [2025-09-29T02:12:51.596029] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:51.960066] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-29T02:12:51.962136] [INFO ] [MAIN ] CI: Loaded 50561 primary data records. [2025-09-29T02:12:51.985526] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-29T02:12:51.991772] [INFO ] [MAIN ] CIB: Loaded 31435 primary data records. [2025-09-29T02:12:52.701462] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:52.703774] [INFO ] [MAIN ] CIA: Generated 1820 derivative records from 17213 primary records. [2025-09-29T02:12:52.704885] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-29T02:12:52.725079] [DEBUG] [LOCAL ] CIA: Derivative data saved (1820 records). [2025-09-29T02:12:52.725360] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-29T02:12:52.728590] [INFO ] [MAIN ] Derivative Progress: 417/2211 symbols completed. CIA took 1.2s. Estimated remaining: 12m 36s. Rate: 142.3 symbols/min [2025-09-29T02:12:52.729344] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:52.769002] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:52.768396] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:52.770122] [INFO ] [MAIN ] CIB: Generated 1820 derivative records from 31435 primary records. [2025-09-29T02:12:52.770917] [INFO ] [MAIN ] CI: Generated 1820 derivative records from 50561 primary records. [2025-09-29T02:12:52.771177] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-29T02:12:52.771245] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-29T02:12:52.802981] [DEBUG] [LOCAL ] CI: Derivative data saved (1820 records). [2025-09-29T02:12:52.820610] [DEBUG] [LOCAL ] CIB: Derivative data saved (1820 records). [2025-09-29T02:12:52.820735] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-29T02:12:52.821000] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-29T02:12:52.823793] [INFO ] [MAIN ] Derivative Progress: 418/2211 symbols completed. CI took 1.3s. Estimated remaining: 12m 34s. Rate: 142.6 symbols/min [2025-09-29T02:12:52.827556] [INFO ] [MAIN ] Derivative Progress: 419/2211 symbols completed. CIB took 1.2s. Estimated remaining: 12m 32s. Rate: 142.9 symbols/min [2025-09-29T02:12:52.847715] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-29T02:12:52.847916] [INFO ] [MAIN ] CIEN: Loaded 52854 primary data records. [2025-09-29T02:12:53.192777] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:53.193539] [INFO ] [MAIN ] CIEN: Generated 1820 derivative records from 52854 primary records. [2025-09-29T02:12:53.193629] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-29T02:12:53.210050] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1820 records). [2025-09-29T02:12:53.210140] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-29T02:12:53.213080] [INFO ] [MAIN ] Derivative Progress: 420/2211 symbols completed. CIEN took 0.5s. Estimated remaining: 12m 32s. Rate: 143.0 symbols/min [2025-09-29T02:12:53.213702] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:53.213868] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:53.213996] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:53.224690] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-29T02:12:53.225301] [INFO ] [MAIN ] CIF: Loaded 4396 primary data records. [2025-09-29T02:12:53.363939] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-29T02:12:53.364627] [INFO ] [MAIN ] CII: Loaded 15638 primary data records. [2025-09-29T02:12:53.739333] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-29T02:12:53.761573] [INFO ] [MAIN ] CIG: Loaded 44447 primary data records. [2025-09-29T02:12:54.400726] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:54.403245] [INFO ] [MAIN ] CIF: Generated 1820 derivative records from 4396 primary records. [2025-09-29T02:12:54.403794] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-29T02:12:54.428488] [DEBUG] [LOCAL ] CIF: Derivative data saved (1820 records). [2025-09-29T02:12:54.443383] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-29T02:12:54.443804] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:54.447952] [INFO ] [MAIN ] Derivative Progress: 421/2211 symbols completed. CIF took 1.2s. Estimated remaining: 12m 35s. Rate: 142.3 symbols/min [2025-09-29T02:12:54.449472] [INFO ] [MAIN ] CII: Generated 1820 derivative records from 15638 primary records. [2025-09-29T02:12:54.449599] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-29T02:12:54.449775] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:54.471044] [DEBUG] [LOCAL ] CII: Derivative data saved (1820 records). [2025-09-29T02:12:54.471793] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-29T02:12:54.475685] [INFO ] [MAIN ] Derivative Progress: 422/2211 symbols completed. CII took 1.3s. Estimated remaining: 12m 33s. Rate: 142.6 symbols/min [2025-09-29T02:12:54.476772] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:54.495265] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-29T02:12:54.503341] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:54.503479] [INFO ] [MAIN ] CIMN: Loaded 2697 primary data records. [2025-09-29T02:12:54.521663] [INFO ] [MAIN ] CIG: Generated 1820 derivative records from 44447 primary records. [2025-09-29T02:12:54.522191] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-29T02:12:54.743073] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-29T02:12:54.740808] [DEBUG] [LOCAL ] CIG: Derivative data saved (1820 records). [2025-09-29T02:12:54.756351] [INFO ] [MAIN ] CIM: Loaded 37858 primary data records. [2025-09-29T02:12:54.761965] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-29T02:12:54.883870] [INFO ] [MAIN ] Derivative Progress: 423/2211 symbols completed. CIG took 1.6s. Estimated remaining: 12m 32s. Rate: 142.6 symbols/min [2025-09-29T02:12:54.889592] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:55.246021] [DEBUG] [LOCAL ] CINT: Loaded 18868 existing records from primary storage. [2025-09-29T02:12:55.268760] [INFO ] [MAIN ] CINT: Loaded 18868 primary data records. [2025-09-29T02:12:55.859508] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:55.861804] [INFO ] [MAIN ] CIMN: Generated 1820 derivative records from 2697 primary records. [2025-09-29T02:12:55.862353] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-29T02:12:55.882045] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1820 records). [2025-09-29T02:12:55.882402] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-29T02:12:55.885487] [INFO ] [MAIN ] Derivative Progress: 424/2211 symbols completed. CIMN took 1.4s. Estimated remaining: 12m 34s. Rate: 142.2 symbols/min [2025-09-29T02:12:55.887026] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:55.905610] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:55.906973] [INFO ] [MAIN ] CIM: Generated 1820 derivative records from 37858 primary records. [2025-09-29T02:12:55.907271] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-29T02:12:55.931784] [DEBUG] [LOCAL ] CIM: Derivative data saved (1820 records). [2025-09-29T02:12:55.933938] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-29T02:12:55.952460] [INFO ] [MAIN ] Derivative Progress: 425/2211 symbols completed. CIM took 1.5s. Estimated remaining: 12m 32s. Rate: 142.5 symbols/min [2025-09-29T02:12:55.957989] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:55.959420] [DEBUG] [LOCAL ] CIO: Loaded 20406 existing records from primary storage. [2025-09-29T02:12:55.960152] [INFO ] [MAIN ] CIO: Loaded 20406 primary data records. [2025-09-29T02:12:55.960035] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:55.973226] [INFO ] [MAIN ] CINT: Generated 1820 derivative records from 18868 primary records. [2025-09-29T02:12:55.995742] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-29T02:12:56.097207] [DEBUG] [LOCAL ] CINT: Derivative data saved (1820 records). [2025-09-29T02:12:56.098068] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-29T02:12:56.107520] [INFO ] [MAIN ] Derivative Progress: 426/2211 symbols completed. CINT took 1.2s. Estimated remaining: 12m 31s. Rate: 142.7 symbols/min [2025-09-29T02:12:56.118109] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:56.351389] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-29T02:12:56.352482] [INFO ] [MAIN ] CION: Loaded 29661 primary data records. [2025-09-29T02:12:56.771937] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-29T02:12:56.773017] [INFO ] [MAIN ] CIVI: Loaded 53363 primary data records. [2025-09-29T02:12:56.940105] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:56.957187] [INFO ] [MAIN ] CIO: Generated 1820 derivative records from 20406 primary records. [2025-09-29T02:12:56.963334] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-29T02:12:57.169067] [DEBUG] [LOCAL ] CIO: Derivative data saved (1820 records). [2025-09-29T02:12:57.169393] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-29T02:12:57.172609] [INFO ] [MAIN ] Derivative Progress: 427/2211 symbols completed. CIO took 1.3s. Estimated remaining: 12m 33s. Rate: 142.2 symbols/min [2025-09-29T02:12:57.173260] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:57.195769] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:57.197088] [INFO ] [MAIN ] CION: Generated 1820 derivative records from 29661 primary records. [2025-09-29T02:12:57.197280] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-29T02:12:57.216665] [DEBUG] [LOCAL ] CION: Derivative data saved (1820 records). [2025-09-29T02:12:57.217502] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-29T02:12:57.220673] [INFO ] [MAIN ] Derivative Progress: 428/2211 symbols completed. CION took 1.3s. Estimated remaining: 12m 31s. Rate: 142.4 symbols/min [2025-09-29T02:12:57.221240] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:57.255681] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:57.256458] [INFO ] [MAIN ] CIVI: Generated 1820 derivative records from 53363 primary records. [2025-09-29T02:12:57.256660] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-29T02:12:57.290558] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1820 records). [2025-09-29T02:12:57.291072] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-29T02:12:57.295087] [INFO ] [MAIN ] Derivative Progress: 429/2211 symbols completed. CIVI took 1.2s. Estimated remaining: 12m 29s. Rate: 142.7 symbols/min [2025-09-29T02:12:57.297792] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-29T02:12:57.295387] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:57.298319] [INFO ] [MAIN ] CL: Loaded 54424 primary data records. [2025-09-29T02:12:57.422762] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-29T02:12:57.447608] [INFO ] [MAIN ] CLB: Loaded 33475 primary data records. [2025-09-29T02:12:57.488801] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-29T02:12:57.528038] [INFO ] [MAIN ] CLCO: Loaded 13189 primary data records. [2025-09-29T02:12:58.384166] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:58.385376] [INFO ] [MAIN ] CL: Generated 1820 derivative records from 54424 primary records. [2025-09-29T02:12:58.388845] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-29T02:12:58.422928] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:58.423036] [DEBUG] [LOCAL ] CL: Derivative data saved (1820 records). [2025-09-29T02:12:58.423417] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-29T02:12:58.427289] [INFO ] [MAIN ] Derivative Progress: 430/2211 symbols completed. CL took 1.3s. Estimated remaining: 12m 32s. Rate: 142.2 symbols/min [2025-09-29T02:12:58.424225] [INFO ] [MAIN ] CLB: Generated 1820 derivative records from 33475 primary records. [2025-09-29T02:12:58.427819] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-29T02:12:58.428022] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:58.450095] [DEBUG] [LOCAL ] CLB: Derivative data saved (1820 records). [2025-09-29T02:12:58.450262] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-29T02:12:58.453746] [INFO ] [MAIN ] Derivative Progress: 431/2211 symbols completed. CLB took 1.2s. Estimated remaining: 12m 30s. Rate: 142.5 symbols/min [2025-09-29T02:12:58.454251] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:58.468403] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:58.469230] [INFO ] [MAIN ] CLCO: Generated 1820 derivative records from 13189 primary records. [2025-09-29T02:12:58.469375] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-29T02:12:58.503524] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-29T02:12:58.504562] [INFO ] [MAIN ] CLDT: Loaded 26082 primary data records. [2025-09-29T02:12:58.524628] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1820 records). [2025-09-29T02:12:58.556381] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-29T02:12:58.584809] [INFO ] [MAIN ] Derivative Progress: 432/2211 symbols completed. CLCO took 1.3s. Estimated remaining: 12m 28s. Rate: 142.7 symbols/min [2025-09-29T02:12:58.599364] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:58.895849] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-29T02:12:58.896455] [INFO ] [MAIN ] CLF: Loaded 54521 primary data records. [2025-09-29T02:12:59.025597] [DEBUG] [LOCAL ] CLH: Loaded 28493 existing records from primary storage. [2025-09-29T02:12:59.060163] [INFO ] [MAIN ] CLH: Loaded 28493 primary data records. [2025-09-29T02:12:59.648416] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:59.649625] [INFO ] [MAIN ] CLDT: Generated 1820 derivative records from 26082 primary records. [2025-09-29T02:12:59.650030] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-29T02:12:59.670391] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1820 records). [2025-09-29T02:12:59.671544] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-29T02:12:59.674456] [INFO ] [MAIN ] Derivative Progress: 433/2211 symbols completed. CLDT took 1.2s. Estimated remaining: 12m 30s. Rate: 142.2 symbols/min [2025-09-29T02:12:59.695858] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:59.696629] [INFO ] [MAIN ] CLF: Generated 1820 derivative records from 54521 primary records. [2025-09-29T02:12:59.696744] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-29T02:12:59.728364] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:59.729612] [DEBUG] [LOCAL ] CLF: Derivative data saved (1820 records). [2025-09-29T02:12:59.730483] [INFO ] [MAIN ] CLH: Generated 1820 derivative records from 28493 primary records. [2025-09-29T02:12:59.730668] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-29T02:12:59.730585] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-29T02:12:59.734576] [INFO ] [MAIN ] Derivative Progress: 434/2211 symbols completed. CLF took 1.3s. Estimated remaining: 12m 28s. Rate: 142.5 symbols/min [2025-09-29T02:12:59.751406] [DEBUG] [LOCAL ] CLH: Derivative data saved (1820 records). [2025-09-29T02:12:59.751543] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-29T02:12:59.754816] [INFO ] [MAIN ] Derivative Progress: 435/2211 symbols completed. CLH took 1.2s. Estimated remaining: 12m 26s. Rate: 142.8 symbols/min [2025-09-29T02:12:59.755415] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:59.755568] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:59.755511] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:59.773187] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-29T02:12:59.773419] [INFO ] [MAIN ] CLPR: Loaded 11615 primary data records. [2025-09-29T02:13:00.153192] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-29T02:13:00.153766] [INFO ] [MAIN ] CLVT: Loaded 52713 primary data records. [2025-09-29T02:13:00.298039] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-29T02:13:00.314402] [INFO ] [MAIN ] CLS: Loaded 54412 primary data records. [2025-09-29T02:13:00.885452] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:00.886876] [INFO ] [MAIN ] CLPR: Generated 1820 derivative records from 11615 primary records. [2025-09-29T02:13:00.888336] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-29T02:13:00.909746] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1820 records). [2025-09-29T02:13:00.918510] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-29T02:13:00.926272] [INFO ] [MAIN ] Derivative Progress: 436/2211 symbols completed. CLPR took 1.2s. Estimated remaining: 12m 29s. Rate: 142.2 symbols/min [2025-09-29T02:13:00.926715] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:00.927434] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:00.930325] [INFO ] [MAIN ] CLVT: Generated 1820 derivative records from 52713 primary records. [2025-09-29T02:13:00.930813] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-29T02:13:00.948979] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1820 records). [2025-09-29T02:13:00.949335] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-29T02:13:00.953313] [INFO ] [MAIN ] Derivative Progress: 437/2211 symbols completed. CLVT took 1.2s. Estimated remaining: 12m 27s. Rate: 142.5 symbols/min [2025-09-29T02:13:00.954131] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:00.979664] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:00.980537] [INFO ] [MAIN ] CLS: Generated 1820 derivative records from 54412 primary records. [2025-09-29T02:13:00.980731] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-29T02:13:01.005532] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-29T02:13:01.006308] [INFO ] [MAIN ] CLW: Loaded 22226 primary data records. [2025-09-29T02:13:01.060942] [DEBUG] [LOCAL ] CLS: Derivative data saved (1820 records). [2025-09-29T02:13:01.097224] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-29T02:13:01.100745] [INFO ] [MAIN ] Derivative Progress: 438/2211 symbols completed. CLS took 1.3s. Estimated remaining: 12m 25s. Rate: 142.7 symbols/min [2025-09-29T02:13:01.111298] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:01.409461] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-29T02:13:01.409802] [INFO ] [MAIN ] CLX: Loaded 52189 primary data records. [2025-09-29T02:13:01.599783] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-29T02:13:01.600077] [INFO ] [MAIN ] CM: Loaded 49317 primary data records. [2025-09-29T02:13:02.130574] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:02.131835] [INFO ] [MAIN ] CLW: Generated 1820 derivative records from 22226 primary records. [2025-09-29T02:13:02.132322] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-29T02:13:02.152385] [DEBUG] [LOCAL ] CLW: Derivative data saved (1820 records). [2025-09-29T02:13:02.153347] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-29T02:13:02.156230] [INFO ] [MAIN ] Derivative Progress: 439/2211 symbols completed. CLW took 1.2s. Estimated remaining: 12m 28s. Rate: 142.2 symbols/min [2025-09-29T02:13:02.157592] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:02.177606] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:02.178552] [INFO ] [MAIN ] CLX: Generated 1820 derivative records from 52189 primary records. [2025-09-29T02:13:02.178845] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-29T02:13:02.199702] [DEBUG] [LOCAL ] CLX: Derivative data saved (1820 records). [2025-09-29T02:13:02.200013] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-29T02:13:02.202691] [INFO ] [MAIN ] Derivative Progress: 440/2211 symbols completed. CLX took 1.2s. Estimated remaining: 12m 26s. Rate: 142.5 symbols/min [2025-09-29T02:13:02.203200] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:02.224096] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:02.225150] [INFO ] [MAIN ] CM: Generated 1820 derivative records from 49317 primary records. [2025-09-29T02:13:02.225354] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-29T02:13:02.258589] [DEBUG] [LOCAL ] CM: Derivative data saved (1820 records). [2025-09-29T02:13:02.259015] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-29T02:13:02.262238] [INFO ] [MAIN ] Derivative Progress: 441/2211 symbols completed. CM took 1.2s. Estimated remaining: 12m 24s. Rate: 142.8 symbols/min [2025-09-29T02:13:02.262520] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:02.296991] [DEBUG] [LOCAL ] CMA: Loaded 50721 existing records from primary storage. [2025-09-29T02:13:02.297326] [INFO ] [MAIN ] CMA: Loaded 50721 primary data records. [2025-09-29T02:13:02.298193] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-29T02:13:02.321709] [INFO ] [MAIN ] CMBT: Loaded 22911 primary data records. [2025-09-29T02:13:02.759072] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-29T02:13:02.811415] [INFO ] [MAIN ] CMC: Loaded 46311 primary data records. [2025-09-29T02:13:03.405500] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:03.406866] [INFO ] [MAIN ] CMA: Generated 1820 derivative records from 50721 primary records. [2025-09-29T02:13:03.407098] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-29T02:13:03.426855] [DEBUG] [LOCAL ] CMA: Derivative data saved (1820 records). [2025-09-29T02:13:03.435293] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-29T02:13:03.444389] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:03.445567] [INFO ] [MAIN ] CMBT: Generated 1820 derivative records from 22911 primary records. [2025-09-29T02:13:03.443860] [INFO ] [MAIN ] Derivative Progress: 442/2211 symbols completed. CMA took 1.3s. Estimated remaining: 12m 26s. Rate: 142.2 symbols/min [2025-09-29T02:13:03.446043] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:03.445888] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-29T02:13:03.472832] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:03.477996] [INFO ] [MAIN ] CMC: Generated 1820 derivative records from 46311 primary records. [2025-09-29T02:13:03.478690] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-29T02:13:03.484047] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1820 records). [2025-09-29T02:13:03.487522] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-29T02:13:03.487228] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-29T02:13:03.487958] [INFO ] [MAIN ] CMCM: Loaded 4834 primary data records. [2025-09-29T02:13:03.496709] [INFO ] [MAIN ] Derivative Progress: 443/2211 symbols completed. CMBT took 1.3s. Estimated remaining: 12m 25s. Rate: 142.5 symbols/min [2025-09-29T02:13:03.496996] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:03.574886] [DEBUG] [LOCAL ] CMC: Derivative data saved (1820 records). [2025-09-29T02:13:03.610883] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-29T02:13:03.636395] [INFO ] [MAIN ] Derivative Progress: 444/2211 symbols completed. CMC took 1.4s. Estimated remaining: 12m 23s. Rate: 142.7 symbols/min [2025-09-29T02:13:03.637301] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:03.899325] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-29T02:13:03.899763] [INFO ] [MAIN ] CMG: Loaded 54501 primary data records. [2025-09-29T02:13:04.078503] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-29T02:13:04.130679] [INFO ] [MAIN ] CMI: Loaded 42484 primary data records. [2025-09-29T02:13:04.358283] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:04.394619] [INFO ] [MAIN ] CMCM: Generated 1820 derivative records from 4834 primary records. [2025-09-29T02:13:04.400624] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-29T02:13:04.633872] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1820 records). [2025-09-29T02:13:04.634277] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-29T02:13:04.637030] [INFO ] [MAIN ] Derivative Progress: 445/2211 symbols completed. CMCM took 1.2s. Estimated remaining: 12m 25s. Rate: 142.3 symbols/min [2025-09-29T02:13:04.637752] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:04.661975] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:04.662972] [INFO ] [MAIN ] CMG: Generated 1820 derivative records from 54501 primary records. [2025-09-29T02:13:04.663211] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-29T02:13:04.692093] [DEBUG] [LOCAL ] CMG: Derivative data saved (1820 records). [2025-09-29T02:13:04.692336] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-29T02:13:04.695269] [INFO ] [MAIN ] Derivative Progress: 446/2211 symbols completed. CMG took 1.2s. Estimated remaining: 12m 23s. Rate: 142.5 symbols/min [2025-09-29T02:13:04.695801] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:04.714424] [DEBUG] [LOCAL ] CMP: Loaded 36848 existing records from primary storage. [2025-09-29T02:13:04.728472] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:13:04.728042] [INFO ] [MAIN ] CMP: Loaded 36848 primary data records. [2025-09-29T02:13:04.729398] [INFO ] [MAIN ] CMI: Generated 1819 derivative records from 42484 primary records. [2025-09-29T02:13:04.746626] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-29T02:13:04.859361] [DEBUG] [LOCAL ] CMI: Derivative data saved (1819 records). [2025-09-29T02:13:04.881088] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-29T02:13:04.901533] [INFO ] [MAIN ] Derivative Progress: 447/2211 symbols completed. CMI took 1.3s. Estimated remaining: 12m 22s. Rate: 142.7 symbols/min [2025-09-29T02:13:04.927734] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:04.955201] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-29T02:13:04.987115] [INFO ] [MAIN ] CMPO: Loaded 40071 primary data records. [2025-09-29T02:13:05.534210] [DEBUG] [LOCAL ] CMRE: Loaded 36068 existing records from primary storage. [2025-09-29T02:13:05.535058] [INFO ] [MAIN ] CMRE: Loaded 36068 primary data records. [2025-09-29T02:13:05.808067] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:05.891279] [INFO ] [MAIN ] CMP: Generated 1820 derivative records from 36848 primary records. [2025-09-29T02:13:05.892202] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-29T02:13:05.912921] [DEBUG] [LOCAL ] CMP: Derivative data saved (1820 records). [2025-09-29T02:13:05.913553] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-29T02:13:05.916900] [INFO ] [MAIN ] Derivative Progress: 448/2211 symbols completed. CMP took 1.3s. Estimated remaining: 12m 24s. Rate: 142.2 symbols/min [2025-09-29T02:13:05.936155] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:05.937335] [INFO ] [MAIN ] CMPO: Generated 1820 derivative records from 40071 primary records. [2025-09-29T02:13:05.937578] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-09-29T02:13:05.954932] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1820 records). [2025-09-29T02:13:05.955100] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-09-29T02:13:05.958271] [INFO ] [MAIN ] Derivative Progress: 449/2211 symbols completed. CMPO took 1.3s. Estimated remaining: 12m 22s. Rate: 142.5 symbols/min [2025-09-29T02:13:05.974944] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:05.975726] [INFO ] [MAIN ] CMRE: Generated 1820 derivative records from 36068 primary records. [2025-09-29T02:13:05.975823] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-29T02:13:05.992172] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1820 records). [2025-09-29T02:13:05.992259] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-29T02:13:05.995674] [INFO ] [MAIN ] Derivative Progress: 450/2211 symbols completed. CMRE took 1.1s. Estimated remaining: 12m 20s. Rate: 142.8 symbols/min [2025-09-29T02:13:05.996348] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:05.996248] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:05.996630] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:06.007907] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-29T02:13:06.008301] [INFO ] [MAIN ] CMSA: Loaded 3421 primary data records. [2025-09-29T02:13:06.046584] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-29T02:13:06.087525] [INFO ] [MAIN ] CMSC: Loaded 5131 primary data records. [2025-09-29T02:13:06.698280] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-29T02:13:06.700737] [INFO ] [MAIN ] CMS: Loaded 53371 primary data records. [2025-09-29T02:13:07.048914] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:07.054056] [INFO ] [MAIN ] CMSA: Generated 1820 derivative records from 3421 primary records. [2025-09-29T02:13:07.054973] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-29T02:13:07.068021] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:07.069678] [INFO ] [MAIN ] CMSC: Generated 1820 derivative records from 5131 primary records. [2025-09-29T02:13:07.070076] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-29T02:13:07.086187] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1820 records). [2025-09-29T02:13:07.094214] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-29T02:13:07.102949] [INFO ] [MAIN ] Derivative Progress: 451/2211 symbols completed. CMSA took 1.1s. Estimated remaining: 12m 22s. Rate: 142.3 symbols/min [2025-09-29T02:13:07.103852] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:07.105669] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1820 records). [2025-09-29T02:13:07.105961] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-29T02:13:07.109708] [INFO ] [MAIN ] Derivative Progress: 452/2211 symbols completed. CMSC took 1.1s. Estimated remaining: 12m 20s. Rate: 142.6 symbols/min [2025-09-29T02:13:07.110379] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:07.130739] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:07.134515] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-29T02:13:07.135556] [INFO ] [MAIN ] CMS: Generated 1820 derivative records from 53371 primary records. [2025-09-29T02:13:07.135715] [INFO ] [MAIN ] CMSD: Loaded 8184 primary data records. [2025-09-29T02:13:07.157547] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-29T02:13:07.274788] [DEBUG] [LOCAL ] CMS: Derivative data saved (1820 records). [2025-09-29T02:13:07.327211] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-29T02:13:07.362875] [INFO ] [MAIN ] Derivative Progress: 453/2211 symbols completed. CMS took 1.4s. Estimated remaining: 12m 19s. Rate: 142.7 symbols/min [2025-09-29T02:13:07.533375] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:07.551727] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-29T02:13:07.552436] [INFO ] [MAIN ] CMTG: Loaded 37931 primary data records. [2025-09-29T02:13:07.658745] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-29T02:13:07.680973] [INFO ] [MAIN ] CMU: Loaded 7303 primary data records. [2025-09-29T02:13:08.259495] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:08.262860] [INFO ] [MAIN ] CMSD: Generated 1820 derivative records from 8184 primary records. [2025-09-29T02:13:08.263665] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-29T02:13:08.283083] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1820 records). [2025-09-29T02:13:08.284073] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-29T02:13:08.286997] [INFO ] [MAIN ] Derivative Progress: 454/2211 symbols completed. CMSD took 1.2s. Estimated remaining: 12m 21s. Rate: 142.4 symbols/min [2025-09-29T02:13:08.287392] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:08.325635] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:08.325316] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:08.326497] [INFO ] [MAIN ] CMU: Generated 1820 derivative records from 7303 primary records. [2025-09-29T02:13:08.327170] [INFO ] [MAIN ] CMTG: Generated 1820 derivative records from 37931 primary records. [2025-09-29T02:13:08.327596] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-29T02:13:08.337021] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-29T02:13:08.365896] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1820 records). [2025-09-29T02:13:08.366143] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-29T02:13:08.372693] [INFO ] [MAIN ] Derivative Progress: 455/2211 symbols completed. CMTG took 1.3s. Estimated remaining: 12m 19s. Rate: 142.6 symbols/min [2025-09-29T02:13:08.374078] [DEBUG] [LOCAL ] CMU: Derivative data saved (1820 records). [2025-09-29T02:13:08.374257] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:08.374697] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-29T02:13:08.378245] [INFO ] [MAIN ] Derivative Progress: 456/2211 symbols completed. CMU took 0.8s. Estimated remaining: 12m 17s. Rate: 142.9 symbols/min [2025-09-29T02:13:08.389047] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:08.395422] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-29T02:13:08.396062] [INFO ] [MAIN ] CNA: Loaded 33235 primary data records. [2025-09-29T02:13:08.498589] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-29T02:13:08.517706] [INFO ] [MAIN ] CNF: Loaded 11166 primary data records. [2025-09-29T02:13:08.970630] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-09-29T02:13:08.971598] [INFO ] [MAIN ] CNC: Loaded 54518 primary data records. [2025-09-29T02:13:09.462407] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:09.464733] [INFO ] [MAIN ] CNA: Generated 1820 derivative records from 33235 primary records. [2025-09-29T02:13:09.465127] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-29T02:13:09.487124] [DEBUG] [LOCAL ] CNA: Derivative data saved (1820 records). [2025-09-29T02:13:09.499964] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-29T02:13:09.503075] [INFO ] [MAIN ] Derivative Progress: 457/2211 symbols completed. CNA took 1.2s. Estimated remaining: 12m 19s. Rate: 142.4 symbols/min [2025-09-29T02:13:09.503404] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:09.503986] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:13:09.505434] [INFO ] [MAIN ] CNF: Generated 1819 derivative records from 11166 primary records. [2025-09-29T02:13:09.505783] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-29T02:13:09.526023] [DEBUG] [LOCAL ] CNF: Derivative data saved (1819 records). [2025-09-29T02:13:09.526483] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-29T02:13:09.529670] [INFO ] [MAIN ] Derivative Progress: 458/2211 symbols completed. CNF took 1.1s. Estimated remaining: 12m 17s. Rate: 142.7 symbols/min [2025-09-29T02:13:09.544753] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:09.530288] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:09.545692] [INFO ] [MAIN ] CNC: Generated 1820 derivative records from 54518 primary records. [2025-09-29T02:13:09.546300] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-29T02:13:09.563871] [DEBUG] [LOCAL ] CNC: Derivative data saved (1820 records). [2025-09-29T02:13:09.564341] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-29T02:13:09.568138] [INFO ] [MAIN ] Derivative Progress: 459/2211 symbols completed. CNC took 1.2s. Estimated remaining: 12m 15s. Rate: 143.0 symbols/min [2025-09-29T02:13:09.568449] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:09.627359] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-29T02:13:09.627759] [INFO ] [MAIN ] CNH: Loaded 54337 primary data records. [2025-09-29T02:13:09.754462] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-29T02:13:09.762459] [INFO ] [MAIN ] CNI: Loaded 52419 primary data records. [2025-09-29T02:13:09.983615] [DEBUG] [LOCAL ] CNK: Loaded 53658 existing records from primary storage. [2025-09-29T02:13:10.045277] [INFO ] [MAIN ] CNK: Loaded 53658 primary data records. [2025-09-29T02:13:10.745908] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:10.748549] [INFO ] [MAIN ] CNH: Generated 1820 derivative records from 54337 primary records. [2025-09-29T02:13:10.749109] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-29T02:13:10.767438] [DEBUG] [LOCAL ] CNH: Derivative data saved (1820 records). [2025-09-29T02:13:10.767844] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-29T02:13:10.770951] [INFO ] [MAIN ] Derivative Progress: 460/2211 symbols completed. CNH took 1.3s. Estimated remaining: 12m 18s. Rate: 142.4 symbols/min [2025-09-29T02:13:10.771308] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:10.789537] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:10.791885] [INFO ] [MAIN ] CNI: Generated 1820 derivative records from 52419 primary records. [2025-09-29T02:13:10.792184] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-29T02:13:10.806450] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:10.807616] [INFO ] [MAIN ] CNK: Generated 1820 derivative records from 53658 primary records. [2025-09-29T02:13:10.808061] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-29T02:13:10.838511] [DEBUG] [LOCAL ] CNI: Derivative data saved (1820 records). [2025-09-29T02:13:10.841253] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-29T02:13:10.842522] [DEBUG] [LOCAL ] CNK: Derivative data saved (1820 records). [2025-09-29T02:13:10.845937] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-29T02:13:10.845677] [INFO ] [MAIN ] Derivative Progress: 461/2211 symbols completed. CNI took 1.3s. Estimated remaining: 12m 16s. Rate: 142.6 symbols/min [2025-09-29T02:13:10.849873] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:10.849952] [INFO ] [MAIN ] Derivative Progress: 462/2211 symbols completed. CNK took 1.3s. Estimated remaining: 12m 14s. Rate: 143.0 symbols/min [2025-09-29T02:13:10.850674] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:10.894966] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-29T02:13:10.895233] [INFO ] [MAIN ] CNM: Loaded 51747 primary data records. [2025-09-29T02:13:11.094967] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-29T02:13:11.134189] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-29T02:13:11.140978] [INFO ] [MAIN ] CNNE: Loaded 37257 primary data records. [2025-09-29T02:13:11.141263] [INFO ] [MAIN ] CNMD: Loaded 32884 primary data records. [2025-09-29T02:13:12.006220] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:12.007943] [INFO ] [MAIN ] CNM: Generated 1820 derivative records from 51747 primary records. [2025-09-29T02:13:12.008088] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-29T02:13:12.027604] [DEBUG] [LOCAL ] CNM: Derivative data saved (1820 records). [2025-09-29T02:13:12.028114] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-29T02:13:12.030705] [INFO ] [MAIN ] Derivative Progress: 463/2211 symbols completed. CNM took 1.3s. Estimated remaining: 12m 17s. Rate: 142.4 symbols/min [2025-09-29T02:13:12.063897] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:12.064242] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:12.065248] [INFO ] [MAIN ] CNMD: Generated 1820 derivative records from 32884 primary records. [2025-09-29T02:13:12.066082] [INFO ] [MAIN ] CNNE: Generated 1820 derivative records from 37257 primary records. [2025-09-29T02:13:12.066280] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-29T02:13:12.066426] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-29T02:13:12.100494] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1820 records). [2025-09-29T02:13:12.099193] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1820 records). [2025-09-29T02:13:12.100809] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-29T02:13:12.100728] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-29T02:13:12.104277] [INFO ] [MAIN ] Derivative Progress: 464/2211 symbols completed. CNMD took 1.3s. Estimated remaining: 12m 15s. Rate: 142.7 symbols/min [2025-09-29T02:13:12.107448] [INFO ] [MAIN ] Derivative Progress: 465/2211 symbols completed. CNNE took 1.3s. Estimated remaining: 12m 13s. Rate: 143.0 symbols/min [2025-09-29T02:13:12.107865] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:12.108093] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:12.107970] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:12.209925] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-29T02:13:12.210327] [INFO ] [MAIN ] CNO: Loaded 41901 primary data records. [2025-09-29T02:13:12.211510] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-29T02:13:12.236606] [INFO ] [MAIN ] CNQ: Loaded 54361 primary data records. [2025-09-29T02:13:12.382693] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-29T02:13:12.438125] [INFO ] [MAIN ] CNP: Loaded 54249 primary data records. [2025-09-29T02:13:13.264797] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:13.266579] [INFO ] [MAIN ] CNO: Generated 1820 derivative records from 41901 primary records. [2025-09-29T02:13:13.267239] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-29T02:13:13.281717] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:13.282713] [INFO ] [MAIN ] CNQ: Generated 1820 derivative records from 54361 primary records. [2025-09-29T02:13:13.290748] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-29T02:13:13.319692] [DEBUG] [LOCAL ] CNO: Derivative data saved (1820 records). [2025-09-29T02:13:13.318100] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1820 records). [2025-09-29T02:13:13.320245] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-29T02:13:13.320305] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-29T02:13:13.322968] [INFO ] [MAIN ] Derivative Progress: 466/2211 symbols completed. CNO took 1.2s. Estimated remaining: 12m 15s. Rate: 142.4 symbols/min [2025-09-29T02:13:13.323362] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:13.341234] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:13.340531] [INFO ] [MAIN ] Derivative Progress: 467/2211 symbols completed. CNQ took 1.2s. Estimated remaining: 12m 13s. Rate: 142.7 symbols/min [2025-09-29T02:13:13.342615] [INFO ] [MAIN ] CNP: Generated 1820 derivative records from 54249 primary records. [2025-09-29T02:13:13.343367] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:13.343680] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-29T02:13:13.362368] [DEBUG] [LOCAL ] CNP: Derivative data saved (1820 records). [2025-09-29T02:13:13.362767] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-29T02:13:13.366528] [INFO ] [MAIN ] Derivative Progress: 468/2211 symbols completed. CNP took 1.3s. Estimated remaining: 12m 12s. Rate: 143.0 symbols/min [2025-09-29T02:13:13.366811] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:13.384187] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-29T02:13:13.384411] [INFO ] [MAIN ] CNS: Loaded 21245 primary data records. [2025-09-29T02:13:13.765686] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-29T02:13:13.784959] [INFO ] [MAIN ] CNX: Loaded 52150 primary data records. [2025-09-29T02:13:13.792089] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-29T02:13:13.800260] [INFO ] [MAIN ] CODI: Loaded 40312 primary data records. [2025-09-29T02:13:14.506188] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:14.507299] [INFO ] [MAIN ] CNS: Generated 1820 derivative records from 21245 primary records. [2025-09-29T02:13:14.509617] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-29T02:13:14.528771] [DEBUG] [LOCAL ] CNS: Derivative data saved (1820 records). [2025-09-29T02:13:14.529933] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-29T02:13:14.532755] [INFO ] [MAIN ] Derivative Progress: 469/2211 symbols completed. CNS took 1.2s. Estimated remaining: 12m 14s. Rate: 142.4 symbols/min [2025-09-29T02:13:14.534225] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:14.557078] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:14.558235] [INFO ] [MAIN ] CNX: Generated 1820 derivative records from 52150 primary records. [2025-09-29T02:13:14.558487] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-29T02:13:14.581386] [DEBUG] [LOCAL ] CNX: Derivative data saved (1820 records). [2025-09-29T02:13:14.590218] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-29T02:13:14.595874] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:14.599545] [INFO ] [MAIN ] Derivative Progress: 470/2211 symbols completed. CNX took 1.3s. Estimated remaining: 12m 12s. Rate: 142.7 symbols/min [2025-09-29T02:13:14.600950] [INFO ] [MAIN ] CODI: Generated 1820 derivative records from 40312 primary records. [2025-09-29T02:13:14.616267] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:14.616468] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-29T02:13:14.639370] [DEBUG] [LOCAL ] CODI: Derivative data saved (1820 records). [2025-09-29T02:13:14.639690] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-29T02:13:14.658552] [INFO ] [MAIN ] Derivative Progress: 471/2211 symbols completed. CODI took 1.3s. Estimated remaining: 12m 10s. Rate: 142.9 symbols/min [2025-09-29T02:13:14.659184] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:14.661956] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-29T02:13:14.662141] [INFO ] [MAIN ] COF: Loaded 54389 primary data records. [2025-09-29T02:13:15.037322] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-29T02:13:15.054827] [INFO ] [MAIN ] COHR: Loaded 54144 primary data records. [2025-09-29T02:13:15.205131] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-29T02:13:15.233731] [INFO ] [MAIN ] COLD: Loaded 52785 primary data records. [2025-09-29T02:13:15.656801] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:15.793278] [INFO ] [MAIN ] COF: Generated 1820 derivative records from 54389 primary records. [2025-09-29T02:13:15.794571] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-29T02:13:15.815427] [DEBUG] [LOCAL ] COF: Derivative data saved (1820 records). [2025-09-29T02:13:15.815999] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-29T02:13:15.819253] [INFO ] [MAIN ] Derivative Progress: 472/2211 symbols completed. COF took 1.3s. Estimated remaining: 12m 13s. Rate: 142.4 symbols/min [2025-09-29T02:13:15.820268] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:15.840025] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:15.842229] [INFO ] [MAIN ] COHR: Generated 1820 derivative records from 54144 primary records. [2025-09-29T02:13:15.842431] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-29T02:13:15.861422] [DEBUG] [LOCAL ] COHR: Derivative data saved (1820 records). [2025-09-29T02:13:15.861792] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-29T02:13:15.864914] [INFO ] [MAIN ] Derivative Progress: 473/2211 symbols completed. COHR took 1.2s. Estimated remaining: 12m 11s. Rate: 142.7 symbols/min [2025-09-29T02:13:15.865546] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:15.882596] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:15.883442] [INFO ] [MAIN ] COLD: Generated 1820 derivative records from 52785 primary records. [2025-09-29T02:13:15.883559] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-29T02:13:15.915509] [DEBUG] [LOCAL ] COLD: Derivative data saved (1820 records). [2025-09-29T02:13:15.915886] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-29T02:13:15.919082] [INFO ] [MAIN ] Derivative Progress: 474/2211 symbols completed. COLD took 1.3s. Estimated remaining: 12m 9s. Rate: 142.9 symbols/min [2025-09-29T02:13:15.919546] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:15.941763] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-29T02:13:15.942100] [INFO ] [MAIN ] COMP: Loaded 54166 primary data records. [2025-09-29T02:13:16.126229] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-29T02:13:16.114599] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-29T02:13:16.335734] [INFO ] [MAIN ] CON: Loaded 39289 primary data records. [2025-09-29T02:13:16.344815] [INFO ] [MAIN ] COOK: Loaded 24850 primary data records. [2025-09-29T02:13:17.045264] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:17.046759] [INFO ] [MAIN ] COMP: Generated 1820 derivative records from 54166 primary records. [2025-09-29T02:13:17.047147] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-29T02:13:17.067615] [DEBUG] [LOCAL ] COMP: Derivative data saved (1820 records). [2025-09-29T02:13:17.070965] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-29T02:13:17.074288] [INFO ] [MAIN ] Derivative Progress: 475/2211 symbols completed. COMP took 1.3s. Estimated remaining: 12m 11s. Rate: 142.4 symbols/min [2025-09-29T02:13:17.074719] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:17.093026] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:17.106554] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:17.108976] [INFO ] [MAIN ] CON: Generated 1820 derivative records from 39289 primary records. [2025-09-29T02:13:17.109292] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-29T02:13:17.107845] [INFO ] [MAIN ] COOK: Generated 1820 derivative records from 24850 primary records. [2025-09-29T02:13:17.110157] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-29T02:13:17.139845] [DEBUG] [LOCAL ] CON: Derivative data saved (1820 records). [2025-09-29T02:13:17.141468] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-29T02:13:17.147764] [INFO ] [MAIN ] Derivative Progress: 476/2211 symbols completed. CON took 1.3s. Estimated remaining: 12m 10s. Rate: 142.7 symbols/min [2025-09-29T02:13:17.148071] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:17.144805] [DEBUG] [LOCAL ] COOK: Derivative data saved (1820 records). [2025-09-29T02:13:17.148404] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-29T02:13:17.151912] [INFO ] [MAIN ] Derivative Progress: 477/2211 symbols completed. COOK took 1.2s. Estimated remaining: 12m 8s. Rate: 143.0 symbols/min [2025-09-29T02:13:17.152370] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:17.198910] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-29T02:13:17.199243] [INFO ] [MAIN ] COP: Loaded 54507 primary data records. [2025-09-29T02:13:17.587693] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-29T02:13:17.585538] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-29T02:13:17.587996] [INFO ] [MAIN ] COTY: Loaded 54014 primary data records. [2025-09-29T02:13:17.588239] [INFO ] [MAIN ] COR: Loaded 47937 primary data records. [2025-09-29T02:13:18.287430] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:18.288633] [INFO ] [MAIN ] COP: Generated 1820 derivative records from 54507 primary records. [2025-09-29T02:13:18.288988] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-29T02:13:18.308676] [DEBUG] [LOCAL ] COP: Derivative data saved (1820 records). [2025-09-29T02:13:18.309813] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-29T02:13:18.312597] [INFO ] [MAIN ] Derivative Progress: 478/2211 symbols completed. COP took 1.2s. Estimated remaining: 12m 10s. Rate: 142.4 symbols/min [2025-09-29T02:13:18.330091] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:18.333194] [INFO ] [MAIN ] COR: Generated 1820 derivative records from 47937 primary records. [2025-09-29T02:13:18.334189] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-29T02:13:18.360117] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:18.364433] [DEBUG] [LOCAL ] COR: Derivative data saved (1820 records). [2025-09-29T02:13:18.365548] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-29T02:13:18.365473] [INFO ] [MAIN ] COTY: Generated 1820 derivative records from 54014 primary records. [2025-09-29T02:13:18.368576] [INFO ] [MAIN ] Derivative Progress: 479/2211 symbols completed. COR took 1.2s. Estimated remaining: 12m 8s. Rate: 142.7 symbols/min [2025-09-29T02:13:18.365770] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-29T02:13:18.384929] [DEBUG] [LOCAL ] COTY: Derivative data saved (1820 records). [2025-09-29T02:13:18.385029] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-29T02:13:18.387804] [INFO ] [MAIN ] Derivative Progress: 480/2211 symbols completed. COTY took 1.2s. Estimated remaining: 12m 6s. Rate: 143.0 symbols/min [2025-09-29T02:13:18.388373] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:18.388275] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:18.388475] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:18.428045] [DEBUG] [LOCAL ] CPA: Loaded 29208 existing records from primary storage. [2025-09-29T02:13:18.428224] [INFO ] [MAIN ] CPA: Loaded 29208 primary data records. [2025-09-29T02:13:18.637147] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-29T02:13:18.663427] [INFO ] [MAIN ] COUR: Loaded 49636 primary data records. [2025-09-29T02:13:18.676156] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-29T02:13:18.859680] [INFO ] [MAIN ] CP: Loaded 54051 primary data records. [2025-09-29T02:13:19.545987] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:19.547265] [INFO ] [MAIN ] CPA: Generated 1820 derivative records from 29208 primary records. [2025-09-29T02:13:19.547495] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-29T02:13:19.571949] [DEBUG] [LOCAL ] CPA: Derivative data saved (1820 records). [2025-09-29T02:13:19.572212] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-29T02:13:19.576256] [INFO ] [MAIN ] Derivative Progress: 481/2211 symbols completed. CPA took 1.2s. Estimated remaining: 12m 9s. Rate: 142.4 symbols/min [2025-09-29T02:13:19.579129] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:19.593882] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:19.595241] [INFO ] [MAIN ] COUR: Generated 1820 derivative records from 49636 primary records. [2025-09-29T02:13:19.597452] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-29T02:13:19.626526] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:19.638926] [INFO ] [MAIN ] CP: Generated 1820 derivative records from 54051 primary records. [2025-09-29T02:13:19.641230] [DEBUG] [LOCAL ] COUR: Derivative data saved (1820 records). [2025-09-29T02:13:19.641568] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-29T02:13:19.644917] [INFO ] [MAIN ] Derivative Progress: 482/2211 symbols completed. COUR took 1.3s. Estimated remaining: 12m 7s. Rate: 142.7 symbols/min [2025-09-29T02:13:19.641433] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-29T02:13:19.645257] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:19.674702] [DEBUG] [LOCAL ] CP: Derivative data saved (1820 records). [2025-09-29T02:13:19.676426] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-29T02:13:19.679380] [INFO ] [MAIN ] Derivative Progress: 483/2211 symbols completed. CP took 1.3s. Estimated remaining: 12m 5s. Rate: 142.9 symbols/min [2025-09-29T02:13:19.679682] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:19.685713] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-29T02:13:19.686134] [INFO ] [MAIN ] CPAY: Loaded 31286 primary data records. [2025-09-29T02:13:19.739235] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-29T02:13:19.786074] [INFO ] [MAIN ] CPF: Loaded 15618 primary data records. [2025-09-29T02:13:19.940983] [DEBUG] [LOCAL ] CPK: Loaded 13588 existing records from primary storage. [2025-09-29T02:13:19.960922] [INFO ] [MAIN ] CPK: Loaded 13588 primary data records. [2025-09-29T02:13:20.866613] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:20.868791] [INFO ] [MAIN ] CPAY: Generated 1820 derivative records from 31286 primary records. [2025-09-29T02:13:20.869092] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-29T02:13:20.893255] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:20.902680] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1820 records). [2025-09-29T02:13:20.902945] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-29T02:13:20.906083] [INFO ] [MAIN ] Derivative Progress: 484/2211 symbols completed. CPAY took 1.3s. Estimated remaining: 12m 8s. Rate: 142.4 symbols/min [2025-09-29T02:13:20.906999] [INFO ] [MAIN ] CPF: Generated 1820 derivative records from 15618 primary records. [2025-09-29T02:13:20.908083] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:20.908297] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-29T02:13:20.936754] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:20.942374] [INFO ] [MAIN ] CPK: Generated 1820 derivative records from 13588 primary records. [2025-09-29T02:13:20.942695] [DEBUG] [LOCAL ] CPF: Derivative data saved (1820 records). [2025-09-29T02:13:20.942998] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-29T02:13:20.945832] [INFO ] [MAIN ] Derivative Progress: 485/2211 symbols completed. CPF took 1.3s. Estimated remaining: 12m 6s. Rate: 142.6 symbols/min [2025-09-29T02:13:20.942904] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-29T02:13:20.946071] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:20.969552] [DEBUG] [LOCAL ] CPK: Derivative data saved (1820 records). [2025-09-29T02:13:20.969773] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-29T02:13:20.972675] [INFO ] [MAIN ] Derivative Progress: 486/2211 symbols completed. CPK took 1.3s. Estimated remaining: 12m 4s. Rate: 142.9 symbols/min [2025-09-29T02:13:20.972951] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:21.050035] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-29T02:13:21.050480] [INFO ] [MAIN ] CPS: Loaded 26476 primary data records. [2025-09-29T02:13:21.065124] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-29T02:13:21.093581] [INFO ] [MAIN ] CPNG: Loaded 54450 primary data records. [2025-09-29T02:13:21.274075] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-29T02:13:21.328720] [INFO ] [MAIN ] CPRI: Loaded 53326 primary data records. [2025-09-29T02:13:22.088603] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:22.090639] [INFO ] [MAIN ] CPS: Generated 1820 derivative records from 26476 primary records. [2025-09-29T02:13:22.090889] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-29T02:13:22.119812] [DEBUG] [LOCAL ] CPS: Derivative data saved (1820 records). [2025-09-29T02:13:22.125543] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:22.125601] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-29T02:13:22.126689] [INFO ] [MAIN ] CPNG: Generated 1820 derivative records from 54450 primary records. [2025-09-29T02:13:22.130211] [INFO ] [MAIN ] Derivative Progress: 487/2211 symbols completed. CPS took 1.2s. Estimated remaining: 12m 6s. Rate: 142.4 symbols/min [2025-09-29T02:13:22.132298] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:22.132691] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-29T02:13:22.159788] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:22.161250] [INFO ] [MAIN ] CPRI: Generated 1820 derivative records from 53326 primary records. [2025-09-29T02:13:22.161383] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-29T02:13:22.181070] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1820 records). [2025-09-29T02:13:22.181888] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-29T02:13:22.186596] [INFO ] [MAIN ] Derivative Progress: 488/2211 symbols completed. CPNG took 1.3s. Estimated remaining: 12m 5s. Rate: 142.7 symbols/min [2025-09-29T02:13:22.188348] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1820 records). [2025-09-29T02:13:22.188479] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:22.188605] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-29T02:13:22.192783] [INFO ] [MAIN ] Derivative Progress: 489/2211 symbols completed. CPRI took 1.2s. Estimated remaining: 12m 3s. Rate: 142.9 symbols/min [2025-09-29T02:13:22.193138] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:22.243935] [DEBUG] [LOCAL ] CQP: Loaded 20033 existing records from primary storage. [2025-09-29T02:13:22.245326] [DEBUG] [LOCAL ] CPT: Loaded 45034 existing records from primary storage. [2025-09-29T02:13:22.245583] [INFO ] [MAIN ] CQP: Loaded 20033 primary data records. [2025-09-29T02:13:22.245696] [INFO ] [MAIN ] CPT: Loaded 45034 primary data records. [2025-09-29T02:13:22.357918] [DEBUG] [LOCAL ] CR: Loaded 25019 existing records from primary storage. [2025-09-29T02:13:22.441317] [INFO ] [MAIN ] CR: Loaded 25019 primary data records. [2025-09-29T02:13:23.338501] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:23.337979] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:23.340222] [INFO ] [MAIN ] CPT: Generated 1820 derivative records from 45034 primary records. [2025-09-29T02:13:23.339420] [INFO ] [MAIN ] CQP: Generated 1820 derivative records from 20033 primary records. [2025-09-29T02:13:23.340392] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-29T02:13:23.340790] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-29T02:13:23.370771] [DEBUG] [LOCAL ] CQP: Derivative data saved (1820 records). [2025-09-29T02:13:23.376453] [DEBUG] [LOCAL ] CPT: Derivative data saved (1820 records). [2025-09-29T02:13:23.376729] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-29T02:13:23.377143] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-29T02:13:23.379632] [INFO ] [MAIN ] Derivative Progress: 490/2211 symbols completed. CQP took 1.2s. Estimated remaining: 12m 5s. Rate: 142.4 symbols/min [2025-09-29T02:13:23.383211] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:23.383574] [INFO ] [MAIN ] Derivative Progress: 491/2211 symbols completed. CPT took 1.3s. Estimated remaining: 12m 3s. Rate: 142.7 symbols/min [2025-09-29T02:13:23.392177] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:23.398499] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:23.399804] [INFO ] [MAIN ] CR: Generated 1820 derivative records from 25019 primary records. [2025-09-29T02:13:23.400073] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-29T02:13:23.421291] [DEBUG] [LOCAL ] CR: Derivative data saved (1820 records). [2025-09-29T02:13:23.421562] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-29T02:13:23.424611] [INFO ] [MAIN ] Derivative Progress: 492/2211 symbols completed. CR took 1.2s. Estimated remaining: 12m 1s. Rate: 143.0 symbols/min [2025-09-29T02:13:23.431021] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:23.431633] [DEBUG] [LOCAL ] CRBD: Loaded 9131 existing records from primary storage. [2025-09-29T02:13:23.433811] [INFO ] [MAIN ] CRBD: Loaded 9131 primary data records. [2025-09-29T02:13:23.825557] [DEBUG] [LOCAL ] CRC: Loaded 44946 existing records from primary storage. [2025-09-29T02:13:23.824127] [DEBUG] [LOCAL ] CRBG: Loaded 53110 existing records from primary storage. [2025-09-29T02:13:23.825912] [INFO ] [MAIN ] CRC: Loaded 44946 primary data records. [2025-09-29T02:13:23.826239] [INFO ] [MAIN ] CRBG: Loaded 53110 primary data records. [2025-09-29T02:13:24.537136] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:24.538990] [INFO ] [MAIN ] CRBD: Generated 1820 derivative records from 9131 primary records. [2025-09-29T02:13:24.539601] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-29T02:13:24.559400] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1820 records). [2025-09-29T02:13:24.559820] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-29T02:13:24.562632] [INFO ] [MAIN ] Derivative Progress: 493/2211 symbols completed. CRBD took 1.2s. Estimated remaining: 12m 4s. Rate: 142.5 symbols/min [2025-09-29T02:13:24.583079] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:24.586477] [INFO ] [MAIN ] CRC: Generated 1820 derivative records from 44946 primary records. [2025-09-29T02:13:24.586746] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-29T02:13:24.608937] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:24.614954] [INFO ] [MAIN ] CRBG: Generated 1820 derivative records from 53110 primary records. [2025-09-29T02:13:24.617206] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-29T02:13:24.619004] [DEBUG] [LOCAL ] CRC: Derivative data saved (1820 records). [2025-09-29T02:13:24.619101] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-29T02:13:24.622056] [INFO ] [MAIN ] Derivative Progress: 494/2211 symbols completed. CRC took 1.2s. Estimated remaining: 12m 2s. Rate: 142.7 symbols/min [2025-09-29T02:13:24.637475] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1820 records). [2025-09-29T02:13:24.637634] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-29T02:13:24.641098] [INFO ] [MAIN ] Derivative Progress: 495/2211 symbols completed. CRBG took 1.2s. Estimated remaining: 12m 0s. Rate: 143.0 symbols/min [2025-09-29T02:13:24.641635] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:24.641762] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:24.641852] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:24.772036] [DEBUG] [LOCAL ] CRGY: Loaded 53290 existing records from primary storage. [2025-09-29T02:13:24.773168] [DEBUG] [LOCAL ] CRI: Loaded 50713 existing records from primary storage. [2025-09-29T02:13:24.774172] [DEBUG] [LOCAL ] CRH: Loaded 54243 existing records from primary storage. [2025-09-29T02:13:24.774489] [INFO ] [MAIN ] CRGY: Loaded 53290 primary data records. [2025-09-29T02:13:24.774666] [INFO ] [MAIN ] CRI: Loaded 50713 primary data records. [2025-09-29T02:13:24.774988] [INFO ] [MAIN ] CRH: Loaded 54243 primary data records. [2025-09-29T02:13:25.845590] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:25.855055] [INFO ] [MAIN ] CRH: Generated 1820 derivative records from 54243 primary records. [2025-09-29T02:13:25.872942] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-29T02:13:25.873348] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:25.872595] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:25.874797] [INFO ] [MAIN ] CRI: Generated 1820 derivative records from 50713 primary records. [2025-09-29T02:13:25.876096] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-29T02:13:25.875805] [INFO ] [MAIN ] CRGY: Generated 1820 derivative records from 53290 primary records. [2025-09-29T02:13:25.884163] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-29T02:13:25.926614] [DEBUG] [LOCAL ] CRH: Derivative data saved (1820 records). [2025-09-29T02:13:25.926866] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-29T02:13:25.923200] [DEBUG] [LOCAL ] CRI: Derivative data saved (1820 records). [2025-09-29T02:13:25.927258] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-29T02:13:25.930316] [INFO ] [MAIN ] Derivative Progress: 496/2211 symbols completed. CRI took 1.3s. Estimated remaining: 12m 3s. Rate: 142.4 symbols/min [2025-09-29T02:13:25.934327] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:25.935042] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1820 records). [2025-09-29T02:13:25.935195] [INFO ] [MAIN ] Derivative Progress: 497/2211 symbols completed. CRH took 1.3s. Estimated remaining: 12m 1s. Rate: 142.7 symbols/min [2025-09-29T02:13:25.935803] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-29T02:13:25.938489] [INFO ] [MAIN ] Derivative Progress: 498/2211 symbols completed. CRGY took 1.3s. Estimated remaining: 11m 59s. Rate: 143.0 symbols/min [2025-09-29T02:13:25.938946] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:25.935901] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:26.042459] [DEBUG] [LOCAL ] CRK: Loaded 52891 existing records from primary storage. [2025-09-29T02:13:26.043272] [DEBUG] [LOCAL ] CRL: Loaded 43853 existing records from primary storage. [2025-09-29T02:13:26.058281] [INFO ] [MAIN ] CRL: Loaded 43853 primary data records. [2025-09-29T02:13:26.058401] [INFO ] [MAIN ] CRK: Loaded 52891 primary data records. [2025-09-29T02:13:26.071718] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-29T02:13:26.213716] [INFO ] [MAIN ] CRM: Loaded 54550 primary data records. [2025-09-29T02:13:27.083981] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:27.084958] [INFO ] [MAIN ] CRL: Generated 1820 derivative records from 43853 primary records. [2025-09-29T02:13:27.085202] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-29T02:13:27.105937] [DEBUG] [LOCAL ] CRL: Derivative data saved (1820 records). [2025-09-29T02:13:27.119429] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-29T02:13:27.122485] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:27.121982] [INFO ] [MAIN ] Derivative Progress: 499/2211 symbols completed. CRL took 1.2s. Estimated remaining: 12m 1s. Rate: 142.4 symbols/min [2025-09-29T02:13:27.125299] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:27.125168] [INFO ] [MAIN ] CRK: Generated 1820 derivative records from 52891 primary records. [2025-09-29T02:13:27.125635] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-29T02:13:27.158519] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:27.157977] [DEBUG] [LOCAL ] CRK: Derivative data saved (1820 records). [2025-09-29T02:13:27.159309] [INFO ] [MAIN ] CRM: Generated 1820 derivative records from 54550 primary records. [2025-09-29T02:13:27.159476] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-29T02:13:27.162511] [INFO ] [MAIN ] Derivative Progress: 500/2211 symbols completed. CRK took 1.2s. Estimated remaining: 11m 59s. Rate: 142.7 symbols/min [2025-09-29T02:13:27.162829] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:27.162961] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-29T02:13:27.187463] [DEBUG] [LOCAL ] CRT: Loaded 5018 existing records from primary storage. [2025-09-29T02:13:27.183804] [DEBUG] [LOCAL ] CRM: Derivative data saved (1820 records). [2025-09-29T02:13:27.196898] [INFO ] [MAIN ] CRT: Loaded 5018 primary data records. [2025-09-29T02:13:27.202688] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-29T02:13:27.236432] [INFO ] [MAIN ] Derivative Progress: 501/2211 symbols completed. CRM took 1.3s. Estimated remaining: 11m 58s. Rate: 142.9 symbols/min [2025-09-29T02:13:27.281691] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:27.378102] [DEBUG] [LOCAL ] CRS: Loaded 43928 existing records from primary storage. [2025-09-29T02:13:27.408945] [INFO ] [MAIN ] CRS: Loaded 43928 primary data records. [2025-09-29T02:13:27.933268] [DEBUG] [LOCAL ] CSAN: Loaded 42951 existing records from primary storage. [2025-09-29T02:13:27.933989] [INFO ] [MAIN ] CSAN: Loaded 42951 primary data records. [2025-09-29T02:13:28.280952] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:28.282075] [INFO ] [MAIN ] CRT: Generated 1820 derivative records from 5018 primary records. [2025-09-29T02:13:28.283165] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-29T02:13:28.305179] [DEBUG] [LOCAL ] CRT: Derivative data saved (1820 records). [2025-09-29T02:13:28.314805] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-29T02:13:28.322115] [INFO ] [MAIN ] Derivative Progress: 502/2211 symbols completed. CRT took 1.2s. Estimated remaining: 11m 60s. Rate: 142.5 symbols/min [2025-09-29T02:13:28.322336] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:28.323131] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:28.324808] [INFO ] [MAIN ] CRS: Generated 1820 derivative records from 43928 primary records. [2025-09-29T02:13:28.325934] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-29T02:13:28.344432] [DEBUG] [LOCAL ] CRS: Derivative data saved (1820 records). [2025-09-29T02:13:28.344608] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-29T02:13:28.347842] [INFO ] [MAIN ] Derivative Progress: 503/2211 symbols completed. CRS took 1.2s. Estimated remaining: 11m 58s. Rate: 142.8 symbols/min [2025-09-29T02:13:28.348159] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:28.366753] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:28.379427] [INFO ] [MAIN ] CSAN: Generated 1820 derivative records from 42951 primary records. [2025-09-29T02:13:28.379752] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-29T02:13:28.413186] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1820 records). [2025-09-29T02:13:28.413439] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-29T02:13:28.416978] [INFO ] [MAIN ] Derivative Progress: 504/2211 symbols completed. CSAN took 1.1s. Estimated remaining: 11m 56s. Rate: 143.0 symbols/min [2025-09-29T02:13:28.399503] [DEBUG] [LOCAL ] CSR: Loaded 12808 existing records from primary storage. [2025-09-29T02:13:28.417224] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:28.418854] [DEBUG] [LOCAL ] CSL: Loaded 32100 existing records from primary storage. [2025-09-29T02:13:28.419094] [INFO ] [MAIN ] CSL: Loaded 32100 primary data records. [2025-09-29T02:13:28.417349] [INFO ] [MAIN ] CSR: Loaded 12808 primary data records. [2025-09-29T02:13:29.030347] [DEBUG] [LOCAL ] CSTM: Loaded 48360 existing records from primary storage. [2025-09-29T02:13:29.145821] [INFO ] [MAIN ] CSTM: Loaded 48360 primary data records. [2025-09-29T02:13:29.559253] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:29.561497] [INFO ] [MAIN ] CSR: Generated 1820 derivative records from 12808 primary records. [2025-09-29T02:13:29.561672] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-29T02:13:29.592257] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:29.594048] [INFO ] [MAIN ] CSL: Generated 1820 derivative records from 32100 primary records. [2025-09-29T02:13:29.597948] [DEBUG] [LOCAL ] CSR: Derivative data saved (1820 records). [2025-09-29T02:13:29.596814] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-29T02:13:29.598085] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-29T02:13:29.601207] [INFO ] [MAIN ] Derivative Progress: 505/2211 symbols completed. CSR took 1.3s. Estimated remaining: 11m 58s. Rate: 142.5 symbols/min [2025-09-29T02:13:29.602065] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:29.620830] [DEBUG] [LOCAL ] CSL: Derivative data saved (1820 records). [2025-09-29T02:13:29.621442] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-29T02:13:29.624909] [INFO ] [MAIN ] Derivative Progress: 506/2211 symbols completed. CSL took 1.3s. Estimated remaining: 11m 57s. Rate: 142.7 symbols/min [2025-09-29T02:13:29.625818] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:29.645707] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:29.653998] [INFO ] [MAIN ] CSTM: Generated 1820 derivative records from 48360 primary records. [2025-09-29T02:13:29.654492] [DEBUG] [LOCAL ] CSV: Loaded 13198 existing records from primary storage. [2025-09-29T02:13:29.654789] [INFO ] [MAIN ] CSV: Loaded 13198 primary data records. [2025-09-29T02:13:29.654889] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-29T02:13:29.691522] [DEBUG] [LOCAL ] CTBB: Loaded 7168 existing records from primary storage. [2025-09-29T02:13:29.731359] [INFO ] [MAIN ] CTBB: Loaded 7168 primary data records. [2025-09-29T02:13:29.823417] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1820 records). [2025-09-29T02:13:29.876774] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-29T02:13:29.979209] [INFO ] [MAIN ] Derivative Progress: 507/2211 symbols completed. CSTM took 1.6s. Estimated remaining: 11m 56s. Rate: 142.8 symbols/min [2025-09-29T02:13:29.991271] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:30.343505] [DEBUG] [LOCAL ] CTDD: Loaded 5947 existing records from primary storage. [2025-09-29T02:13:30.344074] [INFO ] [MAIN ] CTDD: Loaded 5947 primary data records. [2025-09-29T02:13:30.705844] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:30.707181] [INFO ] [MAIN ] CSV: Generated 1820 derivative records from 13198 primary records. [2025-09-29T02:13:30.708435] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-29T02:13:30.740636] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:30.744844] [INFO ] [MAIN ] CTBB: Generated 1820 derivative records from 7168 primary records. [2025-09-29T02:13:30.746191] [DEBUG] [LOCAL ] CSV: Derivative data saved (1820 records). [2025-09-29T02:13:30.746373] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-29T02:13:30.746305] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-29T02:13:30.750567] [INFO ] [MAIN ] Derivative Progress: 508/2211 symbols completed. CSV took 1.1s. Estimated remaining: 11m 57s. Rate: 142.6 symbols/min [2025-09-29T02:13:30.766197] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1820 records). [2025-09-29T02:13:30.767556] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-29T02:13:30.770166] [INFO ] [MAIN ] Derivative Progress: 509/2211 symbols completed. CTBB took 1.1s. Estimated remaining: 11m 55s. Rate: 142.8 symbols/min [2025-09-29T02:13:30.790352] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:30.791192] [INFO ] [MAIN ] CTDD: Generated 1820 derivative records from 5947 primary records. [2025-09-29T02:13:30.791280] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-29T02:13:30.807110] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1820 records). [2025-09-29T02:13:30.807261] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-29T02:13:30.810495] [INFO ] [MAIN ] Derivative Progress: 510/2211 symbols completed. CTDD took 0.8s. Estimated remaining: 11m 53s. Rate: 143.1 symbols/min [2025-09-29T02:13:30.811146] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:30.811263] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:30.811339] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:30.883400] [DEBUG] [LOCAL ] CTO: Loaded 28661 existing records from primary storage. [2025-09-29T02:13:30.885037] [INFO ] [MAIN ] CTO: Loaded 28661 primary data records. [2025-09-29T02:13:30.891530] [DEBUG] [LOCAL ] CTOS: Loaded 37246 existing records from primary storage. [2025-09-29T02:13:30.927755] [INFO ] [MAIN ] CTOS: Loaded 37246 primary data records. [2025-09-29T02:13:31.053231] [DEBUG] [LOCAL ] CTRA: Loaded 54428 existing records from primary storage. [2025-09-29T02:13:31.105693] [INFO ] [MAIN ] CTRA: Loaded 54428 primary data records. [2025-09-29T02:13:32.035085] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:32.036414] [INFO ] [MAIN ] CTO: Generated 1820 derivative records from 28661 primary records. [2025-09-29T02:13:32.037939] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-29T02:13:32.057367] [DEBUG] [LOCAL ] CTO: Derivative data saved (1820 records). [2025-09-29T02:13:32.071489] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:32.071584] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-29T02:13:32.074556] [INFO ] [MAIN ] Derivative Progress: 511/2211 symbols completed. CTO took 1.3s. Estimated remaining: 11m 56s. Rate: 142.5 symbols/min [2025-09-29T02:13:32.074787] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:32.077285] [INFO ] [MAIN ] CTOS: Generated 1820 derivative records from 37246 primary records. [2025-09-29T02:13:32.078583] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-29T02:13:32.117803] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:32.119275] [INFO ] [MAIN ] CTRA: Generated 1820 derivative records from 54428 primary records. [2025-09-29T02:13:32.117881] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1820 records). [2025-09-29T02:13:32.119457] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-29T02:13:32.122585] [INFO ] [MAIN ] Derivative Progress: 512/2211 symbols completed. CTOS took 1.3s. Estimated remaining: 11m 54s. Rate: 142.8 symbols/min [2025-09-29T02:13:32.122816] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-29T02:13:32.122912] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:32.151686] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1820 records). [2025-09-29T02:13:32.151971] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-29T02:13:32.156312] [INFO ] [MAIN ] Derivative Progress: 513/2211 symbols completed. CTRA took 1.3s. Estimated remaining: 11m 52s. Rate: 143.0 symbols/min [2025-09-29T02:13:32.156574] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:32.212108] [DEBUG] [LOCAL ] CTRE: Loaded 49964 existing records from primary storage. [2025-09-29T02:13:32.224404] [INFO ] [MAIN ] CTRE: Loaded 49964 primary data records. [2025-09-29T02:13:32.248064] [DEBUG] [LOCAL ] CTRI: Loaded 38571 existing records from primary storage. [2025-09-29T02:13:32.293267] [DEBUG] [LOCAL ] CTS: Loaded 19637 existing records from primary storage. [2025-09-29T02:13:32.317352] [INFO ] [MAIN ] CTRI: Loaded 38571 primary data records. [2025-09-29T02:13:32.347344] [INFO ] [MAIN ] CTS: Loaded 19637 primary data records. [2025-09-29T02:13:33.298634] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:33.299739] [INFO ] [MAIN ] CTRE: Generated 1820 derivative records from 49964 primary records. [2025-09-29T02:13:33.299853] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-29T02:13:33.325958] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1820 records). [2025-09-29T02:13:33.349494] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-29T02:13:33.355773] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:33.358523] [INFO ] [MAIN ] Derivative Progress: 514/2211 symbols completed. CTRE took 1.3s. Estimated remaining: 11m 55s. Rate: 142.5 symbols/min [2025-09-29T02:13:33.359733] [INFO ] [MAIN ] CTRI: Generated 1820 derivative records from 38571 primary records. [2025-09-29T02:13:33.360584] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:33.360055] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:33.361728] [INFO ] [MAIN ] CTS: Generated 1820 derivative records from 19637 primary records. [2025-09-29T02:13:33.362206] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-29T02:13:33.362281] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-29T02:13:33.399757] [DEBUG] [LOCAL ] CTS: Derivative data saved (1820 records). [2025-09-29T02:13:33.400031] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-29T02:13:33.397529] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1820 records). [2025-09-29T02:13:33.402933] [INFO ] [MAIN ] Derivative Progress: 515/2211 symbols completed. CTS took 1.2s. Estimated remaining: 11m 53s. Rate: 142.8 symbols/min [2025-09-29T02:13:33.403197] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-29T02:13:33.405960] [INFO ] [MAIN ] Derivative Progress: 516/2211 symbols completed. CTRI took 1.3s. Estimated remaining: 11m 51s. Rate: 143.0 symbols/min [2025-09-29T02:13:33.405839] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:33.406231] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:33.455450] [DEBUG] [LOCAL ] CUBI: Loaded 27667 existing records from primary storage. [2025-09-29T02:13:33.455609] [INFO ] [MAIN ] CUBI: Loaded 27667 primary data records. [2025-09-29T02:13:33.635832] [DEBUG] [LOCAL ] CTVA: Loaded 54002 existing records from primary storage. [2025-09-29T02:13:33.648409] [DEBUG] [LOCAL ] CUBE: Loaded 51391 existing records from primary storage. [2025-09-29T02:13:33.653760] [INFO ] [MAIN ] CTVA: Loaded 54002 primary data records. [2025-09-29T02:13:33.653945] [INFO ] [MAIN ] CUBE: Loaded 51391 primary data records. [2025-09-29T02:13:34.606890] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:34.607923] [INFO ] [MAIN ] CUBI: Generated 1820 derivative records from 27667 primary records. [2025-09-29T02:13:34.608519] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-29T02:13:34.627229] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1820 records). [2025-09-29T02:13:34.627747] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-29T02:13:34.632463] [INFO ] [MAIN ] Derivative Progress: 517/2211 symbols completed. CUBI took 1.2s. Estimated remaining: 11m 53s. Rate: 142.5 symbols/min [2025-09-29T02:13:34.633855] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:34.649853] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:34.651683] [INFO ] [MAIN ] CUBE: Generated 1820 derivative records from 51391 primary records. [2025-09-29T02:13:34.652130] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-29T02:13:34.680244] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:34.684871] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1820 records). [2025-09-29T02:13:34.685830] [INFO ] [MAIN ] CTVA: Generated 1820 derivative records from 54002 primary records. [2025-09-29T02:13:34.686076] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-29T02:13:34.689128] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-29T02:13:34.688901] [INFO ] [MAIN ] Derivative Progress: 518/2211 symbols completed. CUBE took 1.3s. Estimated remaining: 11m 52s. Rate: 142.7 symbols/min [2025-09-29T02:13:34.689419] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:34.723429] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1820 records). [2025-09-29T02:13:34.726746] [DEBUG] [LOCAL ] CULP: Loaded 3111 existing records from primary storage. [2025-09-29T02:13:34.726841] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-29T02:13:34.730382] [INFO ] [MAIN ] Derivative Progress: 519/2211 symbols completed. CTVA took 1.4s. Estimated remaining: 11m 50s. Rate: 143.0 symbols/min [2025-09-29T02:13:34.730845] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:34.730632] [INFO ] [MAIN ] CULP: Loaded 3111 primary data records. [2025-09-29T02:13:34.854065] [DEBUG] [LOCAL ] CUK: Loaded 51762 existing records from primary storage. [2025-09-29T02:13:34.877868] [INFO ] [MAIN ] CUK: Loaded 51762 primary data records. [2025-09-29T02:13:35.088862] [DEBUG] [LOCAL ] CURB: Loaded 33350 existing records from primary storage. [2025-09-29T02:13:35.239072] [INFO ] [MAIN ] CURB: Loaded 33350 primary data records. [2025-09-29T02:13:35.896186] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:35.899349] [INFO ] [MAIN ] CULP: Generated 1820 derivative records from 3111 primary records. [2025-09-29T02:13:35.899727] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-29T02:13:35.936299] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:35.935638] [DEBUG] [LOCAL ] CULP: Derivative data saved (1820 records). [2025-09-29T02:13:35.937621] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-29T02:13:35.938486] [INFO ] [MAIN ] CUK: Generated 1820 derivative records from 51762 primary records. [2025-09-29T02:13:35.940796] [INFO ] [MAIN ] Derivative Progress: 520/2211 symbols completed. CULP took 1.3s. Estimated remaining: 11m 52s. Rate: 142.5 symbols/min [2025-09-29T02:13:35.941156] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:35.941303] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-29T02:13:35.968820] [DEBUG] [LOCAL ] CUK: Derivative data saved (1820 records). [2025-09-29T02:13:35.969219] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-29T02:13:35.972773] [INFO ] [MAIN ] Derivative Progress: 521/2211 symbols completed. CUK took 1.3s. Estimated remaining: 11m 50s. Rate: 142.7 symbols/min [2025-09-29T02:13:35.974165] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:36.003525] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:36.004733] [INFO ] [MAIN ] CURB: Generated 1820 derivative records from 33350 primary records. [2025-09-29T02:13:36.004846] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-29T02:13:36.035070] [DEBUG] [LOCAL ] CURV: Loaded 26933 existing records from primary storage. [2025-09-29T02:13:36.037626] [INFO ] [MAIN ] CURV: Loaded 26933 primary data records. [2025-09-29T02:13:36.062144] [DEBUG] [LOCAL ] CURB: Derivative data saved (1820 records). [2025-09-29T02:13:36.101134] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-29T02:13:36.149792] [INFO ] [MAIN ] Derivative Progress: 522/2211 symbols completed. CURB took 1.4s. Estimated remaining: 11m 49s. Rate: 142.9 symbols/min [2025-09-29T02:13:36.173074] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:36.441364] [DEBUG] [LOCAL ] CUZ: Loaded 50140 existing records from primary storage. [2025-09-29T02:13:36.456309] [INFO ] [MAIN ] CUZ: Loaded 50140 primary data records. [2025-09-29T02:13:36.852559] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-09-29T02:13:36.852917] [INFO ] [MAIN ] CVE: Loaded 54336 primary data records. [2025-09-29T02:13:37.066317] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:37.207779] [INFO ] [MAIN ] CURV: Generated 1820 derivative records from 26933 primary records. [2025-09-29T02:13:37.218328] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-29T02:13:37.241016] [DEBUG] [LOCAL ] CURV: Derivative data saved (1820 records). [2025-09-29T02:13:37.242228] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-29T02:13:37.253986] [INFO ] [MAIN ] Derivative Progress: 523/2211 symbols completed. CURV took 1.3s. Estimated remaining: 11m 51s. Rate: 142.4 symbols/min [2025-09-29T02:13:37.260074] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:37.261112] [INFO ] [MAIN ] CUZ: Generated 1820 derivative records from 50140 primary records. [2025-09-29T02:13:37.261293] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-29T02:13:37.279067] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1820 records). [2025-09-29T02:13:37.279222] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-29T02:13:37.282101] [INFO ] [MAIN ] Derivative Progress: 524/2211 symbols completed. CUZ took 1.3s. Estimated remaining: 11m 49s. Rate: 142.7 symbols/min [2025-09-29T02:13:37.300230] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:37.301010] [INFO ] [MAIN ] CVE: Generated 1820 derivative records from 54336 primary records. [2025-09-29T02:13:37.301097] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-29T02:13:37.317112] [DEBUG] [LOCAL ] CVE: Derivative data saved (1820 records). [2025-09-29T02:13:37.317210] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-29T02:13:37.320516] [INFO ] [MAIN ] Derivative Progress: 525/2211 symbols completed. CVE took 1.1s. Estimated remaining: 11m 48s. Rate: 142.9 symbols/min [2025-09-29T02:13:37.321179] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:37.321327] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:37.321459] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:37.348630] [DEBUG] [LOCAL ] CVLG: Loaded 15730 existing records from primary storage. [2025-09-29T02:13:37.348880] [INFO ] [MAIN ] CVLG: Loaded 15730 primary data records. [2025-09-29T02:13:37.426890] [DEBUG] [LOCAL ] CVEO: Loaded 15402 existing records from primary storage. [2025-09-29T02:13:37.444454] [INFO ] [MAIN ] CVEO: Loaded 15402 primary data records. [2025-09-29T02:13:37.886968] [DEBUG] [LOCAL ] CVI: Loaded 47160 existing records from primary storage. [2025-09-29T02:13:37.943789] [INFO ] [MAIN ] CVI: Loaded 47160 primary data records. [2025-09-29T02:13:38.521361] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:38.523180] [INFO ] [MAIN ] CVLG: Generated 1820 derivative records from 15730 primary records. [2025-09-29T02:13:38.523402] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-29T02:13:38.553161] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:38.554772] [INFO ] [MAIN ] CVEO: Generated 1820 derivative records from 15402 primary records. [2025-09-29T02:13:38.554996] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-29T02:13:38.560194] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1820 records). [2025-09-29T02:13:38.571224] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-29T02:13:38.576504] [INFO ] [MAIN ] Derivative Progress: 526/2211 symbols completed. CVLG took 1.3s. Estimated remaining: 11m 50s. Rate: 142.4 symbols/min [2025-09-29T02:13:38.577124] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:38.579463] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1820 records). [2025-09-29T02:13:38.579870] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-29T02:13:38.582947] [INFO ] [MAIN ] Derivative Progress: 527/2211 symbols completed. CVEO took 1.3s. Estimated remaining: 11m 48s. Rate: 142.7 symbols/min [2025-09-29T02:13:38.583331] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:38.602343] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:38.603321] [INFO ] [MAIN ] CVI: Generated 1820 derivative records from 47160 primary records. [2025-09-29T02:13:38.603421] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-29T02:13:38.621439] [DEBUG] [LOCAL ] CVI: Derivative data saved (1820 records). [2025-09-29T02:13:38.621729] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-29T02:13:38.625059] [INFO ] [MAIN ] Derivative Progress: 528/2211 symbols completed. CVI took 1.3s. Estimated remaining: 11m 47s. Rate: 142.9 symbols/min [2025-09-29T02:13:38.625537] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:38.694702] [DEBUG] [LOCAL ] CVNA: Loaded 53766 existing records from primary storage. [2025-09-29T02:13:38.696615] [INFO ] [MAIN ] CVNA: Loaded 53766 primary data records. [2025-09-29T02:13:38.807919] [DEBUG] [LOCAL ] CVS: Loaded 54476 existing records from primary storage. [2025-09-29T02:13:38.821149] [INFO ] [MAIN ] CVS: Loaded 54476 primary data records. [2025-09-29T02:13:39.017976] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-29T02:13:39.191378] [INFO ] [MAIN ] CVX: Loaded 54540 primary data records. [2025-09-29T02:13:39.793402] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:39.795182] [INFO ] [MAIN ] CVNA: Generated 1820 derivative records from 53766 primary records. [2025-09-29T02:13:39.795572] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-29T02:13:39.829529] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1820 records). [2025-09-29T02:13:39.830465] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-29T02:13:39.833029] [INFO ] [MAIN ] Derivative Progress: 529/2211 symbols completed. CVNA took 1.3s. Estimated remaining: 11m 49s. Rate: 142.4 symbols/min [2025-09-29T02:13:39.830372] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:39.833461] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:39.834972] [INFO ] [MAIN ] CVS: Generated 1820 derivative records from 54476 primary records. [2025-09-29T02:13:39.835541] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-29T02:13:39.853060] [DEBUG] [LOCAL ] CVS: Derivative data saved (1820 records). [2025-09-29T02:13:39.853281] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-29T02:13:39.855606] [INFO ] [MAIN ] Derivative Progress: 530/2211 symbols completed. CVS took 1.3s. Estimated remaining: 11m 47s. Rate: 142.7 symbols/min [2025-09-29T02:13:39.856898] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:39.879095] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:39.880051] [INFO ] [MAIN ] CVX: Generated 1820 derivative records from 54540 primary records. [2025-09-29T02:13:39.880249] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-29T02:13:39.889580] [DEBUG] [LOCAL ] CW: Loaded 22705 existing records from primary storage. [2025-09-29T02:13:39.901292] [INFO ] [MAIN ] CW: Loaded 22705 primary data records. [2025-09-29T02:13:39.905826] [DEBUG] [LOCAL ] CVX: Derivative data saved (1820 records). [2025-09-29T02:13:39.929091] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-29T02:13:39.943970] [INFO ] [MAIN ] Derivative Progress: 531/2211 symbols completed. CVX took 1.3s. Estimated remaining: 11m 46s. Rate: 142.9 symbols/min [2025-09-29T02:13:39.944226] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:40.268442] [DEBUG] [LOCAL ] CWAN: Loaded 53154 existing records from primary storage. [2025-09-29T02:13:40.280630] [INFO ] [MAIN ] CWAN: Loaded 53154 primary data records. [2025-09-29T02:13:40.411586] [DEBUG] [LOCAL ] CWEN: Loaded 45717 existing records from primary storage. [2025-09-29T02:13:40.415959] [INFO ] [MAIN ] CWEN: Loaded 45717 primary data records. [2025-09-29T02:13:41.049021] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:41.051330] [INFO ] [MAIN ] CW: Generated 1820 derivative records from 22705 primary records. [2025-09-29T02:13:41.051777] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-29T02:13:41.073385] [DEBUG] [LOCAL ] CW: Derivative data saved (1820 records). [2025-09-29T02:13:41.074412] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-29T02:13:41.077249] [INFO ] [MAIN ] Derivative Progress: 532/2211 symbols completed. CW took 1.2s. Estimated remaining: 11m 47s. Rate: 142.4 symbols/min [2025-09-29T02:13:41.077920] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:41.096614] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:41.097879] [INFO ] [MAIN ] CWAN: Generated 1820 derivative records from 53154 primary records. [2025-09-29T02:13:41.098287] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-29T02:13:41.117108] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1820 records). [2025-09-29T02:13:41.118940] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-29T02:13:41.121861] [INFO ] [MAIN ] Derivative Progress: 533/2211 symbols completed. CWAN took 1.3s. Estimated remaining: 11m 46s. Rate: 142.7 symbols/min [2025-09-29T02:13:41.122218] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:41.136055] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:41.137280] [INFO ] [MAIN ] CWEN: Generated 1820 derivative records from 45717 primary records. [2025-09-29T02:13:41.137547] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-29T02:13:41.154399] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1820 records). [2025-09-29T02:13:41.154795] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-29T02:13:41.158619] [INFO ] [MAIN ] Derivative Progress: 534/2211 symbols completed. CWEN took 1.2s. Estimated remaining: 11m 44s. Rate: 142.9 symbols/min [2025-09-29T02:13:41.158940] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:41.202139] [DEBUG] [LOCAL ] CWH: Loaded 52151 existing records from primary storage. [2025-09-29T02:13:41.202496] [INFO ] [MAIN ] CWH: Loaded 52151 primary data records. [2025-09-29T02:13:41.348134] [DEBUG] [LOCAL ] CWT: Loaded 28294 existing records from primary storage. [2025-09-29T02:13:41.354257] [INFO ] [MAIN ] CWT: Loaded 28294 primary data records. [2025-09-29T02:13:41.481963] [DEBUG] [LOCAL ] CWK: Loaded 50158 existing records from primary storage. [2025-09-29T02:13:41.646362] [INFO ] [MAIN ] CWK: Loaded 50158 primary data records. [2025-09-29T02:13:42.282541] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:42.283832] [INFO ] [MAIN ] CWH: Generated 1820 derivative records from 52151 primary records. [2025-09-29T02:13:42.284614] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-29T02:13:42.304491] [DEBUG] [LOCAL ] CWH: Derivative data saved (1820 records). [2025-09-29T02:13:42.306341] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-29T02:13:42.310420] [INFO ] [MAIN ] Derivative Progress: 535/2211 symbols completed. CWH took 1.2s. Estimated remaining: 11m 46s. Rate: 142.4 symbols/min [2025-09-29T02:13:42.311150] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:42.328337] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:42.330057] [INFO ] [MAIN ] CWT: Generated 1820 derivative records from 28294 primary records. [2025-09-29T02:13:42.342807] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-29T02:13:42.343229] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:42.344687] [INFO ] [MAIN ] CWK: Generated 1820 derivative records from 50158 primary records. [2025-09-29T02:13:42.344836] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-29T02:13:42.378408] [DEBUG] [LOCAL ] CWK: Derivative data saved (1820 records). [2025-09-29T02:13:42.378591] [DEBUG] [LOCAL ] CWT: Derivative data saved (1820 records). [2025-09-29T02:13:42.378807] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-29T02:13:42.381843] [INFO ] [MAIN ] Derivative Progress: 536/2211 symbols completed. CWK took 1.3s. Estimated remaining: 11m 44s. Rate: 142.7 symbols/min [2025-09-29T02:13:42.378742] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-29T02:13:42.384710] [INFO ] [MAIN ] Derivative Progress: 537/2211 symbols completed. CWT took 1.2s. Estimated remaining: 11m 43s. Rate: 142.9 symbols/min [2025-09-29T02:13:42.384876] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:42.382020] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:42.400216] [DEBUG] [LOCAL ] CXE: Loaded 7247 existing records from primary storage. [2025-09-29T02:13:42.396592] [DEBUG] [LOCAL ] CXH: Loaded 4436 existing records from primary storage. [2025-09-29T02:13:42.400455] [INFO ] [MAIN ] CXH: Loaded 4436 primary data records. [2025-09-29T02:13:42.400516] [INFO ] [MAIN ] CXE: Loaded 7247 primary data records. [2025-09-29T02:13:42.808622] [DEBUG] [LOCAL ] CX: Loaded 53603 existing records from primary storage. [2025-09-29T02:13:43.009415] [INFO ] [MAIN ] CX: Loaded 53603 primary data records. [2025-09-29T02:13:43.523333] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:43.525135] [INFO ] [MAIN ] CXH: Generated 1820 derivative records from 4436 primary records. [2025-09-29T02:13:43.525263] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-29T02:13:43.550183] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:43.557245] [INFO ] [MAIN ] CXE: Generated 1820 derivative records from 7247 primary records. [2025-09-29T02:13:43.557421] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-29T02:13:43.561078] [DEBUG] [LOCAL ] CXH: Derivative data saved (1820 records). [2025-09-29T02:13:43.572354] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-29T02:13:43.575366] [INFO ] [MAIN ] Derivative Progress: 538/2211 symbols completed. CXH took 1.2s. Estimated remaining: 11m 45s. Rate: 142.4 symbols/min [2025-09-29T02:13:43.579948] [DEBUG] [LOCAL ] CXE: Derivative data saved (1820 records). [2025-09-29T02:13:43.580182] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-29T02:13:43.582746] [INFO ] [MAIN ] Derivative Progress: 539/2211 symbols completed. CXE took 1.2s. Estimated remaining: 11m 43s. Rate: 142.7 symbols/min [2025-09-29T02:13:43.599940] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:43.600720] [INFO ] [MAIN ] CX: Generated 1820 derivative records from 53603 primary records. [2025-09-29T02:13:43.600813] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-29T02:13:43.617114] [DEBUG] [LOCAL ] CX: Derivative data saved (1820 records). [2025-09-29T02:13:43.617214] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-29T02:13:43.620537] [INFO ] [MAIN ] Derivative Progress: 540/2211 symbols completed. CX took 1.3s. Estimated remaining: 11m 41s. Rate: 142.9 symbols/min [2025-09-29T02:13:43.621426] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:43.621289] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:43.621600] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:43.683544] [DEBUG] [LOCAL ] CXT: Loaded 31611 existing records from primary storage. [2025-09-29T02:13:43.683923] [INFO ] [MAIN ] CXT: Loaded 31611 primary data records. [2025-09-29T02:13:43.807440] [DEBUG] [LOCAL ] CXW: Loaded 44899 existing records from primary storage. [2025-09-29T02:13:43.833495] [INFO ] [MAIN ] CXW: Loaded 44899 primary data records. [2025-09-29T02:13:43.834720] [DEBUG] [LOCAL ] CXM: Loaded 48607 existing records from primary storage. [2025-09-29T02:13:43.860861] [INFO ] [MAIN ] CXM: Loaded 48607 primary data records. [2025-09-29T02:13:44.771822] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:44.772849] [INFO ] [MAIN ] CXT: Generated 1820 derivative records from 31611 primary records. [2025-09-29T02:13:44.772967] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-29T02:13:44.795041] [DEBUG] [LOCAL ] CXT: Derivative data saved (1820 records). [2025-09-29T02:13:44.795789] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-29T02:13:44.808257] [INFO ] [MAIN ] Derivative Progress: 541/2211 symbols completed. CXT took 1.2s. Estimated remaining: 11m 43s. Rate: 142.5 symbols/min [2025-09-29T02:13:44.817294] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:44.817460] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:44.818680] [INFO ] [MAIN ] CXW: Generated 1820 derivative records from 44899 primary records. [2025-09-29T02:13:44.819332] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-29T02:13:44.862454] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:44.863840] [DEBUG] [LOCAL ] CXW: Derivative data saved (1820 records). [2025-09-29T02:13:44.865290] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-29T02:13:44.864988] [INFO ] [MAIN ] CXM: Generated 1820 derivative records from 48607 primary records. [2025-09-29T02:13:44.865472] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-29T02:13:44.867955] [INFO ] [MAIN ] Derivative Progress: 542/2211 symbols completed. CXW took 1.2s. Estimated remaining: 11m 42s. Rate: 142.7 symbols/min [2025-09-29T02:13:44.884270] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:44.892809] [DEBUG] [LOCAL ] CXM: Derivative data saved (1820 records). [2025-09-29T02:13:44.893338] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-29T02:13:44.896373] [INFO ] [MAIN ] Derivative Progress: 543/2211 symbols completed. CXM took 1.3s. Estimated remaining: 11m 40s. Rate: 142.9 symbols/min [2025-09-29T02:13:44.897825] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:44.908987] [DEBUG] [LOCAL ] CYD: Loaded 27145 existing records from primary storage. [2025-09-29T02:13:44.909273] [INFO ] [MAIN ] CYD: Loaded 27145 primary data records. [2025-09-29T02:13:45.330232] [DEBUG] [LOCAL ] D: Loaded 54426 existing records from primary storage. [2025-09-29T02:13:45.332274] [DEBUG] [LOCAL ] CYH: Loaded 48352 existing records from primary storage. [2025-09-29T02:13:45.332404] [INFO ] [MAIN ] D: Loaded 54426 primary data records. [2025-09-29T02:13:45.332612] [INFO ] [MAIN ] CYH: Loaded 48352 primary data records. [2025-09-29T02:13:46.021747] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:46.023847] [INFO ] [MAIN ] CYD: Generated 1820 derivative records from 27145 primary records. [2025-09-29T02:13:46.024330] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-29T02:13:46.043635] [DEBUG] [LOCAL ] CYD: Derivative data saved (1820 records). [2025-09-29T02:13:46.044113] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-29T02:13:46.047324] [INFO ] [MAIN ] Derivative Progress: 544/2211 symbols completed. CYD took 1.2s. Estimated remaining: 11m 42s. Rate: 142.5 symbols/min [2025-09-29T02:13:46.047523] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:46.067767] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:46.074132] [INFO ] [MAIN ] CYH: Generated 1820 derivative records from 48352 primary records. [2025-09-29T02:13:46.075390] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-29T02:13:46.098443] [DEBUG] [LOCAL ] DAC: Loaded 12769 existing records from primary storage. [2025-09-29T02:13:46.103812] [INFO ] [MAIN ] DAC: Loaded 12769 primary data records. [2025-09-29T02:13:46.104103] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:46.111895] [DEBUG] [LOCAL ] CYH: Derivative data saved (1820 records). [2025-09-29T02:13:46.118462] [INFO ] [MAIN ] D: Generated 1820 derivative records from 54426 primary records. [2025-09-29T02:13:46.136066] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-29T02:13:46.165455] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-29T02:13:46.168130] [INFO ] [MAIN ] Derivative Progress: 545/2211 symbols completed. CYH took 1.3s. Estimated remaining: 11m 41s. Rate: 142.7 symbols/min [2025-09-29T02:13:46.212373] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:46.251725] [DEBUG] [LOCAL ] D: Derivative data saved (1820 records). [2025-09-29T02:13:46.273175] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-29T02:13:46.315330] [INFO ] [MAIN ] Derivative Progress: 546/2211 symbols completed. D took 1.4s. Estimated remaining: 11m 39s. Rate: 142.8 symbols/min [2025-09-29T02:13:46.340676] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:46.533832] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:46.537094] [INFO ] [MAIN ] DAC: Generated 1820 derivative records from 12769 primary records. [2025-09-29T02:13:46.536164] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-29T02:13:46.537428] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-29T02:13:46.548691] [INFO ] [MAIN ] DAL: Loaded 54533 primary data records. [2025-09-29T02:13:46.605541] [DEBUG] [LOCAL ] DAC: Derivative data saved (1820 records). [2025-09-29T02:13:46.629696] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-29T02:13:46.641679] [INFO ] [MAIN ] Derivative Progress: 547/2211 symbols completed. DAC took 0.6s. Estimated remaining: 11m 39s. Rate: 142.9 symbols/min [2025-09-29T02:13:46.703753] [DEBUG] [LOCAL ] DAN: Loaded 49753 existing records from primary storage. [2025-09-29T02:13:46.701428] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:46.704403] [INFO ] [MAIN ] DAN: Loaded 49753 primary data records. [2025-09-29T02:13:47.102919] [DEBUG] [LOCAL ] DAO: Loaded 21546 existing records from primary storage. [2025-09-29T02:13:47.269891] [INFO ] [MAIN ] DAO: Loaded 21546 primary data records. [2025-09-29T02:13:47.635771] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:47.637167] [INFO ] [MAIN ] DAL: Generated 1820 derivative records from 54533 primary records. [2025-09-29T02:13:47.637408] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-29T02:13:47.678193] [DEBUG] [LOCAL ] DAL: Derivative data saved (1820 records). [2025-09-29T02:13:47.679376] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-29T02:13:47.679748] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:47.682737] [INFO ] [MAIN ] Derivative Progress: 548/2211 symbols completed. DAL took 1.5s. Estimated remaining: 11m 40s. Rate: 142.5 symbols/min [2025-09-29T02:13:47.683819] [INFO ] [MAIN ] DAN: Generated 1820 derivative records from 49753 primary records. [2025-09-29T02:13:47.684145] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:47.684473] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-29T02:13:47.703027] [DEBUG] [LOCAL ] DAN: Derivative data saved (1820 records). [2025-09-29T02:13:47.706035] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-29T02:13:47.710059] [INFO ] [MAIN ] Derivative Progress: 549/2211 symbols completed. DAN took 1.4s. Estimated remaining: 11m 39s. Rate: 142.7 symbols/min [2025-09-29T02:13:47.710507] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:47.725378] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:47.726181] [INFO ] [MAIN ] DAO: Generated 1820 derivative records from 21546 primary records. [2025-09-29T02:13:47.726284] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-29T02:13:47.744621] [DEBUG] [LOCAL ] DAO: Derivative data saved (1820 records). [2025-09-29T02:13:47.744834] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-29T02:13:47.748575] [INFO ] [MAIN ] Derivative Progress: 550/2211 symbols completed. DAO took 1.0s. Estimated remaining: 11m 37s. Rate: 143.0 symbols/min [2025-09-29T02:13:47.748984] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:47.799874] [DEBUG] [LOCAL ] DAR: Loaded 52603 existing records from primary storage. [2025-09-29T02:13:47.800174] [INFO ] [MAIN ] DAR: Loaded 52603 primary data records. [2025-09-29T02:13:47.950165] [DEBUG] [LOCAL ] DAVA: Loaded 41308 existing records from primary storage. [2025-09-29T02:13:47.978486] [INFO ] [MAIN ] DAVA: Loaded 41308 primary data records. [2025-09-29T02:13:48.177182] [DEBUG] [LOCAL ] DAY: Loaded 50491 existing records from primary storage. [2025-09-29T02:13:48.216882] [INFO ] [MAIN ] DAY: Loaded 50491 primary data records. [2025-09-29T02:13:48.869965] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:48.871750] [INFO ] [MAIN ] DAR: Generated 1820 derivative records from 52603 primary records. [2025-09-29T02:13:48.872039] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-29T02:13:48.903109] [DEBUG] [LOCAL ] DAR: Derivative data saved (1820 records). [2025-09-29T02:13:48.909356] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:48.908947] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-29T02:13:48.910353] [INFO ] [MAIN ] DAVA: Generated 1820 derivative records from 41308 primary records. [2025-09-29T02:13:48.913877] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-29T02:13:48.913566] [INFO ] [MAIN ] Derivative Progress: 551/2211 symbols completed. DAR took 1.2s. Estimated remaining: 11m 39s. Rate: 142.5 symbols/min [2025-09-29T02:13:48.915832] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:48.937810] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1820 records). [2025-09-29T02:13:48.951101] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:48.951959] [INFO ] [MAIN ] DAY: Generated 1820 derivative records from 50491 primary records. [2025-09-29T02:13:48.950624] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-29T02:13:48.954749] [INFO ] [MAIN ] Derivative Progress: 552/2211 symbols completed. DAVA took 1.2s. Estimated remaining: 11m 37s. Rate: 142.8 symbols/min [2025-09-29T02:13:48.955030] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-29T02:13:48.955152] [INFO ] [MAIN ] DBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:48.973437] [DEBUG] [LOCAL ] DAY: Derivative data saved (1820 records). [2025-09-29T02:13:48.973603] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-29T02:13:48.977703] [INFO ] [MAIN ] Derivative Progress: 553/2211 symbols completed. DAY took 1.2s. Estimated remaining: 11m 36s. Rate: 143.0 symbols/min [2025-09-29T02:13:48.998112] [DEBUG] [LOCAL ] DBD: Loaded 24109 existing records from primary storage. [2025-09-29T02:13:49.013355] [INFO ] [MAIN ] DBD: Loaded 24109 primary data records. [2025-09-29T02:13:49.168632] [DEBUG] [LOCAL ] DB: Loaded 53377 existing records from primary storage. [2025-09-29T02:13:49.201533] [INFO ] [MAIN ] DB: Loaded 53377 primary data records. [2025-09-29T02:13:49.734974] [DEBUG] [MAIN ] DBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:49.736117] [INFO ] [MAIN ] DBD: Generated 1820 derivative records from 24109 primary records. [2025-09-29T02:13:49.736448] [DEBUG] [LOCAL ] DBD: Saving derivative data. [2025-09-29T02:13:49.762802] [DEBUG] [LOCAL ] DBD: Derivative data saved (1820 records). [2025-09-29T02:13:49.764794] [INFO ] [MAIN ] DBD: Successfully saved derivative data. [2025-09-29T02:13:49.768046] [INFO ] [MAIN ] Derivative Progress: 554/2211 symbols completed. DBD took 0.8s. Estimated remaining: 11m 36s. Rate: 142.8 symbols/min [2025-09-29T02:13:49.781968] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:49.782691] [INFO ] [MAIN ] DB: Generated 1820 derivative records from 53377 primary records. [2025-09-29T02:13:49.782777] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-29T02:13:49.798442] [DEBUG] [LOCAL ] DB: Derivative data saved (1820 records). [2025-09-29T02:13:49.798545] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-29T02:13:49.801552] [INFO ] [MAIN ] Derivative Progress: 555/2211 symbols completed. DB took 0.9s. Estimated remaining: 11m 35s. Rate: 143.0 symbols/min [2025-09-29T02:13:49.802234] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:49.802387] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:49.802324] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:49.817993] [DEBUG] [LOCAL ] DBL: Loaded 9259 existing records from primary storage. [2025-09-29T02:13:49.818153] [INFO ] [MAIN ] DBL: Loaded 9259 primary data records. [2025-09-29T02:13:50.055518] [DEBUG] [LOCAL ] DBI: Loaded 45524 existing records from primary storage. [2025-09-29T02:13:50.060334] [INFO ] [MAIN ] DBI: Loaded 45524 primary data records. [2025-09-29T02:13:50.225710] [DEBUG] [LOCAL ] DBRG: Loaded 50526 existing records from primary storage. [2025-09-29T02:13:50.257396] [INFO ] [MAIN ] DBRG: Loaded 50526 primary data records. [2025-09-29T02:13:50.901253] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:50.902878] [INFO ] [MAIN ] DBL: Generated 1820 derivative records from 9259 primary records. [2025-09-29T02:13:50.904319] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-29T02:13:50.924262] [DEBUG] [LOCAL ] DBL: Derivative data saved (1820 records). [2025-09-29T02:13:50.924443] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-29T02:13:50.927213] [INFO ] [MAIN ] Derivative Progress: 556/2211 symbols completed. DBL took 1.1s. Estimated remaining: 11m 36s. Rate: 142.6 symbols/min [2025-09-29T02:13:50.927799] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:50.949062] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:50.951339] [INFO ] [MAIN ] DBI: Generated 1820 derivative records from 45524 primary records. [2025-09-29T02:13:50.952672] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-29T02:13:50.980483] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:50.985563] [DEBUG] [LOCAL ] DBI: Derivative data saved (1820 records). [2025-09-29T02:13:50.985806] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-29T02:13:50.999163] [INFO ] [MAIN ] Derivative Progress: 557/2211 symbols completed. DBI took 1.2s. Estimated remaining: 11m 35s. Rate: 142.8 symbols/min [2025-09-29T02:13:50.986635] [INFO ] [MAIN ] DBRG: Generated 1820 derivative records from 50526 primary records. [2025-09-29T02:13:50.999603] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:50.999780] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-29T02:13:51.032401] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1820 records). [2025-09-29T02:13:51.031378] [DEBUG] [LOCAL ] DCI: Loaded 38065 existing records from primary storage. [2025-09-29T02:13:51.036015] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-29T02:13:51.039323] [INFO ] [MAIN ] Derivative Progress: 558/2211 symbols completed. DBRG took 1.2s. Estimated remaining: 11m 33s. Rate: 143.0 symbols/min [2025-09-29T02:13:51.036219] [INFO ] [MAIN ] DCI: Loaded 38065 primary data records. [2025-09-29T02:13:51.039686] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:51.068069] [DEBUG] [LOCAL ] DCO: Loaded 14003 existing records from primary storage. [2025-09-29T02:13:51.085017] [INFO ] [MAIN ] DCO: Loaded 14003 primary data records. [2025-09-29T02:13:51.773159] [DEBUG] [LOCAL ] DD: Loaded 53595 existing records from primary storage. [2025-09-29T02:13:51.774411] [INFO ] [MAIN ] DD: Loaded 53595 primary data records. [2025-09-29T02:13:52.142704] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:52.144408] [INFO ] [MAIN ] DCI: Generated 1820 derivative records from 38065 primary records. [2025-09-29T02:13:52.144941] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-29T02:13:52.159601] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:52.178597] [DEBUG] [LOCAL ] DCI: Derivative data saved (1820 records). [2025-09-29T02:13:52.178765] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-29T02:13:52.173613] [INFO ] [MAIN ] DCO: Generated 1820 derivative records from 14003 primary records. [2025-09-29T02:13:52.181708] [INFO ] [MAIN ] Derivative Progress: 559/2211 symbols completed. DCI took 1.3s. Estimated remaining: 11m 35s. Rate: 142.6 symbols/min [2025-09-29T02:13:52.182274] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:52.182800] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-29T02:13:52.203367] [DEBUG] [LOCAL ] DCO: Derivative data saved (1820 records). [2025-09-29T02:13:52.203714] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-29T02:13:52.207697] [INFO ] [MAIN ] Derivative Progress: 560/2211 symbols completed. DCO took 1.2s. Estimated remaining: 11m 34s. Rate: 142.8 symbols/min [2025-09-29T02:13:52.209715] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:52.223861] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:52.224848] [INFO ] [MAIN ] DD: Generated 1820 derivative records from 53595 primary records. [2025-09-29T02:13:52.225014] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-29T02:13:52.244384] [DEBUG] [LOCAL ] DD: Derivative data saved (1820 records). [2025-09-29T02:13:52.244845] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-29T02:13:52.248488] [INFO ] [MAIN ] Derivative Progress: 561/2211 symbols completed. DD took 1.2s. Estimated remaining: 11m 32s. Rate: 143.0 symbols/min [2025-09-29T02:13:52.248872] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:52.291318] [DEBUG] [LOCAL ] DDL: Loaded 37016 existing records from primary storage. [2025-09-29T02:13:52.299106] [INFO ] [MAIN ] DDL: Loaded 37016 primary data records. [2025-09-29T02:13:52.299480] [DEBUG] [LOCAL ] DDS: Loaded 13374 existing records from primary storage. [2025-09-29T02:13:52.331269] [INFO ] [MAIN ] DDS: Loaded 13374 primary data records. [2025-09-29T02:13:52.385097] [DEBUG] [LOCAL ] DDD: Loaded 51647 existing records from primary storage. [2025-09-29T02:13:52.443844] [INFO ] [MAIN ] DDD: Loaded 51647 primary data records. [2025-09-29T02:13:53.362877] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:53.372326] [INFO ] [MAIN ] DDL: Generated 1820 derivative records from 37016 primary records. [2025-09-29T02:13:53.377211] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-29T02:13:53.378729] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:13:53.381289] [INFO ] [MAIN ] DDS: Generated 1819 derivative records from 13374 primary records. [2025-09-29T02:13:53.391504] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-29T02:13:53.400318] [DEBUG] [LOCAL ] DDL: Derivative data saved (1820 records). [2025-09-29T02:13:53.408028] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-29T02:13:53.429035] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:53.432053] [INFO ] [MAIN ] DDD: Generated 1820 derivative records from 51647 primary records. [2025-09-29T02:13:53.428027] [INFO ] [MAIN ] Derivative Progress: 562/2211 symbols completed. DDL took 1.2s. Estimated remaining: 11m 34s. Rate: 142.6 symbols/min [2025-09-29T02:13:53.432578] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:53.434586] [DEBUG] [LOCAL ] DDS: Derivative data saved (1819 records). [2025-09-29T02:13:53.435220] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-29T02:13:53.432660] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-29T02:13:53.439085] [INFO ] [MAIN ] Derivative Progress: 563/2211 symbols completed. DDS took 1.2s. Estimated remaining: 11m 32s. Rate: 142.8 symbols/min [2025-09-29T02:13:53.439512] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:53.460789] [DEBUG] [LOCAL ] DDD: Derivative data saved (1820 records). [2025-09-29T02:13:53.460325] [DEBUG] [LOCAL ] DDT: Loaded 2117 existing records from primary storage. [2025-09-29T02:13:53.461053] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-29T02:13:53.464593] [INFO ] [MAIN ] Derivative Progress: 564/2211 symbols completed. DDD took 1.3s. Estimated remaining: 11m 31s. Rate: 143.1 symbols/min [2025-09-29T02:13:53.464846] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:53.461153] [INFO ] [MAIN ] DDT: Loaded 2117 primary data records. [2025-09-29T02:13:53.914125] [DEBUG] [LOCAL ] DEA: Loaded 41860 existing records from primary storage. [2025-09-29T02:13:53.914403] [INFO ] [MAIN ] DEA: Loaded 41860 primary data records. [2025-09-29T02:13:53.921187] [DEBUG] [LOCAL ] DE: Loaded 48397 existing records from primary storage. [2025-09-29T02:13:53.938236] [INFO ] [MAIN ] DE: Loaded 48397 primary data records. [2025-09-29T02:13:54.618691] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:54.620599] [INFO ] [MAIN ] DDT: Generated 1820 derivative records from 2117 primary records. [2025-09-29T02:13:54.621958] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-29T02:13:54.640170] [DEBUG] [LOCAL ] DDT: Derivative data saved (1820 records). [2025-09-29T02:13:54.641015] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-29T02:13:54.643686] [INFO ] [MAIN ] Derivative Progress: 565/2211 symbols completed. DDT took 1.2s. Estimated remaining: 11m 32s. Rate: 142.6 symbols/min [2025-09-29T02:13:54.644290] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:54.664255] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:54.666203] [INFO ] [MAIN ] DEA: Generated 1820 derivative records from 41860 primary records. [2025-09-29T02:13:54.666349] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-29T02:13:54.692356] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:54.698112] [DEBUG] [LOCAL ] DEA: Derivative data saved (1820 records). [2025-09-29T02:13:54.694977] [INFO ] [MAIN ] DE: Generated 1820 derivative records from 48397 primary records. [2025-09-29T02:13:54.698458] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-29T02:13:54.698391] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-29T02:13:54.702275] [INFO ] [MAIN ] Derivative Progress: 566/2211 symbols completed. DEA took 1.2s. Estimated remaining: 11m 31s. Rate: 142.8 symbols/min [2025-09-29T02:13:54.718755] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:54.728112] [DEBUG] [LOCAL ] DE: Derivative data saved (1820 records). [2025-09-29T02:13:54.728283] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-29T02:13:54.731229] [INFO ] [MAIN ] Derivative Progress: 567/2211 symbols completed. DE took 1.3s. Estimated remaining: 11m 29s. Rate: 143.1 symbols/min [2025-09-29T02:13:54.732518] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:54.743854] [DEBUG] [LOCAL ] DEC: Loaded 31121 existing records from primary storage. [2025-09-29T02:13:54.743985] [INFO ] [MAIN ] DEC: Loaded 31121 primary data records. [2025-09-29T02:13:55.239499] [DEBUG] [LOCAL ] DECK: Loaded 54078 existing records from primary storage. [2025-09-29T02:13:55.240090] [INFO ] [MAIN ] DECK: Loaded 54078 primary data records. [2025-09-29T02:13:55.241201] [DEBUG] [LOCAL ] DEI: Loaded 49204 existing records from primary storage. [2025-09-29T02:13:55.247681] [INFO ] [MAIN ] DEI: Loaded 49204 primary data records. [2025-09-29T02:13:56.020621] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:56.021732] [INFO ] [MAIN ] DEC: Generated 1820 derivative records from 31121 primary records. [2025-09-29T02:13:56.023689] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-29T02:13:56.048083] [DEBUG] [LOCAL ] DEC: Derivative data saved (1820 records). [2025-09-29T02:13:56.048610] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-29T02:13:56.053550] [INFO ] [MAIN ] Derivative Progress: 568/2211 symbols completed. DEC took 1.4s. Estimated remaining: 11m 32s. Rate: 142.5 symbols/min [2025-09-29T02:13:56.072630] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:56.073721] [INFO ] [MAIN ] DEI: Generated 1820 derivative records from 49204 primary records. [2025-09-29T02:13:56.073915] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-29T02:13:56.095581] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:56.100332] [INFO ] [MAIN ] DECK: Generated 1820 derivative records from 54078 primary records. [2025-09-29T02:13:56.103506] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-29T02:13:56.104686] [DEBUG] [LOCAL ] DEI: Derivative data saved (1820 records). [2025-09-29T02:13:56.105587] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-29T02:13:56.108505] [INFO ] [MAIN ] Derivative Progress: 569/2211 symbols completed. DEI took 1.4s. Estimated remaining: 11m 30s. Rate: 142.7 symbols/min [2025-09-29T02:13:56.124370] [DEBUG] [LOCAL ] DECK: Derivative data saved (1820 records). [2025-09-29T02:13:56.124486] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-29T02:13:56.127734] [INFO ] [MAIN ] Derivative Progress: 570/2211 symbols completed. DECK took 1.4s. Estimated remaining: 11m 29s. Rate: 143.0 symbols/min [2025-09-29T02:13:56.128278] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:56.128346] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:56.128402] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:56.186100] [DEBUG] [LOCAL ] DFH: Loaded 33106 existing records from primary storage. [2025-09-29T02:13:56.187758] [INFO ] [MAIN ] DFH: Loaded 33106 primary data records. [2025-09-29T02:13:56.266256] [DEBUG] [LOCAL ] DEO: Loaded 49777 existing records from primary storage. [2025-09-29T02:13:56.302976] [INFO ] [MAIN ] DEO: Loaded 49777 primary data records. [2025-09-29T02:13:56.437355] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-29T02:13:56.646721] [INFO ] [MAIN ] DELL: Loaded 54515 primary data records. [2025-09-29T02:13:57.257217] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:57.258942] [INFO ] [MAIN ] DFH: Generated 1820 derivative records from 33106 primary records. [2025-09-29T02:13:57.259242] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-29T02:13:57.279511] [DEBUG] [LOCAL ] DFH: Derivative data saved (1820 records). [2025-09-29T02:13:57.281471] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-29T02:13:57.284179] [INFO ] [MAIN ] Derivative Progress: 571/2211 symbols completed. DFH took 1.2s. Estimated remaining: 11m 30s. Rate: 142.5 symbols/min [2025-09-29T02:13:57.285073] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:57.299967] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:57.300835] [INFO ] [MAIN ] DEO: Generated 1820 derivative records from 49777 primary records. [2025-09-29T02:13:57.301856] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-29T02:13:57.323455] [DEBUG] [LOCAL ] DEO: Derivative data saved (1820 records). [2025-09-29T02:13:57.324022] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-29T02:13:57.335120] [INFO ] [MAIN ] Derivative Progress: 572/2211 symbols completed. DEO took 1.2s. Estimated remaining: 11m 29s. Rate: 142.8 symbols/min [2025-09-29T02:13:57.340442] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:57.341460] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:57.348486] [INFO ] [MAIN ] DELL: Generated 1820 derivative records from 54515 primary records. [2025-09-29T02:13:57.348756] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-29T02:13:57.377392] [DEBUG] [LOCAL ] DELL: Derivative data saved (1820 records). [2025-09-29T02:13:57.381297] [DEBUG] [LOCAL ] DFIN: Loaded 23650 existing records from primary storage. [2025-09-29T02:13:57.380453] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-29T02:13:57.381683] [INFO ] [MAIN ] DFIN: Loaded 23650 primary data records. [2025-09-29T02:13:57.385937] [INFO ] [MAIN ] Derivative Progress: 573/2211 symbols completed. DELL took 1.3s. Estimated remaining: 11m 27s. Rate: 143.0 symbols/min [2025-09-29T02:13:57.391682] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:57.441222] [DEBUG] [LOCAL ] DFP: Loaded 11771 existing records from primary storage. [2025-09-29T02:13:57.463567] [INFO ] [MAIN ] DFP: Loaded 11771 primary data records. [2025-09-29T02:13:58.136574] [DEBUG] [LOCAL ] DG: Loaded 54068 existing records from primary storage. [2025-09-29T02:13:58.137268] [INFO ] [MAIN ] DG: Loaded 54068 primary data records. [2025-09-29T02:13:58.531618] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:58.533453] [INFO ] [MAIN ] DFIN: Generated 1820 derivative records from 23650 primary records. [2025-09-29T02:13:58.533569] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-29T02:13:58.548303] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:58.550113] [INFO ] [MAIN ] DFP: Generated 1820 derivative records from 11771 primary records. [2025-09-29T02:13:58.550542] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-29T02:13:58.569680] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1820 records). [2025-09-29T02:13:58.570454] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-29T02:13:58.581550] [INFO ] [MAIN ] Derivative Progress: 574/2211 symbols completed. DFIN took 1.3s. Estimated remaining: 11m 29s. Rate: 142.5 symbols/min [2025-09-29T02:13:58.584805] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:58.592454] [DEBUG] [LOCAL ] DFP: Derivative data saved (1820 records). [2025-09-29T02:13:58.593034] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-29T02:13:58.596258] [INFO ] [MAIN ] Derivative Progress: 575/2211 symbols completed. DFP took 1.3s. Estimated remaining: 11m 28s. Rate: 142.8 symbols/min [2025-09-29T02:13:58.597274] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:58.620422] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:58.621531] [INFO ] [MAIN ] DG: Generated 1820 derivative records from 54068 primary records. [2025-09-29T02:13:58.621786] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-29T02:13:58.644559] [DEBUG] [LOCAL ] DG: Derivative data saved (1820 records). [2025-09-29T02:13:58.644830] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-29T02:13:58.647985] [INFO ] [MAIN ] Derivative Progress: 576/2211 symbols completed. DG took 1.3s. Estimated remaining: 11m 26s. Rate: 143.0 symbols/min [2025-09-29T02:13:58.648318] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:58.666721] [DEBUG] [LOCAL ] DHF: Loaded 20835 existing records from primary storage. [2025-09-29T02:13:58.667265] [INFO ] [MAIN ] DHF: Loaded 20835 primary data records. [2025-09-29T02:13:58.797576] [DEBUG] [LOCAL ] DGX: Loaded 45736 existing records from primary storage. [2025-09-29T02:13:58.808819] [INFO ] [MAIN ] DGX: Loaded 45736 primary data records. [2025-09-29T02:13:59.386784] [DEBUG] [LOCAL ] DHI: Loaded 54147 existing records from primary storage. [2025-09-29T02:13:59.389469] [INFO ] [MAIN ] DHI: Loaded 54147 primary data records. [2025-09-29T02:13:59.786297] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:59.787400] [INFO ] [MAIN ] DHF: Generated 1820 derivative records from 20835 primary records. [2025-09-29T02:13:59.787727] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-29T02:13:59.825818] [DEBUG] [LOCAL ] DHF: Derivative data saved (1820 records). [2025-09-29T02:13:59.826264] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:59.826682] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-29T02:13:59.829922] [INFO ] [MAIN ] Derivative Progress: 577/2211 symbols completed. DHF took 1.2s. Estimated remaining: 11m 28s. Rate: 142.5 symbols/min [2025-09-29T02:13:59.831157] [INFO ] [MAIN ] DGX: Generated 1820 derivative records from 45736 primary records. [2025-09-29T02:13:59.831388] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-29T02:13:59.831592] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:59.855331] [DEBUG] [LOCAL ] DGX: Derivative data saved (1820 records). [2025-09-29T02:13:59.855520] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-29T02:13:59.858784] [INFO ] [MAIN ] Derivative Progress: 578/2211 symbols completed. DGX took 1.3s. Estimated remaining: 11m 26s. Rate: 142.8 symbols/min [2025-09-29T02:13:59.859491] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:59.878701] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:59.879789] [INFO ] [MAIN ] DHI: Generated 1820 derivative records from 54147 primary records. [2025-09-29T02:13:59.879917] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-29T02:13:59.898495] [DEBUG] [LOCAL ] DHI: Derivative data saved (1820 records). [2025-09-29T02:13:59.898813] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-29T02:13:59.901751] [INFO ] [MAIN ] Derivative Progress: 579/2211 symbols completed. DHI took 1.3s. Estimated remaining: 11m 25s. Rate: 143.0 symbols/min [2025-09-29T02:13:59.902208] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:59.948402] [DEBUG] [LOCAL ] DHX: Loaded 13404 existing records from primary storage. [2025-09-29T02:13:59.948627] [INFO ] [MAIN ] DHX: Loaded 13404 primary data records. [2025-09-29T02:14:00.076896] [DEBUG] [LOCAL ] DHR: Loaded 54139 existing records from primary storage. [2025-09-29T02:14:00.107000] [DEBUG] [LOCAL ] DHT: Loaded 48583 existing records from primary storage. [2025-09-29T02:14:00.107525] [INFO ] [MAIN ] DHT: Loaded 48583 primary data records. [2025-09-29T02:14:00.107165] [INFO ] [MAIN ] DHR: Loaded 54139 primary data records. [2025-09-29T02:14:01.105838] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:01.107259] [INFO ] [MAIN ] DHX: Generated 1820 derivative records from 13404 primary records. [2025-09-29T02:14:01.107486] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-29T02:14:01.128850] [DEBUG] [LOCAL ] DHX: Derivative data saved (1820 records). [2025-09-29T02:14:01.129124] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-29T02:14:01.131111] [INFO ] [MAIN ] Derivative Progress: 580/2211 symbols completed. DHX took 1.2s. Estimated remaining: 11m 27s. Rate: 142.5 symbols/min [2025-09-29T02:14:01.139896] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:01.148250] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:01.150843] [INFO ] [MAIN ] DHT: Generated 1820 derivative records from 48583 primary records. [2025-09-29T02:14:01.151132] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-29T02:14:01.165692] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:01.175581] [INFO ] [MAIN ] DHR: Generated 1820 derivative records from 54139 primary records. [2025-09-29T02:14:01.184151] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-29T02:14:01.188008] [DEBUG] [LOCAL ] DHT: Derivative data saved (1820 records). [2025-09-29T02:14:01.188634] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-29T02:14:01.200737] [INFO ] [MAIN ] Derivative Progress: 581/2211 symbols completed. DHT took 1.3s. Estimated remaining: 11m 25s. Rate: 142.7 symbols/min [2025-09-29T02:14:01.213460] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:01.216434] [DEBUG] [LOCAL ] DHR: Derivative data saved (1820 records). [2025-09-29T02:14:01.217763] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-29T02:14:01.221121] [INFO ] [MAIN ] Derivative Progress: 582/2211 symbols completed. DHR took 1.4s. Estimated remaining: 11m 24s. Rate: 143.0 symbols/min [2025-09-29T02:14:01.217040] [DEBUG] [LOCAL ] DIAX: Loaded 12780 existing records from primary storage. [2025-09-29T02:14:01.221598] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:01.221829] [INFO ] [MAIN ] DIAX: Loaded 12780 primary data records. [2025-09-29T02:14:01.614899] [DEBUG] [LOCAL ] DIN: Loaded 37823 existing records from primary storage. [2025-09-29T02:14:01.615302] [INFO ] [MAIN ] DIN: Loaded 37823 primary data records. [2025-09-29T02:14:01.726275] [DEBUG] [LOCAL ] DINO: Loaded 53729 existing records from primary storage. [2025-09-29T02:14:01.744532] [INFO ] [MAIN ] DINO: Loaded 53729 primary data records. [2025-09-29T02:14:02.215973] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:02.343559] [INFO ] [MAIN ] DIAX: Generated 1820 derivative records from 12780 primary records. [2025-09-29T02:14:02.345032] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-29T02:14:02.365562] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1820 records). [2025-09-29T02:14:02.367018] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-29T02:14:02.370054] [INFO ] [MAIN ] Derivative Progress: 583/2211 symbols completed. DIAX took 1.2s. Estimated remaining: 11m 25s. Rate: 142.5 symbols/min [2025-09-29T02:14:02.389602] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:02.390585] [INFO ] [MAIN ] DIN: Generated 1820 derivative records from 37823 primary records. [2025-09-29T02:14:02.390883] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-29T02:14:02.410712] [DEBUG] [LOCAL ] DIN: Derivative data saved (1820 records). [2025-09-29T02:14:02.423899] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:02.423964] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-29T02:14:02.424916] [INFO ] [MAIN ] DINO: Generated 1820 derivative records from 53729 primary records. [2025-09-29T02:14:02.427463] [INFO ] [MAIN ] Derivative Progress: 584/2211 symbols completed. DIN took 1.2s. Estimated remaining: 11m 24s. Rate: 142.7 symbols/min [2025-09-29T02:14:02.427575] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-29T02:14:02.443852] [DEBUG] [LOCAL ] DINO: Derivative data saved (1820 records). [2025-09-29T02:14:02.443942] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-29T02:14:02.446987] [INFO ] [MAIN ] Derivative Progress: 585/2211 symbols completed. DINO took 1.2s. Estimated remaining: 11m 22s. Rate: 143.0 symbols/min [2025-09-29T02:14:02.447518] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:02.447443] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:02.447723] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:02.472477] [DEBUG] [LOCAL ] DKL: Loaded 19229 existing records from primary storage. [2025-09-29T02:14:02.472706] [INFO ] [MAIN ] DKL: Loaded 19229 primary data records. [2025-09-29T02:14:02.887531] [DEBUG] [LOCAL ] DK: Loaded 50093 existing records from primary storage. [2025-09-29T02:14:02.887949] [INFO ] [MAIN ] DK: Loaded 50093 primary data records. [2025-09-29T02:14:02.913247] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-29T02:14:02.925923] [INFO ] [MAIN ] DIS: Loaded 54568 primary data records. [2025-09-29T02:14:03.573769] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:03.575227] [INFO ] [MAIN ] DKL: Generated 1820 derivative records from 19229 primary records. [2025-09-29T02:14:03.577017] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-29T02:14:03.595991] [DEBUG] [LOCAL ] DKL: Derivative data saved (1820 records). [2025-09-29T02:14:03.596576] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-29T02:14:03.599370] [INFO ] [MAIN ] Derivative Progress: 586/2211 symbols completed. DKL took 1.2s. Estimated remaining: 11m 24s. Rate: 142.5 symbols/min [2025-09-29T02:14:03.600148] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:03.619988] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:03.634076] [INFO ] [MAIN ] DK: Generated 1820 derivative records from 50093 primary records. [2025-09-29T02:14:03.634739] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-29T02:14:03.634474] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:03.636415] [INFO ] [MAIN ] DIS: Generated 1820 derivative records from 54568 primary records. [2025-09-29T02:14:03.636869] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-29T02:14:03.672573] [DEBUG] [LOCAL ] DIS: Derivative data saved (1820 records). [2025-09-29T02:14:03.673490] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-29T02:14:03.677850] [INFO ] [MAIN ] Derivative Progress: 587/2211 symbols completed. DIS took 1.2s. Estimated remaining: 11m 23s. Rate: 142.7 symbols/min [2025-09-29T02:14:03.678611] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:03.680666] [DEBUG] [LOCAL ] DK: Derivative data saved (1820 records). [2025-09-29T02:14:03.680886] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-29T02:14:03.683480] [INFO ] [MAIN ] Derivative Progress: 588/2211 symbols completed. DK took 1.2s. Estimated remaining: 11m 21s. Rate: 143.0 symbols/min [2025-09-29T02:14:03.683946] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:03.707820] [DEBUG] [LOCAL ] DLNG: Loaded 6276 existing records from primary storage. [2025-09-29T02:14:03.708069] [INFO ] [MAIN ] DLNG: Loaded 6276 primary data records. [2025-09-29T02:14:03.850867] [DEBUG] [LOCAL ] DKS: Loaded 50579 existing records from primary storage. [2025-09-29T02:14:03.852737] [INFO ] [MAIN ] DKS: Loaded 50579 primary data records. [2025-09-29T02:14:03.908471] [DEBUG] [LOCAL ] DLB: Loaded 32601 existing records from primary storage. [2025-09-29T02:14:04.029053] [INFO ] [MAIN ] DLB: Loaded 32601 primary data records. [2025-09-29T02:14:04.956702] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:04.958279] [INFO ] [MAIN ] DLNG: Generated 1820 derivative records from 6276 primary records. [2025-09-29T02:14:04.960199] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-29T02:14:04.999668] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1820 records). [2025-09-29T02:14:05.008733] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-29T02:14:05.011787] [INFO ] [MAIN ] Derivative Progress: 589/2211 symbols completed. DLNG took 1.3s. Estimated remaining: 11m 23s. Rate: 142.5 symbols/min [2025-09-29T02:14:05.021123] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:05.022579] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:05.022365] [INFO ] [MAIN ] DKS: Generated 1820 derivative records from 50579 primary records. [2025-09-29T02:14:05.023879] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-29T02:14:05.053873] [DEBUG] [LOCAL ] DKS: Derivative data saved (1820 records). [2025-09-29T02:14:05.063987] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-29T02:14:05.067314] [INFO ] [MAIN ] Derivative Progress: 590/2211 symbols completed. DKS took 1.5s. Estimated remaining: 11m 22s. Rate: 142.7 symbols/min [2025-09-29T02:14:05.074421] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:05.078209] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:05.079328] [INFO ] [MAIN ] DLB: Generated 1820 derivative records from 32601 primary records. [2025-09-29T02:14:05.079585] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-29T02:14:05.105391] [DEBUG] [LOCAL ] DLB: Derivative data saved (1820 records). [2025-09-29T02:14:05.105809] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-29T02:14:05.109899] [INFO ] [MAIN ] Derivative Progress: 591/2211 symbols completed. DLB took 1.4s. Estimated remaining: 11m 20s. Rate: 142.9 symbols/min [2025-09-29T02:14:05.110284] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:05.163775] [DEBUG] [LOCAL ] DLX: Loaded 29284 existing records from primary storage. [2025-09-29T02:14:05.170385] [INFO ] [MAIN ] DLX: Loaded 29284 primary data records. [2025-09-29T02:14:05.253251] [DEBUG] [LOCAL ] DLY: Loaded 19800 existing records from primary storage. [2025-09-29T02:14:05.269980] [DEBUG] [LOCAL ] DLR: Loaded 51825 existing records from primary storage. [2025-09-29T02:14:05.284209] [INFO ] [MAIN ] DLY: Loaded 19800 primary data records. [2025-09-29T02:14:05.284399] [INFO ] [MAIN ] DLR: Loaded 51825 primary data records. [2025-09-29T02:14:06.312627] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:06.314131] [INFO ] [MAIN ] DLX: Generated 1820 derivative records from 29284 primary records. [2025-09-29T02:14:06.314497] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-29T02:14:06.336049] [DEBUG] [LOCAL ] DLX: Derivative data saved (1820 records). [2025-09-29T02:14:06.337204] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-29T02:14:06.353277] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:06.352812] [INFO ] [MAIN ] Derivative Progress: 592/2211 symbols completed. DLX took 1.3s. Estimated remaining: 11m 22s. Rate: 142.4 symbols/min [2025-09-29T02:14:06.367697] [INFO ] [MAIN ] DLR: Generated 1820 derivative records from 51825 primary records. [2025-09-29T02:14:06.368223] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-29T02:14:06.368044] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:06.368341] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:06.370046] [INFO ] [MAIN ] DLY: Generated 1820 derivative records from 19800 primary records. [2025-09-29T02:14:06.384893] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-29T02:14:06.389019] [DEBUG] [LOCAL ] DLR: Derivative data saved (1820 records). [2025-09-29T02:14:06.389849] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-29T02:14:06.399967] [INFO ] [MAIN ] Derivative Progress: 593/2211 symbols completed. DLR took 1.4s. Estimated remaining: 11m 21s. Rate: 142.6 symbols/min [2025-09-29T02:14:06.410909] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:06.411748] [DEBUG] [LOCAL ] DMA: Loaded 4604 existing records from primary storage. [2025-09-29T02:14:06.412242] [INFO ] [MAIN ] DMA: Loaded 4604 primary data records. [2025-09-29T02:14:06.425971] [DEBUG] [LOCAL ] DLY: Derivative data saved (1820 records). [2025-09-29T02:14:06.461072] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-29T02:14:06.493099] [INFO ] [MAIN ] Derivative Progress: 594/2211 symbols completed. DLY took 1.4s. Estimated remaining: 11m 19s. Rate: 142.8 symbols/min [2025-09-29T02:14:06.514232] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:06.597129] [DEBUG] [LOCAL ] DMB: Loaded 10254 existing records from primary storage. [2025-09-29T02:14:06.625386] [INFO ] [MAIN ] DMB: Loaded 10254 primary data records. [2025-09-29T02:14:06.764255] [DEBUG] [LOCAL ] DMO: Loaded 9981 existing records from primary storage. [2025-09-29T02:14:06.777420] [INFO ] [MAIN ] DMO: Loaded 9981 primary data records. [2025-09-29T02:14:07.509891] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:07.512125] [INFO ] [MAIN ] DMA: Generated 1820 derivative records from 4604 primary records. [2025-09-29T02:14:07.512816] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-29T02:14:07.532584] [DEBUG] [LOCAL ] DMA: Derivative data saved (1820 records). [2025-09-29T02:14:07.534966] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-29T02:14:07.538031] [INFO ] [MAIN ] Derivative Progress: 595/2211 symbols completed. DMA took 1.2s. Estimated remaining: 11m 21s. Rate: 142.5 symbols/min [2025-09-29T02:14:07.538869] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:07.553333] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:07.554195] [INFO ] [MAIN ] DMB: Generated 1820 derivative records from 10254 primary records. [2025-09-29T02:14:07.554400] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-29T02:14:07.571809] [DEBUG] [LOCAL ] DMB: Derivative data saved (1820 records). [2025-09-29T02:14:07.574243] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-29T02:14:07.577405] [INFO ] [MAIN ] Derivative Progress: 596/2211 symbols completed. DMB took 1.2s. Estimated remaining: 11m 19s. Rate: 142.7 symbols/min [2025-09-29T02:14:07.577684] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:07.592090] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:07.593312] [INFO ] [MAIN ] DMO: Generated 1820 derivative records from 9981 primary records. [2025-09-29T02:14:07.593560] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-29T02:14:07.621068] [DEBUG] [LOCAL ] DMO: Derivative data saved (1820 records). [2025-09-29T02:14:07.621308] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-29T02:14:07.624490] [INFO ] [MAIN ] Derivative Progress: 597/2211 symbols completed. DMO took 1.1s. Estimated remaining: 11m 18s. Rate: 142.9 symbols/min [2025-09-29T02:14:07.636380] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:07.670324] [DEBUG] [LOCAL ] DNA: Loaded 48990 existing records from primary storage. [2025-09-29T02:14:07.670629] [INFO ] [MAIN ] DNA: Loaded 48990 primary data records. [2025-09-29T02:14:07.829838] [DEBUG] [LOCAL ] DNOW: Loaded 44205 existing records from primary storage. [2025-09-29T02:14:07.862810] [INFO ] [MAIN ] DNOW: Loaded 44205 primary data records. [2025-09-29T02:14:07.842077] [DEBUG] [LOCAL ] DNP: Loaded 33786 existing records from primary storage. [2025-09-29T02:14:07.896288] [INFO ] [MAIN ] DNP: Loaded 33786 primary data records. [2025-09-29T02:14:08.763553] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:08.768112] [INFO ] [MAIN ] DNA: Generated 1820 derivative records from 48990 primary records. [2025-09-29T02:14:08.769265] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-29T02:14:08.789101] [DEBUG] [LOCAL ] DNA: Derivative data saved (1820 records). [2025-09-29T02:14:08.790005] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-29T02:14:08.792991] [INFO ] [MAIN ] Derivative Progress: 598/2211 symbols completed. DNA took 1.3s. Estimated remaining: 11m 19s. Rate: 142.5 symbols/min [2025-09-29T02:14:08.824719] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:08.823969] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:08.826298] [INFO ] [MAIN ] DNOW: Generated 1820 derivative records from 44205 primary records. [2025-09-29T02:14:08.825568] [INFO ] [MAIN ] DNP: Generated 1820 derivative records from 33786 primary records. [2025-09-29T02:14:08.826416] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-29T02:14:08.826514] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-29T02:14:08.859095] [DEBUG] [LOCAL ] DNP: Derivative data saved (1820 records). [2025-09-29T02:14:08.859175] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1820 records). [2025-09-29T02:14:08.859386] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-29T02:14:08.859488] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-29T02:14:08.862439] [INFO ] [MAIN ] Derivative Progress: 599/2211 symbols completed. DNOW took 1.3s. Estimated remaining: 11m 18s. Rate: 142.7 symbols/min [2025-09-29T02:14:08.865783] [INFO ] [MAIN ] Derivative Progress: 600/2211 symbols completed. DNP took 1.2s. Estimated remaining: 11m 16s. Rate: 142.9 symbols/min [2025-09-29T02:14:08.866339] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:08.866291] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:08.866390] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:08.974823] [DEBUG] [LOCAL ] DOCN: Loaded 51245 existing records from primary storage. [2025-09-29T02:14:08.977862] [INFO ] [MAIN ] DOCN: Loaded 51245 primary data records. [2025-09-29T02:14:09.006245] [DEBUG] [LOCAL ] DOCS: Loaded 51956 existing records from primary storage. [2025-09-29T02:14:09.073151] [DEBUG] [LOCAL ] DOC: Loaded 54317 existing records from primary storage. [2025-09-29T02:14:09.057087] [INFO ] [MAIN ] DOCS: Loaded 51956 primary data records. [2025-09-29T02:14:09.087317] [INFO ] [MAIN ] DOC: Loaded 54317 primary data records. [2025-09-29T02:14:10.109574] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:10.117285] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:10.117012] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:10.116107] [INFO ] [MAIN ] DOCS: Generated 1820 derivative records from 51956 primary records. [2025-09-29T02:14:10.117730] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-29T02:14:10.118458] [INFO ] [MAIN ] DOC: Generated 1820 derivative records from 54317 primary records. [2025-09-29T02:14:10.119630] [INFO ] [MAIN ] DOCN: Generated 1820 derivative records from 51245 primary records. [2025-09-29T02:14:10.119886] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-29T02:14:10.119959] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-29T02:14:10.161243] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1820 records). [2025-09-29T02:14:10.161412] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-29T02:14:10.171378] [INFO ] [MAIN ] Derivative Progress: 601/2211 symbols completed. DOCS took 1.3s. Estimated remaining: 11m 18s. Rate: 142.4 symbols/min [2025-09-29T02:14:10.172619] [DEBUG] [LOCAL ] DOC: Derivative data saved (1820 records). [2025-09-29T02:14:10.177215] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:10.174017] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-29T02:14:10.178691] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1820 records). [2025-09-29T02:14:10.179404] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-29T02:14:10.182731] [INFO ] [MAIN ] Derivative Progress: 602/2211 symbols completed. DOC took 1.3s. Estimated remaining: 11m 17s. Rate: 142.6 symbols/min [2025-09-29T02:14:10.185955] [INFO ] [MAIN ] Derivative Progress: 603/2211 symbols completed. DOCN took 1.3s. Estimated remaining: 11m 15s. Rate: 142.9 symbols/min [2025-09-29T02:14:10.183119] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:10.186972] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:10.263898] [DEBUG] [LOCAL ] DOUG: Loaded 35254 existing records from primary storage. [2025-09-29T02:14:10.265473] [INFO ] [MAIN ] DOUG: Loaded 35254 primary data records. [2025-09-29T02:14:10.266618] [DEBUG] [LOCAL ] DOLE: Loaded 38568 existing records from primary storage. [2025-09-29T02:14:10.338115] [INFO ] [MAIN ] DOLE: Loaded 38568 primary data records. [2025-09-29T02:14:10.423126] [DEBUG] [LOCAL ] DOV: Loaded 46376 existing records from primary storage. [2025-09-29T02:14:10.448192] [INFO ] [MAIN ] DOV: Loaded 46376 primary data records. [2025-09-29T02:14:11.335873] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:11.337513] [INFO ] [MAIN ] DOUG: Generated 1820 derivative records from 35254 primary records. [2025-09-29T02:14:11.338270] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-29T02:14:11.370976] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1820 records). [2025-09-29T02:14:11.371939] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:11.371605] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-29T02:14:11.375259] [INFO ] [MAIN ] Derivative Progress: 604/2211 symbols completed. DOUG took 1.2s. Estimated remaining: 11m 17s. Rate: 142.4 symbols/min [2025-09-29T02:14:11.376284] [INFO ] [MAIN ] DOLE: Generated 1820 derivative records from 38568 primary records. [2025-09-29T02:14:11.376503] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-29T02:14:11.376709] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:11.398056] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1820 records). [2025-09-29T02:14:11.406335] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-29T02:14:11.414764] [INFO ] [MAIN ] Derivative Progress: 605/2211 symbols completed. DOLE took 1.2s. Estimated remaining: 11m 16s. Rate: 142.6 symbols/min [2025-09-29T02:14:11.415312] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:11.415509] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:11.416430] [INFO ] [MAIN ] DOV: Generated 1820 derivative records from 46376 primary records. [2025-09-29T02:14:11.417318] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-29T02:14:11.438813] [DEBUG] [LOCAL ] DOV: Derivative data saved (1820 records). [2025-09-29T02:14:11.438959] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-29T02:14:11.442023] [INFO ] [MAIN ] Derivative Progress: 606/2211 symbols completed. DOV took 1.3s. Estimated remaining: 11m 14s. Rate: 142.9 symbols/min [2025-09-29T02:14:11.442326] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:11.449968] [DEBUG] [LOCAL ] DPG: Loaded 13683 existing records from primary storage. [2025-09-29T02:14:11.450135] [INFO ] [MAIN ] DPG: Loaded 13683 primary data records. [2025-09-29T02:14:11.854820] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-29T02:14:11.856207] [INFO ] [MAIN ] DOW: Loaded 54513 primary data records. [2025-09-29T02:14:11.923081] [DEBUG] [LOCAL ] DQ: Loaded 43880 existing records from primary storage. [2025-09-29T02:14:11.959806] [INFO ] [MAIN ] DQ: Loaded 43880 primary data records. [2025-09-29T02:14:12.449738] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:12.562578] [INFO ] [MAIN ] DPG: Generated 1820 derivative records from 13683 primary records. [2025-09-29T02:14:12.578786] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-29T02:14:12.601019] [DEBUG] [LOCAL ] DPG: Derivative data saved (1820 records). [2025-09-29T02:14:12.602072] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-29T02:14:12.605442] [INFO ] [MAIN ] Derivative Progress: 607/2211 symbols completed. DPG took 1.2s. Estimated remaining: 11m 16s. Rate: 142.5 symbols/min [2025-09-29T02:14:12.606343] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:12.627149] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:12.628017] [INFO ] [MAIN ] DOW: Generated 1820 derivative records from 54513 primary records. [2025-09-29T02:14:12.628224] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-29T02:14:12.647129] [DEBUG] [LOCAL ] DOW: Derivative data saved (1820 records). [2025-09-29T02:14:12.649026] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-29T02:14:12.651580] [INFO ] [MAIN ] Derivative Progress: 608/2211 symbols completed. DOW took 1.3s. Estimated remaining: 11m 14s. Rate: 142.7 symbols/min [2025-09-29T02:14:12.652682] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:12.666686] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:12.667595] [INFO ] [MAIN ] DQ: Generated 1820 derivative records from 43880 primary records. [2025-09-29T02:14:12.667924] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-29T02:14:12.695277] [DEBUG] [LOCAL ] DQ: Derivative data saved (1820 records). [2025-09-29T02:14:12.695678] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-29T02:14:12.698794] [INFO ] [MAIN ] Derivative Progress: 609/2211 symbols completed. DQ took 1.3s. Estimated remaining: 11m 13s. Rate: 142.9 symbols/min [2025-09-29T02:14:12.700359] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:12.719453] [DEBUG] [LOCAL ] DRD: Loaded 37397 existing records from primary storage. [2025-09-29T02:14:12.719848] [INFO ] [MAIN ] DRD: Loaded 37397 primary data records. [2025-09-29T02:14:13.108007] [DEBUG] [LOCAL ] DRH: Loaded 51205 existing records from primary storage. [2025-09-29T02:14:13.108345] [INFO ] [MAIN ] DRH: Loaded 51205 primary data records. [2025-09-29T02:14:13.240684] [DEBUG] [LOCAL ] DRI: Loaded 48554 existing records from primary storage. [2025-09-29T02:14:13.245502] [INFO ] [MAIN ] DRI: Loaded 48554 primary data records. [2025-09-29T02:14:13.875910] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:13.878052] [INFO ] [MAIN ] DRD: Generated 1820 derivative records from 37397 primary records. [2025-09-29T02:14:13.879353] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-29T02:14:13.899690] [DEBUG] [LOCAL ] DRD: Derivative data saved (1820 records). [2025-09-29T02:14:13.901403] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-29T02:14:13.904344] [INFO ] [MAIN ] Derivative Progress: 610/2211 symbols completed. DRD took 1.3s. Estimated remaining: 11m 14s. Rate: 142.4 symbols/min [2025-09-29T02:14:13.906334] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:13.922918] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:13.923886] [INFO ] [MAIN ] DRH: Generated 1820 derivative records from 51205 primary records. [2025-09-29T02:14:13.924182] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-29T02:14:13.946529] [DEBUG] [LOCAL ] DRH: Derivative data saved (1820 records). [2025-09-29T02:14:13.951316] [DEBUG] [LOCAL ] DRLL: Loaded 9737 existing records from primary storage. [2025-09-29T02:14:13.964755] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:13.965095] [INFO ] [MAIN ] DRLL: Loaded 9737 primary data records. [2025-09-29T02:14:13.964933] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-29T02:14:13.968255] [INFO ] [MAIN ] Derivative Progress: 611/2211 symbols completed. DRH took 1.3s. Estimated remaining: 11m 13s. Rate: 142.6 symbols/min [2025-09-29T02:14:13.969219] [INFO ] [MAIN ] DRI: Generated 1820 derivative records from 48554 primary records. [2025-09-29T02:14:13.974501] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:13.974779] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-29T02:14:14.062681] [DEBUG] [LOCAL ] DRI: Derivative data saved (1820 records). [2025-09-29T02:14:14.081716] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-29T02:14:14.108522] [INFO ] [MAIN ] Derivative Progress: 612/2211 symbols completed. DRI took 1.4s. Estimated remaining: 11m 12s. Rate: 142.8 symbols/min [2025-09-29T02:14:14.113345] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:14.198736] [DEBUG] [LOCAL ] DSL: Loaded 28651 existing records from primary storage. [2025-09-29T02:14:14.346685] [INFO ] [MAIN ] DSL: Loaded 28651 primary data records. [2025-09-29T02:14:14.411087] [DEBUG] [LOCAL ] DSM: Loaded 15895 existing records from primary storage. [2025-09-29T02:14:14.440804] [INFO ] [MAIN ] DSM: Loaded 15895 primary data records. [2025-09-29T02:14:15.088351] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:15.090169] [INFO ] [MAIN ] DRLL: Generated 1820 derivative records from 9737 primary records. [2025-09-29T02:14:15.091309] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-29T02:14:15.111030] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1820 records). [2025-09-29T02:14:15.113900] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-29T02:14:15.117235] [INFO ] [MAIN ] Derivative Progress: 613/2211 symbols completed. DRLL took 1.2s. Estimated remaining: 11m 13s. Rate: 142.5 symbols/min [2025-09-29T02:14:15.132527] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:15.133712] [INFO ] [MAIN ] DSL: Generated 1820 derivative records from 28651 primary records. [2025-09-29T02:14:15.133983] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-29T02:14:15.165262] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:15.167324] [INFO ] [MAIN ] DSM: Generated 1820 derivative records from 15895 primary records. [2025-09-29T02:14:15.167957] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-29T02:14:15.171131] [DEBUG] [LOCAL ] DSL: Derivative data saved (1820 records). [2025-09-29T02:14:15.178820] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-29T02:14:15.184670] [INFO ] [MAIN ] Derivative Progress: 614/2211 symbols completed. DSL took 1.2s. Estimated remaining: 11m 12s. Rate: 142.7 symbols/min [2025-09-29T02:14:15.189216] [DEBUG] [LOCAL ] DSM: Derivative data saved (1820 records). [2025-09-29T02:14:15.189304] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-29T02:14:15.191884] [INFO ] [MAIN ] Derivative Progress: 615/2211 symbols completed. DSM took 1.1s. Estimated remaining: 11m 10s. Rate: 142.9 symbols/min [2025-09-29T02:14:15.192492] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:15.192359] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:15.192552] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:15.198312] [DEBUG] [LOCAL ] DSMC: Loaded 1974 existing records from primary storage. [2025-09-29T02:14:15.198719] [INFO ] [MAIN ] DSMC: Loaded 1974 primary data records. [2025-09-29T02:14:15.440118] [DEBUG] [LOCAL ] DSU: Loaded 22684 existing records from primary storage. [2025-09-29T02:14:15.438495] [DEBUG] [LOCAL ] DSX: Loaded 24642 existing records from primary storage. [2025-09-29T02:14:15.550607] [INFO ] [MAIN ] DSU: Loaded 22684 primary data records. [2025-09-29T02:14:15.555998] [INFO ] [MAIN ] DSX: Loaded 24642 primary data records. [2025-09-29T02:14:16.334217] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:16.335468] [INFO ] [MAIN ] DSMC: Generated 1820 derivative records from 1974 primary records. [2025-09-29T02:14:16.336243] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-29T02:14:16.355090] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1820 records). [2025-09-29T02:14:16.355542] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-29T02:14:16.358356] [INFO ] [MAIN ] Derivative Progress: 616/2211 symbols completed. DSMC took 1.2s. Estimated remaining: 11m 12s. Rate: 142.5 symbols/min [2025-09-29T02:14:16.358917] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:16.380002] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:16.382488] [INFO ] [MAIN ] DSX: Generated 1820 derivative records from 24642 primary records. [2025-09-29T02:14:16.382899] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-29T02:14:16.396539] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:16.397597] [INFO ] [MAIN ] DSU: Generated 1820 derivative records from 22684 primary records. [2025-09-29T02:14:16.397999] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-29T02:14:16.428269] [DEBUG] [LOCAL ] DSX: Derivative data saved (1820 records). [2025-09-29T02:14:16.430683] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-29T02:14:16.434685] [INFO ] [MAIN ] Derivative Progress: 617/2211 symbols completed. DSX took 1.2s. Estimated remaining: 11m 10s. Rate: 142.7 symbols/min [2025-09-29T02:14:16.431622] [DEBUG] [LOCAL ] DSU: Derivative data saved (1820 records). [2025-09-29T02:14:16.434913] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:16.435568] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-29T02:14:16.438335] [INFO ] [MAIN ] Derivative Progress: 618/2211 symbols completed. DSU took 1.2s. Estimated remaining: 11m 9s. Rate: 142.9 symbols/min [2025-09-29T02:14:16.453398] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:16.461870] [DEBUG] [LOCAL ] DTB: Loaded 4817 existing records from primary storage. [2025-09-29T02:14:16.462186] [INFO ] [MAIN ] DTB: Loaded 4817 primary data records. [2025-09-29T02:14:16.602564] [DEBUG] [LOCAL ] DT: Loaded 53708 existing records from primary storage. [2025-09-29T02:14:16.602804] [INFO ] [MAIN ] DT: Loaded 53708 primary data records. [2025-09-29T02:14:17.156259] [DEBUG] [LOCAL ] DTE: Loaded 48557 existing records from primary storage. [2025-09-29T02:14:17.173427] [INFO ] [MAIN ] DTE: Loaded 48557 primary data records. [2025-09-29T02:14:17.536382] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:17.538793] [INFO ] [MAIN ] DTB: Generated 1820 derivative records from 4817 primary records. [2025-09-29T02:14:17.539314] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-29T02:14:17.559366] [DEBUG] [LOCAL ] DTB: Derivative data saved (1820 records). [2025-09-29T02:14:17.560115] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-29T02:14:17.570319] [INFO ] [MAIN ] Derivative Progress: 619/2211 symbols completed. DTB took 1.1s. Estimated remaining: 11m 10s. Rate: 142.5 symbols/min [2025-09-29T02:14:17.577019] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:17.577294] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:17.579338] [INFO ] [MAIN ] DT: Generated 1820 derivative records from 53708 primary records. [2025-09-29T02:14:17.579929] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-29T02:14:17.603868] [DEBUG] [LOCAL ] DT: Derivative data saved (1820 records). [2025-09-29T02:14:17.604762] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-29T02:14:17.608264] [INFO ] [MAIN ] Derivative Progress: 620/2211 symbols completed. DT took 1.2s. Estimated remaining: 11m 9s. Rate: 142.7 symbols/min [2025-09-29T02:14:17.612717] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:17.613208] [DEBUG] [LOCAL ] DTG: Loaded 5952 existing records from primary storage. [2025-09-29T02:14:17.614134] [INFO ] [MAIN ] DTG: Loaded 5952 primary data records. [2025-09-29T02:14:17.755162] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:17.796692] [INFO ] [MAIN ] DTE: Generated 1820 derivative records from 48557 primary records. [2025-09-29T02:14:17.831752] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-29T02:14:18.041408] [DEBUG] [LOCAL ] DTE: Derivative data saved (1820 records). [2025-09-29T02:14:18.059970] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-29T02:14:18.063298] [INFO ] [MAIN ] Derivative Progress: 621/2211 symbols completed. DTE took 1.6s. Estimated remaining: 11m 9s. Rate: 142.7 symbols/min [2025-09-29T02:14:18.065810] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:18.068797] [DEBUG] [LOCAL ] DTM: Loaded 45043 existing records from primary storage. [2025-09-29T02:14:18.069165] [INFO ] [MAIN ] DTM: Loaded 45043 primary data records. [2025-09-29T02:14:18.153301] [DEBUG] [LOCAL ] DTW: Loaded 4923 existing records from primary storage. [2025-09-29T02:14:18.172320] [INFO ] [MAIN ] DTW: Loaded 4923 primary data records. [2025-09-29T02:14:18.421017] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:18.427382] [INFO ] [MAIN ] DTG: Generated 1820 derivative records from 5952 primary records. [2025-09-29T02:14:18.562636] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-29T02:14:18.797547] [DEBUG] [LOCAL ] DTG: Derivative data saved (1820 records). [2025-09-29T02:14:18.798116] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-29T02:14:18.800433] [INFO ] [MAIN ] Derivative Progress: 622/2211 symbols completed. DTG took 1.2s. Estimated remaining: 11m 9s. Rate: 142.5 symbols/min [2025-09-29T02:14:18.800757] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:18.833157] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:18.835761] [INFO ] [MAIN ] DTM: Generated 1820 derivative records from 45043 primary records. [2025-09-29T02:14:18.836538] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-29T02:14:18.859817] [DEBUG] [LOCAL ] DTM: Derivative data saved (1820 records). [2025-09-29T02:14:18.860557] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-29T02:14:18.864047] [INFO ] [MAIN ] Derivative Progress: 623/2211 symbols completed. DTM took 1.3s. Estimated remaining: 11m 8s. Rate: 142.7 symbols/min [2025-09-29T02:14:18.878816] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:18.879957] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:14:18.882221] [INFO ] [MAIN ] DTW: Generated 1819 derivative records from 4923 primary records. [2025-09-29T02:14:18.882573] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-29T02:14:18.906032] [DEBUG] [LOCAL ] DTW: Derivative data saved (1819 records). [2025-09-29T02:14:18.921336] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-29T02:14:18.926773] [DEBUG] [LOCAL ] DUKB: Loaded 6414 existing records from primary storage. [2025-09-29T02:14:18.931148] [INFO ] [MAIN ] Derivative Progress: 624/2211 symbols completed. DTW took 0.9s. Estimated remaining: 11m 6s. Rate: 142.9 symbols/min [2025-09-29T02:14:18.931565] [INFO ] [MAIN ] DUKB: Loaded 6414 primary data records. [2025-09-29T02:14:18.937302] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:19.065995] [DEBUG] [LOCAL ] DUK: Loaded 54238 existing records from primary storage. [2025-09-29T02:14:19.072631] [INFO ] [MAIN ] DUK: Loaded 54238 primary data records. [2025-09-29T02:14:19.654939] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-09-29T02:14:19.670911] [INFO ] [MAIN ] DV: Loaded 52038 primary data records. [2025-09-29T02:14:20.016302] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:20.033560] [INFO ] [MAIN ] DUKB: Generated 1820 derivative records from 6414 primary records. [2025-09-29T02:14:20.033993] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-29T02:14:20.053458] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1820 records). [2025-09-29T02:14:20.055616] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-29T02:14:20.060119] [INFO ] [MAIN ] Derivative Progress: 625/2211 symbols completed. DUKB took 1.2s. Estimated remaining: 11m 8s. Rate: 142.5 symbols/min [2025-09-29T02:14:20.060564] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:20.075348] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:20.076195] [INFO ] [MAIN ] DUK: Generated 1820 derivative records from 54238 primary records. [2025-09-29T02:14:20.076935] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-29T02:14:20.095585] [DEBUG] [LOCAL ] DUK: Derivative data saved (1820 records). [2025-09-29T02:14:20.096026] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-29T02:14:20.099181] [INFO ] [MAIN ] Derivative Progress: 626/2211 symbols completed. DUK took 1.3s. Estimated remaining: 11m 6s. Rate: 142.7 symbols/min [2025-09-29T02:14:20.099820] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:20.119548] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:20.120701] [INFO ] [MAIN ] DV: Generated 1820 derivative records from 52038 primary records. [2025-09-29T02:14:20.120798] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-29T02:14:20.148499] [DEBUG] [LOCAL ] DV: Derivative data saved (1820 records). [2025-09-29T02:14:20.148902] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-29T02:14:20.152471] [INFO ] [MAIN ] Derivative Progress: 627/2211 symbols completed. DV took 1.2s. Estimated remaining: 11m 5s. Rate: 142.9 symbols/min [2025-09-29T02:14:20.152937] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:20.176736] [DEBUG] [LOCAL ] DVA: Loaded 41877 existing records from primary storage. [2025-09-29T02:14:20.177216] [INFO ] [MAIN ] DVA: Loaded 41877 primary data records. [2025-09-29T02:14:20.373499] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-29T02:14:20.433618] [INFO ] [MAIN ] DVN: Loaded 54479 primary data records. [2025-09-29T02:14:20.725795] [DEBUG] [LOCAL ] DX: Loaded 53228 existing records from primary storage. [2025-09-29T02:14:20.742703] [INFO ] [MAIN ] DX: Loaded 53228 primary data records. [2025-09-29T02:14:21.197158] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:21.326330] [INFO ] [MAIN ] DVA: Generated 1820 derivative records from 41877 primary records. [2025-09-29T02:14:21.327879] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-29T02:14:21.347875] [DEBUG] [LOCAL ] DVA: Derivative data saved (1820 records). [2025-09-29T02:14:21.351067] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-29T02:14:21.354331] [INFO ] [MAIN ] Derivative Progress: 628/2211 symbols completed. DVA took 1.3s. Estimated remaining: 11m 7s. Rate: 142.5 symbols/min [2025-09-29T02:14:21.369630] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:21.370596] [INFO ] [MAIN ] DVN: Generated 1820 derivative records from 54479 primary records. [2025-09-29T02:14:21.370734] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-29T02:14:21.388761] [DEBUG] [LOCAL ] DVN: Derivative data saved (1820 records). [2025-09-29T02:14:21.389148] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-29T02:14:21.391982] [INFO ] [MAIN ] Derivative Progress: 629/2211 symbols completed. DVN took 1.3s. Estimated remaining: 11m 5s. Rate: 142.7 symbols/min [2025-09-29T02:14:21.409579] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:21.410429] [INFO ] [MAIN ] DX: Generated 1820 derivative records from 53228 primary records. [2025-09-29T02:14:21.410518] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-29T02:14:21.426749] [DEBUG] [LOCAL ] DX: Derivative data saved (1820 records). [2025-09-29T02:14:21.426870] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-29T02:14:21.430547] [INFO ] [MAIN ] Derivative Progress: 630/2211 symbols completed. DX took 1.3s. Estimated remaining: 11m 4s. Rate: 142.9 symbols/min [2025-09-29T02:14:21.431144] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:21.431279] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:21.431631] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:21.474457] [DEBUG] [LOCAL ] DY: Loaded 30160 existing records from primary storage. [2025-09-29T02:14:21.486898] [INFO ] [MAIN ] DY: Loaded 30160 primary data records. [2025-09-29T02:14:21.648392] [DEBUG] [LOCAL ] DXYZ: Loaded 37246 existing records from primary storage. [2025-09-29T02:14:21.666207] [DEBUG] [LOCAL ] DXC: Loaded 50456 existing records from primary storage. [2025-09-29T02:14:21.676929] [INFO ] [MAIN ] DXC: Loaded 50456 primary data records. [2025-09-29T02:14:21.666401] [INFO ] [MAIN ] DXYZ: Loaded 37246 primary data records. [2025-09-29T02:14:22.704732] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:22.707233] [INFO ] [MAIN ] DY: Generated 1820 derivative records from 30160 primary records. [2025-09-29T02:14:22.708024] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-29T02:14:22.736350] [DEBUG] [LOCAL ] DY: Derivative data saved (1820 records). [2025-09-29T02:14:22.738281] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-29T02:14:22.741386] [INFO ] [MAIN ] Derivative Progress: 631/2211 symbols completed. DY took 1.3s. Estimated remaining: 11m 6s. Rate: 142.4 symbols/min [2025-09-29T02:14:22.741940] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:22.781390] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:22.783274] [INFO ] [MAIN ] DXYZ: Generated 1820 derivative records from 37246 primary records. [2025-09-29T02:14:22.782033] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:22.784690] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-29T02:14:22.784580] [INFO ] [MAIN ] DXC: Generated 1820 derivative records from 50456 primary records. [2025-09-29T02:14:22.785015] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-29T02:14:22.819515] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1820 records). [2025-09-29T02:14:22.819902] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-29T02:14:22.830572] [DEBUG] [LOCAL ] DXC: Derivative data saved (1820 records). [2025-09-29T02:14:22.831062] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-29T02:14:22.834185] [INFO ] [MAIN ] Derivative Progress: 632/2211 symbols completed. DXYZ took 1.4s. Estimated remaining: 11m 4s. Rate: 142.6 symbols/min [2025-09-29T02:14:22.837818] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:22.837912] [INFO ] [MAIN ] Derivative Progress: 633/2211 symbols completed. DXC took 1.4s. Estimated remaining: 11m 3s. Rate: 142.8 symbols/min [2025-09-29T02:14:22.838391] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:22.860907] [DEBUG] [LOCAL ] EAI: Loaded 4008 existing records from primary storage. [2025-09-29T02:14:22.861209] [INFO ] [MAIN ] EAI: Loaded 4008 primary data records. [2025-09-29T02:14:22.867865] [DEBUG] [LOCAL ] E: Loaded 33848 existing records from primary storage. [2025-09-29T02:14:22.888117] [INFO ] [MAIN ] E: Loaded 33848 primary data records. [2025-09-29T02:14:23.266882] [DEBUG] [LOCAL ] EAF: Loaded 44158 existing records from primary storage. [2025-09-29T02:14:23.412125] [INFO ] [MAIN ] EAF: Loaded 44158 primary data records. [2025-09-29T02:14:23.916313] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:23.920711] [INFO ] [MAIN ] EAI: Generated 1820 derivative records from 4008 primary records. [2025-09-29T02:14:23.922014] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-29T02:14:23.945537] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:23.955326] [DEBUG] [LOCAL ] EAI: Derivative data saved (1820 records). [2025-09-29T02:14:23.956159] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-29T02:14:23.950945] [INFO ] [MAIN ] E: Generated 1820 derivative records from 33848 primary records. [2025-09-29T02:14:23.956322] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-29T02:14:23.958571] [INFO ] [MAIN ] Derivative Progress: 634/2211 symbols completed. EAI took 1.1s. Estimated remaining: 11m 4s. Rate: 142.5 symbols/min [2025-09-29T02:14:23.961941] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:23.982869] [DEBUG] [LOCAL ] E: Derivative data saved (1820 records). [2025-09-29T02:14:23.984130] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-29T02:14:23.989047] [INFO ] [MAIN ] Derivative Progress: 635/2211 symbols completed. E took 1.2s. Estimated remaining: 11m 3s. Rate: 142.7 symbols/min [2025-09-29T02:14:23.990304] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:24.007736] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:24.008561] [INFO ] [MAIN ] EAF: Generated 1820 derivative records from 44158 primary records. [2025-09-29T02:14:24.008797] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-29T02:14:24.034956] [DEBUG] [LOCAL ] EAF: Derivative data saved (1820 records). [2025-09-29T02:14:24.035171] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-29T02:14:24.038086] [INFO ] [MAIN ] Derivative Progress: 636/2211 symbols completed. EAF took 1.2s. Estimated remaining: 11m 1s. Rate: 142.9 symbols/min [2025-09-29T02:14:24.038427] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:24.052248] [DEBUG] [LOCAL ] EARN: Loaded 30576 existing records from primary storage. [2025-09-29T02:14:24.052434] [INFO ] [MAIN ] EARN: Loaded 30576 primary data records. [2025-09-29T02:14:24.272388] [DEBUG] [LOCAL ] EAT: Loaded 50542 existing records from primary storage. [2025-09-29T02:14:24.307432] [INFO ] [MAIN ] EAT: Loaded 50542 primary data records. [2025-09-29T02:14:24.320596] [DEBUG] [LOCAL ] EB: Loaded 38017 existing records from primary storage. [2025-09-29T02:14:24.470617] [INFO ] [MAIN ] EB: Loaded 38017 primary data records. [2025-09-29T02:14:25.172048] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:25.174784] [INFO ] [MAIN ] EARN: Generated 1820 derivative records from 30576 primary records. [2025-09-29T02:14:25.175127] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-29T02:14:25.196103] [DEBUG] [LOCAL ] EARN: Derivative data saved (1820 records). [2025-09-29T02:14:25.196325] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-29T02:14:25.199258] [INFO ] [MAIN ] Derivative Progress: 637/2211 symbols completed. EARN took 1.2s. Estimated remaining: 11m 3s. Rate: 142.5 symbols/min [2025-09-29T02:14:25.200032] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:25.215298] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:25.216539] [INFO ] [MAIN ] EAT: Generated 1820 derivative records from 50542 primary records. [2025-09-29T02:14:25.216794] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-29T02:14:25.252882] [DEBUG] [LOCAL ] EAT: Derivative data saved (1820 records). [2025-09-29T02:14:25.253296] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:25.258060] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-29T02:14:25.261714] [INFO ] [MAIN ] Derivative Progress: 638/2211 symbols completed. EAT took 1.3s. Estimated remaining: 11m 2s. Rate: 142.7 symbols/min [2025-09-29T02:14:25.262056] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:25.263174] [INFO ] [MAIN ] EB: Generated 1820 derivative records from 38017 primary records. [2025-09-29T02:14:25.264037] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-29T02:14:25.282016] [DEBUG] [LOCAL ] EBF: Loaded 19635 existing records from primary storage. [2025-09-29T02:14:25.287174] [INFO ] [MAIN ] EBF: Loaded 19635 primary data records. [2025-09-29T02:14:25.340982] [DEBUG] [LOCAL ] EB: Derivative data saved (1820 records). [2025-09-29T02:14:25.365504] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-29T02:14:25.387905] [INFO ] [MAIN ] Derivative Progress: 639/2211 symbols completed. EB took 1.3s. Estimated remaining: 11m 0s. Rate: 142.8 symbols/min [2025-09-29T02:14:25.394668] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:25.672095] [DEBUG] [LOCAL ] EBR: Loaded 43731 existing records from primary storage. [2025-09-29T02:14:25.672781] [INFO ] [MAIN ] EBR: Loaded 43731 primary data records. [2025-09-29T02:14:25.864492] [DEBUG] [LOCAL ] EBS: Loaded 47455 existing records from primary storage. [2025-09-29T02:14:25.920693] [INFO ] [MAIN ] EBS: Loaded 47455 primary data records. [2025-09-29T02:14:26.201716] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:26.224226] [INFO ] [MAIN ] EBF: Generated 1820 derivative records from 19635 primary records. [2025-09-29T02:14:26.236218] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-29T02:14:26.423790] [DEBUG] [LOCAL ] EBF: Derivative data saved (1820 records). [2025-09-29T02:14:26.426868] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-29T02:14:26.430415] [INFO ] [MAIN ] Derivative Progress: 640/2211 symbols completed. EBF took 1.2s. Estimated remaining: 11m 2s. Rate: 142.5 symbols/min [2025-09-29T02:14:26.431309] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:26.446517] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:26.449926] [INFO ] [MAIN ] EBR: Generated 1820 derivative records from 43731 primary records. [2025-09-29T02:14:26.450150] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-29T02:14:26.471243] [DEBUG] [LOCAL ] EBR: Derivative data saved (1820 records). [2025-09-29T02:14:26.471574] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-29T02:14:26.474626] [INFO ] [MAIN ] Derivative Progress: 641/2211 symbols completed. EBR took 1.2s. Estimated remaining: 11m 0s. Rate: 142.7 symbols/min [2025-09-29T02:14:26.475401] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:26.494846] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:26.495723] [INFO ] [MAIN ] EBS: Generated 1820 derivative records from 47455 primary records. [2025-09-29T02:14:26.495851] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-29T02:14:26.524990] [DEBUG] [LOCAL ] EBS: Derivative data saved (1820 records). [2025-09-29T02:14:26.525150] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-29T02:14:26.528876] [INFO ] [MAIN ] Derivative Progress: 642/2211 symbols completed. EBS took 1.1s. Estimated remaining: 10m 59s. Rate: 142.9 symbols/min [2025-09-29T02:14:26.536949] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:26.574031] [DEBUG] [LOCAL ] EC: Loaded 50056 existing records from primary storage. [2025-09-29T02:14:26.575066] [DEBUG] [LOCAL ] ECAT: Loaded 30092 existing records from primary storage. [2025-09-29T02:14:26.575434] [INFO ] [MAIN ] ECAT: Loaded 30092 primary data records. [2025-09-29T02:14:26.575515] [INFO ] [MAIN ] EC: Loaded 50056 primary data records. [2025-09-29T02:14:27.291072] [DEBUG] [LOCAL ] ECC: Loaded 44025 existing records from primary storage. [2025-09-29T02:14:27.305411] [INFO ] [MAIN ] ECC: Loaded 44025 primary data records. [2025-09-29T02:14:27.666902] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:27.681858] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:27.682815] [INFO ] [MAIN ] ECAT: Generated 1820 derivative records from 30092 primary records. [2025-09-29T02:14:27.683075] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-29T02:14:27.683714] [INFO ] [MAIN ] EC: Generated 1820 derivative records from 50056 primary records. [2025-09-29T02:14:27.683991] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-29T02:14:27.717059] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1820 records). [2025-09-29T02:14:27.719537] [DEBUG] [LOCAL ] EC: Derivative data saved (1820 records). [2025-09-29T02:14:27.719867] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-29T02:14:27.719994] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-29T02:14:27.722759] [INFO ] [MAIN ] Derivative Progress: 643/2211 symbols completed. ECAT took 1.2s. Estimated remaining: 11m 0s. Rate: 142.5 symbols/min [2025-09-29T02:14:27.726995] [INFO ] [MAIN ] Derivative Progress: 644/2211 symbols completed. EC took 1.3s. Estimated remaining: 10m 59s. Rate: 142.7 symbols/min [2025-09-29T02:14:27.745348] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:27.746147] [INFO ] [MAIN ] ECC: Generated 1820 derivative records from 44025 primary records. [2025-09-29T02:14:27.746239] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-29T02:14:27.761790] [DEBUG] [LOCAL ] ECC: Derivative data saved (1820 records). [2025-09-29T02:14:27.761884] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-29T02:14:27.764536] [INFO ] [MAIN ] Derivative Progress: 645/2211 symbols completed. ECC took 1.2s. Estimated remaining: 10m 58s. Rate: 142.9 symbols/min [2025-09-29T02:14:27.765215] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:27.765346] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:27.765721] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:27.800559] [DEBUG] [LOCAL ] ECO: Loaded 18768 existing records from primary storage. [2025-09-29T02:14:27.800952] [INFO ] [MAIN ] ECO: Loaded 18768 primary data records. [2025-09-29T02:14:27.934542] [DEBUG] [LOCAL ] ECG: Loaded 34619 existing records from primary storage. [2025-09-29T02:14:27.966575] [INFO ] [MAIN ] ECG: Loaded 34619 primary data records. [2025-09-29T02:14:28.281162] [DEBUG] [LOCAL ] ECL: Loaded 47489 existing records from primary storage. [2025-09-29T02:14:28.286870] [INFO ] [MAIN ] ECL: Loaded 47489 primary data records. [2025-09-29T02:14:28.891664] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:28.894583] [INFO ] [MAIN ] ECO: Generated 1820 derivative records from 18768 primary records. [2025-09-29T02:14:28.895312] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-29T02:14:28.914268] [DEBUG] [LOCAL ] ECO: Derivative data saved (1820 records). [2025-09-29T02:14:28.914469] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-29T02:14:28.917333] [INFO ] [MAIN ] Derivative Progress: 646/2211 symbols completed. ECO took 1.2s. Estimated remaining: 10m 59s. Rate: 142.5 symbols/min [2025-09-29T02:14:28.918533] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:28.942073] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:28.963754] [INFO ] [MAIN ] ECG: Generated 1820 derivative records from 34619 primary records. [2025-09-29T02:14:28.964873] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-29T02:14:28.965153] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:28.966455] [INFO ] [MAIN ] ECL: Generated 1820 derivative records from 47489 primary records. [2025-09-29T02:14:28.967473] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-29T02:14:29.005875] [DEBUG] [LOCAL ] ECG: Derivative data saved (1820 records). [2025-09-29T02:14:29.021421] [DEBUG] [LOCAL ] ECL: Derivative data saved (1820 records). [2025-09-29T02:14:29.021871] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-29T02:14:29.021512] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-29T02:14:29.024950] [INFO ] [MAIN ] Derivative Progress: 647/2211 symbols completed. ECL took 1.3s. Estimated remaining: 10m 58s. Rate: 142.7 symbols/min [2025-09-29T02:14:29.028874] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:29.029128] [INFO ] [MAIN ] Derivative Progress: 648/2211 symbols completed. ECG took 1.3s. Estimated remaining: 10m 56s. Rate: 142.9 symbols/min [2025-09-29T02:14:29.029681] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:29.047103] [DEBUG] [LOCAL ] ECVT: Loaded 43587 existing records from primary storage. [2025-09-29T02:14:29.047395] [INFO ] [MAIN ] ECVT: Loaded 43587 primary data records. [2025-09-29T02:14:29.234909] [DEBUG] [LOCAL ] EDD: Loaded 27470 existing records from primary storage. [2025-09-29T02:14:29.267146] [INFO ] [MAIN ] EDD: Loaded 27470 primary data records. [2025-09-29T02:14:29.561346] [DEBUG] [LOCAL ] ED: Loaded 53539 existing records from primary storage. [2025-09-29T02:14:29.578482] [INFO ] [MAIN ] ED: Loaded 53539 primary data records. [2025-09-29T02:14:30.172128] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:30.173354] [INFO ] [MAIN ] ECVT: Generated 1820 derivative records from 43587 primary records. [2025-09-29T02:14:30.173853] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-29T02:14:30.194548] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1820 records). [2025-09-29T02:14:30.194913] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-29T02:14:30.199018] [INFO ] [MAIN ] Derivative Progress: 649/2211 symbols completed. ECVT took 1.3s. Estimated remaining: 10m 58s. Rate: 142.5 symbols/min [2025-09-29T02:14:30.199820] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:30.221002] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:30.222464] [INFO ] [MAIN ] EDD: Generated 1820 derivative records from 27470 primary records. [2025-09-29T02:14:30.222772] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-29T02:14:30.247022] [DEBUG] [LOCAL ] EDD: Derivative data saved (1820 records). [2025-09-29T02:14:30.247704] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-29T02:14:30.251225] [INFO ] [MAIN ] Derivative Progress: 650/2211 symbols completed. EDD took 1.2s. Estimated remaining: 10m 56s. Rate: 142.7 symbols/min [2025-09-29T02:14:30.251504] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:30.272448] [DEBUG] [LOCAL ] EDF: Loaded 13627 existing records from primary storage. [2025-09-29T02:14:30.273548] [INFO ] [MAIN ] EDF: Loaded 13627 primary data records. [2025-09-29T02:14:30.273317] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:30.274676] [INFO ] [MAIN ] ED: Generated 1820 derivative records from 53539 primary records. [2025-09-29T02:14:30.296736] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-29T02:14:30.414963] [DEBUG] [LOCAL ] ED: Derivative data saved (1820 records). [2025-09-29T02:14:30.465413] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-29T02:14:30.475924] [DEBUG] [LOCAL ] EDN: Loaded 18501 existing records from primary storage. [2025-09-29T02:14:30.507944] [INFO ] [MAIN ] EDN: Loaded 18501 primary data records. [2025-09-29T02:14:30.483932] [INFO ] [MAIN ] Derivative Progress: 651/2211 symbols completed. ED took 1.5s. Estimated remaining: 10m 55s. Rate: 142.8 symbols/min [2025-09-29T02:14:30.519633] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:31.028224] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:31.029718] [INFO ] [MAIN ] EDF: Generated 1820 derivative records from 13627 primary records. [2025-09-29T02:14:31.031200] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-29T02:14:31.030778] [DEBUG] [LOCAL ] EDU: Loaded 45666 existing records from primary storage. [2025-09-29T02:14:31.031522] [INFO ] [MAIN ] EDU: Loaded 45666 primary data records. [2025-09-29T02:14:31.101924] [DEBUG] [LOCAL ] EDF: Derivative data saved (1820 records). [2025-09-29T02:14:31.138169] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-29T02:14:31.168592] [INFO ] [MAIN ] Derivative Progress: 652/2211 symbols completed. EDF took 1.0s. Estimated remaining: 10m 56s. Rate: 142.7 symbols/min [2025-09-29T02:14:31.185196] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:31.244038] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:31.270500] [INFO ] [MAIN ] EDN: Generated 1820 derivative records from 18501 primary records. [2025-09-29T02:14:31.270878] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-29T02:14:31.456761] [DEBUG] [LOCAL ] EDN: Derivative data saved (1820 records). [2025-09-29T02:14:31.457951] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-29T02:14:31.460869] [INFO ] [MAIN ] Derivative Progress: 653/2211 symbols completed. EDN took 1.2s. Estimated remaining: 10m 55s. Rate: 142.7 symbols/min [2025-09-29T02:14:31.461581] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:31.498087] [DEBUG] [LOCAL ] EEX: Loaded 12042 existing records from primary storage. [2025-09-29T02:14:31.499090] [DEBUG] [LOCAL ] EE: Loaded 32973 existing records from primary storage. [2025-09-29T02:14:31.499378] [INFO ] [MAIN ] EEX: Loaded 12042 primary data records. [2025-09-29T02:14:31.499742] [INFO ] [MAIN ] EE: Loaded 32973 primary data records. [2025-09-29T02:14:31.536198] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:31.584421] [INFO ] [MAIN ] EDU: Generated 1820 derivative records from 45666 primary records. [2025-09-29T02:14:31.684319] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-29T02:14:32.178325] [DEBUG] [LOCAL ] EDU: Derivative data saved (1820 records). [2025-09-29T02:14:32.193779] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-29T02:14:32.197401] [INFO ] [MAIN ] Derivative Progress: 654/2211 symbols completed. EDU took 1.7s. Estimated remaining: 10m 55s. Rate: 142.6 symbols/min [2025-09-29T02:14:32.198263] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:32.224484] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:32.225718] [INFO ] [MAIN ] EE: Generated 1820 derivative records from 32973 primary records. [2025-09-29T02:14:32.225815] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-29T02:14:32.246544] [DEBUG] [LOCAL ] EE: Derivative data saved (1820 records). [2025-09-29T02:14:32.248781] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-29T02:14:32.251747] [INFO ] [MAIN ] Derivative Progress: 655/2211 symbols completed. EE took 1.1s. Estimated remaining: 10m 54s. Rate: 142.7 symbols/min [2025-09-29T02:14:32.251968] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:32.267403] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:32.268929] [INFO ] [MAIN ] EEX: Generated 1820 derivative records from 12042 primary records. [2025-09-29T02:14:32.269184] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-29T02:14:32.308757] [DEBUG] [LOCAL ] EFR: Loaded 14474 existing records from primary storage. [2025-09-29T02:14:32.310552] [DEBUG] [LOCAL ] EEX: Derivative data saved (1820 records). [2025-09-29T02:14:32.310612] [INFO ] [MAIN ] EFR: Loaded 14474 primary data records. [2025-09-29T02:14:32.310936] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-29T02:14:32.367343] [INFO ] [MAIN ] Derivative Progress: 656/2211 symbols completed. EEX took 0.9s. Estimated remaining: 10m 53s. Rate: 142.9 symbols/min [2025-09-29T02:14:32.440957] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:32.442239] [DEBUG] [LOCAL ] EFC: Loaded 46944 existing records from primary storage. [2025-09-29T02:14:32.448785] [INFO ] [MAIN ] EFC: Loaded 46944 primary data records. [2025-09-29T02:14:32.783781] [DEBUG] [LOCAL ] EFT: Loaded 12857 existing records from primary storage. [2025-09-29T02:14:32.784312] [INFO ] [MAIN ] EFT: Loaded 12857 primary data records. [2025-09-29T02:14:33.404714] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:33.406553] [INFO ] [MAIN ] EFR: Generated 1820 derivative records from 14474 primary records. [2025-09-29T02:14:33.406850] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-29T02:14:33.442096] [DEBUG] [LOCAL ] EFR: Derivative data saved (1820 records). [2025-09-29T02:14:33.442969] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-29T02:14:33.442446] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:33.446727] [INFO ] [MAIN ] EFC: Generated 1820 derivative records from 46944 primary records. [2025-09-29T02:14:33.446871] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-29T02:14:33.445661] [INFO ] [MAIN ] Derivative Progress: 657/2211 symbols completed. EFR took 1.2s. Estimated remaining: 10m 54s. Rate: 142.6 symbols/min [2025-09-29T02:14:33.447882] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:33.466076] [DEBUG] [LOCAL ] EFC: Derivative data saved (1820 records). [2025-09-29T02:14:33.466501] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-29T02:14:33.471743] [INFO ] [MAIN ] Derivative Progress: 658/2211 symbols completed. EFC took 1.3s. Estimated remaining: 10m 53s. Rate: 142.8 symbols/min [2025-09-29T02:14:33.486898] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:33.487878] [INFO ] [MAIN ] EFT: Generated 1820 derivative records from 12857 primary records. [2025-09-29T02:14:33.487970] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-29T02:14:33.506259] [DEBUG] [LOCAL ] EFT: Derivative data saved (1820 records). [2025-09-29T02:14:33.506436] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-29T02:14:33.509898] [INFO ] [MAIN ] Derivative Progress: 659/2211 symbols completed. EFT took 1.1s. Estimated remaining: 10m 51s. Rate: 143.0 symbols/min [2025-09-29T02:14:33.545997] [DEBUG] [LOCAL ] EFX: Loaded 45419 existing records from primary storage. [2025-09-29T02:14:33.546176] [INFO ] [MAIN ] EFX: Loaded 45419 primary data records. [2025-09-29T02:14:33.894941] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:33.895805] [INFO ] [MAIN ] EFX: Generated 1820 derivative records from 45419 primary records. [2025-09-29T02:14:33.895899] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-29T02:14:33.912594] [DEBUG] [LOCAL ] EFX: Derivative data saved (1820 records). [2025-09-29T02:14:33.912790] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-29T02:14:33.915282] [INFO ] [MAIN ] Derivative Progress: 660/2211 symbols completed. EFX took 0.5s. Estimated remaining: 10m 51s. Rate: 143.0 symbols/min [2025-09-29T02:14:33.915910] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:33.916043] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:33.916266] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:33.976148] [DEBUG] [LOCAL ] EFXT: Loaded 29755 existing records from primary storage. [2025-09-29T02:14:33.977131] [DEBUG] [LOCAL ] EG: Loaded 29024 existing records from primary storage. [2025-09-29T02:14:33.992798] [INFO ] [MAIN ] EFXT: Loaded 29755 primary data records. [2025-09-29T02:14:33.992727] [INFO ] [MAIN ] EG: Loaded 29024 primary data records. [2025-09-29T02:14:34.274286] [DEBUG] [LOCAL ] EGO: Loaded 52295 existing records from primary storage. [2025-09-29T02:14:34.356266] [INFO ] [MAIN ] EGO: Loaded 52295 primary data records. [2025-09-29T02:14:35.078046] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:35.081721] [INFO ] [MAIN ] EFXT: Generated 1820 derivative records from 29755 primary records. [2025-09-29T02:14:35.082179] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-29T02:14:35.105342] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:35.114361] [INFO ] [MAIN ] EG: Generated 1820 derivative records from 29024 primary records. [2025-09-29T02:14:35.115581] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1820 records). [2025-09-29T02:14:35.115848] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-29T02:14:35.116164] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-29T02:14:35.120015] [INFO ] [MAIN ] Derivative Progress: 661/2211 symbols completed. EFXT took 1.2s. Estimated remaining: 10m 52s. Rate: 142.6 symbols/min [2025-09-29T02:14:35.121050] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:35.141320] [DEBUG] [LOCAL ] EG: Derivative data saved (1820 records). [2025-09-29T02:14:35.141734] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-29T02:14:35.145174] [INFO ] [MAIN ] Derivative Progress: 662/2211 symbols completed. EG took 1.2s. Estimated remaining: 10m 51s. Rate: 142.8 symbols/min [2025-09-29T02:14:35.145585] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:35.160801] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:35.162259] [INFO ] [MAIN ] EGO: Generated 1820 derivative records from 52295 primary records. [2025-09-29T02:14:35.162622] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-29T02:14:35.182995] [DEBUG] [LOCAL ] EGO: Derivative data saved (1820 records). [2025-09-29T02:14:35.183156] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-29T02:14:35.187102] [INFO ] [MAIN ] Derivative Progress: 663/2211 symbols completed. EGO took 1.3s. Estimated remaining: 10m 50s. Rate: 143.0 symbols/min [2025-09-29T02:14:35.196708] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:35.212366] [DEBUG] [LOCAL ] EGP: Loaded 31536 existing records from primary storage. [2025-09-29T02:14:35.212542] [INFO ] [MAIN ] EGP: Loaded 31536 primary data records. [2025-09-29T02:14:35.416491] [DEBUG] [LOCAL ] EGY: Loaded 42824 existing records from primary storage. [2025-09-29T02:14:35.449699] [INFO ] [MAIN ] EGY: Loaded 42824 primary data records. [2025-09-29T02:14:35.669986] [DEBUG] [LOCAL ] EHAB: Loaded 30257 existing records from primary storage. [2025-09-29T02:14:35.702412] [INFO ] [MAIN ] EHAB: Loaded 30257 primary data records. [2025-09-29T02:14:36.306865] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:36.309275] [INFO ] [MAIN ] EGP: Generated 1820 derivative records from 31536 primary records. [2025-09-29T02:14:36.309614] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-29T02:14:36.330943] [DEBUG] [LOCAL ] EGP: Derivative data saved (1820 records). [2025-09-29T02:14:36.331321] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-29T02:14:36.334859] [INFO ] [MAIN ] Derivative Progress: 664/2211 symbols completed. EGP took 1.2s. Estimated remaining: 10m 51s. Rate: 142.6 symbols/min [2025-09-29T02:14:36.335204] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:36.354179] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:36.355081] [INFO ] [MAIN ] EGY: Generated 1820 derivative records from 42824 primary records. [2025-09-29T02:14:36.355360] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-29T02:14:36.375569] [DEBUG] [LOCAL ] EGY: Derivative data saved (1820 records). [2025-09-29T02:14:36.379566] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-29T02:14:36.383153] [INFO ] [MAIN ] Derivative Progress: 665/2211 symbols completed. EGY took 1.2s. Estimated remaining: 10m 50s. Rate: 142.8 symbols/min [2025-09-29T02:14:36.383819] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:36.403826] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:36.415721] [INFO ] [MAIN ] EHAB: Generated 1820 derivative records from 30257 primary records. [2025-09-29T02:14:36.415863] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-29T02:14:36.435856] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1820 records). [2025-09-29T02:14:36.436972] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-29T02:14:36.454149] [INFO ] [MAIN ] Derivative Progress: 666/2211 symbols completed. EHAB took 1.3s. Estimated remaining: 10m 48s. Rate: 143.0 symbols/min [2025-09-29T02:14:36.461209] [DEBUG] [LOCAL ] EHC: Loaded 41849 existing records from primary storage. [2025-09-29T02:14:36.461383] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:36.459898] [DEBUG] [LOCAL ] EHI: Loaded 10472 existing records from primary storage. [2025-09-29T02:14:36.462181] [INFO ] [MAIN ] EHI: Loaded 10472 primary data records. [2025-09-29T02:14:36.462074] [INFO ] [MAIN ] EHC: Loaded 41849 primary data records. [2025-09-29T02:14:36.997145] [DEBUG] [LOCAL ] EIC: Loaded 24238 existing records from primary storage. [2025-09-29T02:14:37.140265] [INFO ] [MAIN ] EIC: Loaded 24238 primary data records. [2025-09-29T02:14:37.501772] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:37.503024] [INFO ] [MAIN ] EHI: Generated 1820 derivative records from 10472 primary records. [2025-09-29T02:14:37.503226] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-29T02:14:37.528669] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:37.535363] [INFO ] [MAIN ] EHC: Generated 1820 derivative records from 41849 primary records. [2025-09-29T02:14:37.535562] [DEBUG] [LOCAL ] EHI: Derivative data saved (1820 records). [2025-09-29T02:14:37.536033] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-29T02:14:37.538705] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-29T02:14:37.538576] [INFO ] [MAIN ] Derivative Progress: 667/2211 symbols completed. EHI took 1.2s. Estimated remaining: 10m 50s. Rate: 142.6 symbols/min [2025-09-29T02:14:37.540230] [INFO ] [MAIN ] EICC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:37.560208] [DEBUG] [LOCAL ] EHC: Derivative data saved (1820 records). [2025-09-29T02:14:37.560673] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-29T02:14:37.564488] [DEBUG] [LOCAL ] EICC: Loaded 6245 existing records from primary storage. [2025-09-29T02:14:37.568714] [INFO ] [MAIN ] EICC: Loaded 6245 primary data records. [2025-09-29T02:14:37.568547] [INFO ] [MAIN ] Derivative Progress: 668/2211 symbols completed. EHC took 1.2s. Estimated remaining: 10m 48s. Rate: 142.8 symbols/min [2025-09-29T02:14:37.569379] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:37.702883] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:37.708756] [INFO ] [MAIN ] EIC: Generated 1820 derivative records from 24238 primary records. [2025-09-29T02:14:37.708932] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-29T02:14:37.817814] [DEBUG] [LOCAL ] EIG: Loaded 20519 existing records from primary storage. [2025-09-29T02:14:37.819803] [DEBUG] [LOCAL ] EIC: Derivative data saved (1820 records). [2025-09-29T02:14:37.990517] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-29T02:14:37.993922] [INFO ] [MAIN ] Derivative Progress: 669/2211 symbols completed. EIC took 1.5s. Estimated remaining: 10m 48s. Rate: 142.8 symbols/min [2025-09-29T02:14:37.990628] [INFO ] [MAIN ] EIG: Loaded 20519 primary data records. [2025-09-29T02:14:37.994466] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:38.368791] [DEBUG] [MAIN ] EICC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:38.370247] [INFO ] [MAIN ] EICC: Generated 1820 derivative records from 6245 primary records. [2025-09-29T02:14:38.385805] [DEBUG] [LOCAL ] EICC: Saving derivative data. [2025-09-29T02:14:38.389043] [DEBUG] [LOCAL ] EIX: Loaded 54113 existing records from primary storage. [2025-09-29T02:14:38.389233] [INFO ] [MAIN ] EIX: Loaded 54113 primary data records. [2025-09-29T02:14:38.460253] [DEBUG] [LOCAL ] EICC: Derivative data saved (1820 records). [2025-09-29T02:14:38.485171] [INFO ] [MAIN ] EICC: Successfully saved derivative data. [2025-09-29T02:14:38.513238] [INFO ] [MAIN ] Derivative Progress: 670/2211 symbols completed. EICC took 1.0s. Estimated remaining: 10m 48s. Rate: 142.8 symbols/min [2025-09-29T02:14:38.525681] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:38.760333] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:38.762677] [INFO ] [MAIN ] EIG: Generated 1820 derivative records from 20519 primary records. [2025-09-29T02:14:38.763222] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-29T02:14:38.783061] [DEBUG] [LOCAL ] EIG: Derivative data saved (1820 records). [2025-09-29T02:14:38.783497] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-29T02:14:38.787058] [INFO ] [MAIN ] Derivative Progress: 671/2211 symbols completed. EIG took 1.2s. Estimated remaining: 10m 47s. Rate: 142.8 symbols/min [2025-09-29T02:14:38.787493] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:38.824286] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:38.825097] [INFO ] [MAIN ] EIX: Generated 1820 derivative records from 54113 primary records. [2025-09-29T02:14:38.825246] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-29T02:14:38.862131] [DEBUG] [LOCAL ] EIX: Derivative data saved (1820 records). [2025-09-29T02:14:38.863881] [DEBUG] [LOCAL ] EL: Loaded 54177 existing records from primary storage. [2025-09-29T02:14:38.864258] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-29T02:14:38.864476] [INFO ] [MAIN ] EL: Loaded 54177 primary data records. [2025-09-29T02:14:38.868460] [INFO ] [MAIN ] Derivative Progress: 672/2211 symbols completed. EIX took 0.9s. Estimated remaining: 10m 46s. Rate: 143.0 symbols/min [2025-09-29T02:14:38.892447] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:39.003488] [DEBUG] [LOCAL ] ELC: Loaded 3512 existing records from primary storage. [2025-09-29T02:14:39.008738] [INFO ] [MAIN ] ELC: Loaded 3512 primary data records. [2025-09-29T02:14:39.229183] [DEBUG] [LOCAL ] ELAN: Loaded 53985 existing records from primary storage. [2025-09-29T02:14:39.365906] [INFO ] [MAIN ] ELAN: Loaded 53985 primary data records. [2025-09-29T02:14:39.995271] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:39.998706] [INFO ] [MAIN ] EL: Generated 1820 derivative records from 54177 primary records. [2025-09-29T02:14:39.999766] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-29T02:14:40.029096] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:40.034701] [DEBUG] [LOCAL ] EL: Derivative data saved (1820 records). [2025-09-29T02:14:40.035137] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-29T02:14:40.036541] [INFO ] [MAIN ] ELC: Generated 1820 derivative records from 3512 primary records. [2025-09-29T02:14:40.039904] [INFO ] [MAIN ] Derivative Progress: 673/2211 symbols completed. EL took 1.5s. Estimated remaining: 10m 47s. Rate: 142.6 symbols/min [2025-09-29T02:14:40.040861] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-29T02:14:40.059092] [DEBUG] [LOCAL ] ELC: Derivative data saved (1820 records). [2025-09-29T02:14:40.061448] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-29T02:14:40.065080] [INFO ] [MAIN ] Derivative Progress: 674/2211 symbols completed. ELC took 1.2s. Estimated remaining: 10m 46s. Rate: 142.8 symbols/min [2025-09-29T02:14:40.078566] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:40.079302] [INFO ] [MAIN ] ELAN: Generated 1820 derivative records from 53985 primary records. [2025-09-29T02:14:40.079390] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-29T02:14:40.095462] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1820 records). [2025-09-29T02:14:40.095557] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-29T02:14:40.099334] [INFO ] [MAIN ] Derivative Progress: 675/2211 symbols completed. ELAN took 1.3s. Estimated remaining: 10m 44s. Rate: 143.0 symbols/min [2025-09-29T02:14:40.099960] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:40.099856] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:40.100105] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:40.132634] [DEBUG] [LOCAL ] ELP: Loaded 26107 existing records from primary storage. [2025-09-29T02:14:40.132838] [INFO ] [MAIN ] ELP: Loaded 26107 primary data records. [2025-09-29T02:14:40.288664] [DEBUG] [LOCAL ] ELME: Loaded 39817 existing records from primary storage. [2025-09-29T02:14:40.348085] [INFO ] [MAIN ] ELME: Loaded 39817 primary data records. [2025-09-29T02:14:40.534189] [DEBUG] [LOCAL ] ELF: Loaded 53037 existing records from primary storage. [2025-09-29T02:14:40.566033] [INFO ] [MAIN ] ELF: Loaded 53037 primary data records. [2025-09-29T02:14:41.236308] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:41.237584] [INFO ] [MAIN ] ELP: Generated 1820 derivative records from 26107 primary records. [2025-09-29T02:14:41.237830] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-29T02:14:41.259158] [DEBUG] [LOCAL ] ELP: Derivative data saved (1820 records). [2025-09-29T02:14:41.260140] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-29T02:14:41.263301] [INFO ] [MAIN ] Derivative Progress: 676/2211 symbols completed. ELP took 1.2s. Estimated remaining: 10m 46s. Rate: 142.7 symbols/min [2025-09-29T02:14:41.264252] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:41.290197] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:41.291303] [INFO ] [MAIN ] ELF: Generated 1820 derivative records from 53037 primary records. [2025-09-29T02:14:41.291406] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-29T02:14:41.307430] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:41.320477] [INFO ] [MAIN ] ELME: Generated 1820 derivative records from 39817 primary records. [2025-09-29T02:14:41.321977] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-29T02:14:41.326024] [DEBUG] [LOCAL ] ELF: Derivative data saved (1820 records). [2025-09-29T02:14:41.326434] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-29T02:14:41.337254] [INFO ] [MAIN ] Derivative Progress: 677/2211 symbols completed. ELF took 1.2s. Estimated remaining: 10m 44s. Rate: 142.8 symbols/min [2025-09-29T02:14:41.342851] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:41.347340] [DEBUG] [LOCAL ] ELME: Derivative data saved (1820 records). [2025-09-29T02:14:41.348004] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-29T02:14:41.350847] [INFO ] [MAIN ] Derivative Progress: 678/2211 symbols completed. ELME took 1.3s. Estimated remaining: 10m 43s. Rate: 143.0 symbols/min [2025-09-29T02:14:41.351308] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:41.390618] [DEBUG] [LOCAL ] ELS: Loaded 50110 existing records from primary storage. [2025-09-29T02:14:41.391121] [INFO ] [MAIN ] ELS: Loaded 50110 primary data records. [2025-09-29T02:14:41.524530] [DEBUG] [LOCAL ] EMD: Loaded 21338 existing records from primary storage. [2025-09-29T02:14:41.540503] [INFO ] [MAIN ] EMD: Loaded 21338 primary data records. [2025-09-29T02:14:41.759909] [DEBUG] [LOCAL ] ELV: Loaded 51334 existing records from primary storage. [2025-09-29T02:14:41.774450] [INFO ] [MAIN ] ELV: Loaded 51334 primary data records. [2025-09-29T02:14:42.554583] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:42.556104] [INFO ] [MAIN ] ELS: Generated 1820 derivative records from 50110 primary records. [2025-09-29T02:14:42.564309] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-29T02:14:42.571668] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:42.581002] [INFO ] [MAIN ] EMD: Generated 1820 derivative records from 21338 primary records. [2025-09-29T02:14:42.589719] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-29T02:14:42.590503] [DEBUG] [LOCAL ] ELS: Derivative data saved (1820 records). [2025-09-29T02:14:42.592374] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-29T02:14:42.603019] [INFO ] [MAIN ] Derivative Progress: 679/2211 symbols completed. ELS took 1.3s. Estimated remaining: 10m 45s. Rate: 142.6 symbols/min [2025-09-29T02:14:42.608508] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:42.617455] [DEBUG] [LOCAL ] EMD: Derivative data saved (1820 records). [2025-09-29T02:14:42.617802] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-29T02:14:42.634798] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:42.629096] [INFO ] [MAIN ] Derivative Progress: 680/2211 symbols completed. EMD took 1.3s. Estimated remaining: 10m 43s. Rate: 142.8 symbols/min [2025-09-29T02:14:42.635030] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:42.635919] [INFO ] [MAIN ] ELV: Generated 1820 derivative records from 51334 primary records. [2025-09-29T02:14:42.636197] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-29T02:14:42.656155] [DEBUG] [LOCAL ] ELV: Derivative data saved (1820 records). [2025-09-29T02:14:42.656564] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-29T02:14:42.660122] [INFO ] [MAIN ] Derivative Progress: 681/2211 symbols completed. ELV took 1.3s. Estimated remaining: 10m 42s. Rate: 143.0 symbols/min [2025-09-29T02:14:42.663684] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:42.664037] [DEBUG] [LOCAL ] EMF: Loaded 3575 existing records from primary storage. [2025-09-29T02:14:42.665080] [INFO ] [MAIN ] EMF: Loaded 3575 primary data records. [2025-09-29T02:14:42.807569] [DEBUG] [LOCAL ] EME: Loaded 32035 existing records from primary storage. [2025-09-29T02:14:42.807890] [INFO ] [MAIN ] EME: Loaded 32035 primary data records. [2025-09-29T02:14:43.273063] [DEBUG] [LOCAL ] EMN: Loaded 51117 existing records from primary storage. [2025-09-29T02:14:43.273888] [INFO ] [MAIN ] EMN: Loaded 51117 primary data records. [2025-09-29T02:14:43.762473] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:43.765213] [INFO ] [MAIN ] EMF: Generated 1820 derivative records from 3575 primary records. [2025-09-29T02:14:43.766297] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-29T02:14:43.781968] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:43.783314] [INFO ] [MAIN ] EME: Generated 1820 derivative records from 32035 primary records. [2025-09-29T02:14:43.784095] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-29T02:14:43.807891] [DEBUG] [LOCAL ] EMF: Derivative data saved (1820 records). [2025-09-29T02:14:43.810952] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-29T02:14:43.818813] [DEBUG] [LOCAL ] EME: Derivative data saved (1820 records). [2025-09-29T02:14:43.819008] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-29T02:14:43.817981] [INFO ] [MAIN ] Derivative Progress: 682/2211 symbols completed. EMF took 1.2s. Estimated remaining: 10m 43s. Rate: 142.6 symbols/min [2025-09-29T02:14:43.819308] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:43.822784] [INFO ] [MAIN ] Derivative Progress: 683/2211 symbols completed. EME took 1.2s. Estimated remaining: 10m 42s. Rate: 142.8 symbols/min [2025-09-29T02:14:43.823463] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:43.833046] [DEBUG] [LOCAL ] EMP: Loaded 3062 existing records from primary storage. [2025-09-29T02:14:43.846272] [INFO ] [MAIN ] EMP: Loaded 3062 primary data records. [2025-09-29T02:14:43.888368] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:43.930727] [INFO ] [MAIN ] EMN: Generated 1820 derivative records from 51117 primary records. [2025-09-29T02:14:43.953279] [DEBUG] [LOCAL ] EMO: Loaded 12656 existing records from primary storage. [2025-09-29T02:14:43.953383] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-29T02:14:43.966229] [INFO ] [MAIN ] EMO: Loaded 12656 primary data records. [2025-09-29T02:14:44.154380] [DEBUG] [LOCAL ] EMN: Derivative data saved (1820 records). [2025-09-29T02:14:44.339500] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-29T02:14:44.360484] [INFO ] [MAIN ] Derivative Progress: 684/2211 symbols completed. EMN took 1.7s. Estimated remaining: 10m 42s. Rate: 142.8 symbols/min [2025-09-29T02:14:44.382032] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:44.621745] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:14:44.638297] [INFO ] [MAIN ] EMP: Generated 1819 derivative records from 3062 primary records. [2025-09-29T02:14:44.638525] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-29T02:14:44.655826] [DEBUG] [LOCAL ] EMP: Derivative data saved (1819 records). [2025-09-29T02:14:44.657965] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-29T02:14:44.660668] [INFO ] [MAIN ] Derivative Progress: 685/2211 symbols completed. EMP took 0.8s. Estimated remaining: 10m 41s. Rate: 142.8 symbols/min [2025-09-29T02:14:44.662801] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:44.691898] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:44.694361] [INFO ] [MAIN ] EMO: Generated 1820 derivative records from 12656 primary records. [2025-09-29T02:14:44.694716] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-29T02:14:44.697289] [DEBUG] [LOCAL ] EMR: Loaded 54027 existing records from primary storage. [2025-09-29T02:14:44.697874] [INFO ] [MAIN ] EMR: Loaded 54027 primary data records. [2025-09-29T02:14:44.762460] [DEBUG] [LOCAL ] EMO: Derivative data saved (1820 records). [2025-09-29T02:14:44.785760] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-29T02:14:44.795111] [INFO ] [MAIN ] Derivative Progress: 686/2211 symbols completed. EMO took 1.0s. Estimated remaining: 10m 40s. Rate: 143.0 symbols/min [2025-09-29T02:14:44.808283] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:44.860915] [DEBUG] [LOCAL ] ENFY: Loaded 3106 existing records from primary storage. [2025-09-29T02:14:44.902113] [INFO ] [MAIN ] ENFY: Loaded 3106 primary data records. [2025-09-29T02:14:45.223773] [DEBUG] [LOCAL ] ENB: Loaded 54295 existing records from primary storage. [2025-09-29T02:14:45.246222] [INFO ] [MAIN ] ENB: Loaded 54295 primary data records. [2025-09-29T02:14:45.801132] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:14:45.804075] [INFO ] [MAIN ] EMR: Generated 1819 derivative records from 54027 primary records. [2025-09-29T02:14:45.804556] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-29T02:14:45.824192] [DEBUG] [LOCAL ] EMR: Derivative data saved (1819 records). [2025-09-29T02:14:45.827095] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-29T02:14:45.832506] [INFO ] [MAIN ] Derivative Progress: 687/2211 symbols completed. EMR took 1.5s. Estimated remaining: 10m 41s. Rate: 142.7 symbols/min [2025-09-29T02:14:45.833307] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:45.848395] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:45.850428] [INFO ] [MAIN ] ENFY: Generated 1820 derivative records from 3106 primary records. [2025-09-29T02:14:45.850765] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-29T02:14:45.868986] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1820 records). [2025-09-29T02:14:45.869151] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-29T02:14:45.871312] [INFO ] [MAIN ] Derivative Progress: 688/2211 symbols completed. ENFY took 1.1s. Estimated remaining: 10m 40s. Rate: 142.9 symbols/min [2025-09-29T02:14:45.885803] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:45.886677] [INFO ] [MAIN ] ENB: Generated 1820 derivative records from 54295 primary records. [2025-09-29T02:14:45.886767] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-29T02:14:45.913515] [DEBUG] [LOCAL ] ENB: Derivative data saved (1820 records). [2025-09-29T02:14:45.924276] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-29T02:14:45.928174] [INFO ] [MAIN ] Derivative Progress: 689/2211 symbols completed. ENB took 1.3s. Estimated remaining: 10m 38s. Rate: 143.1 symbols/min [2025-09-29T02:14:45.929611] [DEBUG] [LOCAL ] ENIC: Loaded 36910 existing records from primary storage. [2025-09-29T02:14:45.929806] [INFO ] [MAIN ] ENIC: Loaded 36910 primary data records. [2025-09-29T02:14:46.282409] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:46.283208] [INFO ] [MAIN ] ENIC: Generated 1820 derivative records from 36910 primary records. [2025-09-29T02:14:46.283310] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-29T02:14:46.299615] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1820 records). [2025-09-29T02:14:46.299792] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-29T02:14:46.302598] [INFO ] [MAIN ] Derivative Progress: 690/2211 symbols completed. ENIC took 0.5s. Estimated remaining: 10m 38s. Rate: 143.1 symbols/min [2025-09-29T02:14:46.303414] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:46.303294] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:46.303580] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:46.309532] [DEBUG] [LOCAL ] ENO: Loaded 1952 existing records from primary storage. [2025-09-29T02:14:46.309796] [INFO ] [MAIN ] ENO: Loaded 1952 primary data records. [2025-09-29T02:14:46.754187] [DEBUG] [LOCAL ] ENR: Loaded 43336 existing records from primary storage. [2025-09-29T02:14:46.788567] [INFO ] [MAIN ] ENR: Loaded 43336 primary data records. [2025-09-29T02:14:46.826256] [DEBUG] [LOCAL ] ENOV: Loaded 45799 existing records from primary storage. [2025-09-29T02:14:46.841102] [INFO ] [MAIN ] ENOV: Loaded 45799 primary data records. [2025-09-29T02:14:47.508446] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:47.510488] [INFO ] [MAIN ] ENO: Generated 1820 derivative records from 1952 primary records. [2025-09-29T02:14:47.511242] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-29T02:14:47.530180] [DEBUG] [LOCAL ] ENO: Derivative data saved (1820 records). [2025-09-29T02:14:47.530377] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-29T02:14:47.533550] [INFO ] [MAIN ] Derivative Progress: 691/2211 symbols completed. ENO took 1.2s. Estimated remaining: 10m 39s. Rate: 142.7 symbols/min [2025-09-29T02:14:47.534527] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:47.553527] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:47.555743] [INFO ] [MAIN ] ENR: Generated 1820 derivative records from 43336 primary records. [2025-09-29T02:14:47.556005] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-29T02:14:47.594882] [DEBUG] [LOCAL ] ENR: Derivative data saved (1820 records). [2025-09-29T02:14:47.600473] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-29T02:14:47.602801] [INFO ] [MAIN ] Derivative Progress: 692/2211 symbols completed. ENR took 1.3s. Estimated remaining: 10m 38s. Rate: 142.8 symbols/min [2025-09-29T02:14:47.603279] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:47.603093] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:47.604778] [INFO ] [MAIN ] ENOV: Generated 1820 derivative records from 45799 primary records. [2025-09-29T02:14:47.605316] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-29T02:14:47.633793] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1820 records). [2025-09-29T02:14:47.634767] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-29T02:14:47.637497] [INFO ] [MAIN ] Derivative Progress: 693/2211 symbols completed. ENOV took 1.3s. Estimated remaining: 10m 37s. Rate: 143.0 symbols/min [2025-09-29T02:14:47.634438] [DEBUG] [LOCAL ] ENS: Loaded 29869 existing records from primary storage. [2025-09-29T02:14:47.637991] [INFO ] [MAIN ] ENS: Loaded 29869 primary data records. [2025-09-29T02:14:47.638108] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:47.787162] [DEBUG] [LOCAL ] EOD: Loaded 14232 existing records from primary storage. [2025-09-29T02:14:47.787493] [INFO ] [MAIN ] EOD: Loaded 14232 primary data records. [2025-09-29T02:14:47.788882] [DEBUG] [LOCAL ] ENVA: Loaded 25914 existing records from primary storage. [2025-09-29T02:14:47.789192] [INFO ] [MAIN ] ENVA: Loaded 25914 primary data records. [2025-09-29T02:14:48.782687] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:48.785335] [INFO ] [MAIN ] ENS: Generated 1820 derivative records from 29869 primary records. [2025-09-29T02:14:48.786009] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-29T02:14:48.808044] [DEBUG] [LOCAL ] ENS: Derivative data saved (1820 records). [2025-09-29T02:14:48.809947] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-29T02:14:48.814602] [INFO ] [MAIN ] Derivative Progress: 694/2211 symbols completed. ENS took 1.3s. Estimated remaining: 10m 38s. Rate: 142.7 symbols/min [2025-09-29T02:14:48.825383] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:48.831833] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:48.846406] [INFO ] [MAIN ] EOD: Generated 1820 derivative records from 14232 primary records. [2025-09-29T02:14:48.847525] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:48.848686] [INFO ] [MAIN ] ENVA: Generated 1820 derivative records from 25914 primary records. [2025-09-29T02:14:48.848808] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-29T02:14:48.847617] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-29T02:14:48.884249] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1820 records). [2025-09-29T02:14:48.884796] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-29T02:14:48.888020] [DEBUG] [LOCAL ] EOD: Derivative data saved (1820 records). [2025-09-29T02:14:48.891369] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-29T02:14:48.891022] [INFO ] [MAIN ] Derivative Progress: 695/2211 symbols completed. ENVA took 1.3s. Estimated remaining: 10m 37s. Rate: 142.8 symbols/min [2025-09-29T02:14:48.894244] [INFO ] [MAIN ] Derivative Progress: 696/2211 symbols completed. EOD took 1.3s. Estimated remaining: 10m 35s. Rate: 143.0 symbols/min [2025-09-29T02:14:48.894169] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:48.894918] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:48.915662] [DEBUG] [LOCAL ] EOI: Loaded 10783 existing records from primary storage. [2025-09-29T02:14:48.915988] [INFO ] [MAIN ] EOI: Loaded 10783 primary data records. [2025-09-29T02:14:48.997240] [DEBUG] [LOCAL ] EOS: Loaded 15589 existing records from primary storage. [2025-09-29T02:14:49.030137] [INFO ] [MAIN ] EOS: Loaded 15589 primary data records. [2025-09-29T02:14:49.137104] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-29T02:14:49.177940] [INFO ] [MAIN ] EOG: Loaded 54121 primary data records. [2025-09-29T02:14:50.075932] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:50.077968] [INFO ] [MAIN ] EOI: Generated 1820 derivative records from 10783 primary records. [2025-09-29T02:14:50.078341] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-29T02:14:50.113509] [DEBUG] [LOCAL ] EOI: Derivative data saved (1820 records). [2025-09-29T02:14:50.114576] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-29T02:14:50.118044] [INFO ] [MAIN ] Derivative Progress: 697/2211 symbols completed. EOI took 1.2s. Estimated remaining: 10m 37s. Rate: 142.6 symbols/min [2025-09-29T02:14:50.119294] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:50.118719] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:50.120886] [INFO ] [MAIN ] EOS: Generated 1820 derivative records from 15589 primary records. [2025-09-29T02:14:50.121756] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-29T02:14:50.143693] [DEBUG] [LOCAL ] EOS: Derivative data saved (1820 records). [2025-09-29T02:14:50.145689] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-29T02:14:50.153089] [INFO ] [MAIN ] Derivative Progress: 698/2211 symbols completed. EOS took 1.3s. Estimated remaining: 10m 36s. Rate: 142.8 symbols/min [2025-09-29T02:14:50.153310] [DEBUG] [LOCAL ] EOT: Loaded 6916 existing records from primary storage. [2025-09-29T02:14:50.167032] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:50.167609] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:50.168105] [INFO ] [MAIN ] EOT: Loaded 6916 primary data records. [2025-09-29T02:14:50.175014] [INFO ] [MAIN ] EOG: Generated 1820 derivative records from 54121 primary records. [2025-09-29T02:14:50.203760] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-29T02:14:50.324571] [DEBUG] [LOCAL ] EOG: Derivative data saved (1820 records). [2025-09-29T02:14:50.392633] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-29T02:14:50.406357] [DEBUG] [LOCAL ] EPAC: Loaded 27416 existing records from primary storage. [2025-09-29T02:14:50.405376] [INFO ] [MAIN ] Derivative Progress: 699/2211 symbols completed. EOG took 1.6s. Estimated remaining: 10m 35s. Rate: 142.9 symbols/min [2025-09-29T02:14:50.529154] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:50.529323] [INFO ] [MAIN ] EPAC: Loaded 27416 primary data records. [2025-09-29T02:14:50.932933] [DEBUG] [LOCAL ] EPAM: Loaded 40450 existing records from primary storage. [2025-09-29T02:14:50.934874] [INFO ] [MAIN ] EPAM: Loaded 40450 primary data records. [2025-09-29T02:14:50.973226] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:51.043463] [INFO ] [MAIN ] EOT: Generated 1820 derivative records from 6916 primary records. [2025-09-29T02:14:51.069121] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-29T02:14:51.173900] [DEBUG] [LOCAL ] EOT: Derivative data saved (1820 records). [2025-09-29T02:14:51.298519] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-29T02:14:51.302683] [INFO ] [MAIN ] Derivative Progress: 700/2211 symbols completed. EOT took 1.2s. Estimated remaining: 10m 35s. Rate: 142.7 symbols/min [2025-09-29T02:14:51.303295] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:51.325535] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:51.327242] [INFO ] [MAIN ] EPAC: Generated 1820 derivative records from 27416 primary records. [2025-09-29T02:14:51.327454] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-29T02:14:51.347418] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1820 records). [2025-09-29T02:14:51.347766] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-29T02:14:51.351296] [INFO ] [MAIN ] Derivative Progress: 701/2211 symbols completed. EPAC took 1.2s. Estimated remaining: 10m 34s. Rate: 142.9 symbols/min [2025-09-29T02:14:51.352063] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:51.383377] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:51.384333] [INFO ] [MAIN ] EPAM: Generated 1820 derivative records from 40450 primary records. [2025-09-29T02:14:51.396700] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-29T02:14:51.399306] [DEBUG] [LOCAL ] EPC: Loaded 40383 existing records from primary storage. [2025-09-29T02:14:51.399816] [INFO ] [MAIN ] EPC: Loaded 40383 primary data records. [2025-09-29T02:14:51.562609] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1820 records). [2025-09-29T02:14:51.588912] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-29T02:14:51.624945] [INFO ] [MAIN ] Derivative Progress: 702/2211 symbols completed. EPAM took 1.1s. Estimated remaining: 10m 33s. Rate: 142.9 symbols/min [2025-09-29T02:14:51.667372] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:51.802145] [DEBUG] [LOCAL ] EPD: Loaded 54389 existing records from primary storage. [2025-09-29T02:14:51.802574] [INFO ] [MAIN ] EPD: Loaded 54389 primary data records. [2025-09-29T02:14:52.192218] [DEBUG] [LOCAL ] EPR: Loaded 44722 existing records from primary storage. [2025-09-29T02:14:52.208543] [INFO ] [MAIN ] EPR: Loaded 44722 primary data records. [2025-09-29T02:14:52.209120] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:52.252266] [INFO ] [MAIN ] EPC: Generated 1820 derivative records from 40383 primary records. [2025-09-29T02:14:52.286149] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-29T02:14:52.435949] [DEBUG] [LOCAL ] EPC: Derivative data saved (1820 records). [2025-09-29T02:14:52.571623] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-29T02:14:52.575702] [INFO ] [MAIN ] Derivative Progress: 703/2211 symbols completed. EPC took 1.3s. Estimated remaining: 10m 34s. Rate: 142.7 symbols/min [2025-09-29T02:14:52.589575] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:52.591280] [INFO ] [MAIN ] EPD: Generated 1820 derivative records from 54389 primary records. [2025-09-29T02:14:52.591372] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-29T02:14:52.611051] [DEBUG] [LOCAL ] EPD: Derivative data saved (1820 records). [2025-09-29T02:14:52.611213] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-29T02:14:52.615166] [INFO ] [MAIN ] Derivative Progress: 704/2211 symbols completed. EPD took 1.3s. Estimated remaining: 10m 33s. Rate: 142.9 symbols/min [2025-09-29T02:14:52.635330] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:52.636073] [INFO ] [MAIN ] EPR: Generated 1820 derivative records from 44722 primary records. [2025-09-29T02:14:52.636177] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-29T02:14:52.651759] [DEBUG] [LOCAL ] EPR: Derivative data saved (1820 records). [2025-09-29T02:14:52.651910] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-29T02:14:52.654768] [INFO ] [MAIN ] Derivative Progress: 705/2211 symbols completed. EPR took 1.0s. Estimated remaining: 10m 32s. Rate: 143.0 symbols/min [2025-09-29T02:14:52.655239] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:52.655372] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:52.655957] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:52.672379] [DEBUG] [LOCAL ] EQBK: Loaded 11050 existing records from primary storage. [2025-09-29T02:14:52.673369] [INFO ] [MAIN ] EQBK: Loaded 11050 primary data records. [2025-09-29T02:14:53.114383] [DEBUG] [LOCAL ] EPRT: Loaded 49306 existing records from primary storage. [2025-09-29T02:14:53.114606] [INFO ] [MAIN ] EPRT: Loaded 49306 primary data records. [2025-09-29T02:14:53.115631] [DEBUG] [LOCAL ] EQH: Loaded 53435 existing records from primary storage. [2025-09-29T02:14:53.117029] [INFO ] [MAIN ] EQH: Loaded 53435 primary data records. [2025-09-29T02:14:53.815566] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:53.817530] [INFO ] [MAIN ] EQBK: Generated 1820 derivative records from 11050 primary records. [2025-09-29T02:14:53.819455] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-29T02:14:53.836900] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1820 records). [2025-09-29T02:14:53.838741] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-29T02:14:53.842105] [INFO ] [MAIN ] Derivative Progress: 706/2211 symbols completed. EQBK took 1.2s. Estimated remaining: 10m 33s. Rate: 142.7 symbols/min [2025-09-29T02:14:53.842563] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:53.861659] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:53.865526] [INFO ] [MAIN ] EPRT: Generated 1820 derivative records from 49306 primary records. [2025-09-29T02:14:53.865948] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-29T02:14:53.896021] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1820 records). [2025-09-29T02:14:53.896267] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:53.896700] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-29T02:14:53.897867] [INFO ] [MAIN ] EQH: Generated 1820 derivative records from 53435 primary records. [2025-09-29T02:14:53.901489] [INFO ] [MAIN ] Derivative Progress: 707/2211 symbols completed. EPRT took 1.2s. Estimated remaining: 10m 32s. Rate: 142.8 symbols/min [2025-09-29T02:14:53.901734] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-29T02:14:53.901909] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:53.924505] [DEBUG] [LOCAL ] EQH: Derivative data saved (1820 records). [2025-09-29T02:14:53.924725] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-29T02:14:53.927996] [INFO ] [MAIN ] Derivative Progress: 708/2211 symbols completed. EQH took 1.3s. Estimated remaining: 10m 30s. Rate: 143.0 symbols/min [2025-09-29T02:14:53.928329] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:54.009421] [DEBUG] [LOCAL ] EQNR: Loaded 53809 existing records from primary storage. [2025-09-29T02:14:54.010129] [INFO ] [MAIN ] EQNR: Loaded 53809 primary data records. [2025-09-29T02:14:54.030698] [DEBUG] [LOCAL ] EQR: Loaded 52190 existing records from primary storage. [2025-09-29T02:14:54.042418] [INFO ] [MAIN ] EQR: Loaded 52190 primary data records. [2025-09-29T02:14:54.307171] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-09-29T02:14:54.346195] [INFO ] [MAIN ] EQT: Loaded 54462 primary data records. [2025-09-29T02:14:55.096038] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:55.097856] [INFO ] [MAIN ] EQNR: Generated 1820 derivative records from 53809 primary records. [2025-09-29T02:14:55.098128] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-29T02:14:55.121137] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:55.126697] [INFO ] [MAIN ] EQR: Generated 1820 derivative records from 52190 primary records. [2025-09-29T02:14:55.131343] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-29T02:14:55.131494] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1820 records). [2025-09-29T02:14:55.133010] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-29T02:14:55.135974] [INFO ] [MAIN ] Derivative Progress: 709/2211 symbols completed. EQNR took 1.3s. Estimated remaining: 10m 32s. Rate: 142.7 symbols/min [2025-09-29T02:14:55.136265] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:55.163170] [DEBUG] [LOCAL ] EQV: Loaded 2840 existing records from primary storage. [2025-09-29T02:14:55.166097] [DEBUG] [LOCAL ] EQR: Derivative data saved (1820 records). [2025-09-29T02:14:55.166690] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-29T02:14:55.166471] [INFO ] [MAIN ] EQV: Loaded 2840 primary data records. [2025-09-29T02:14:55.170275] [INFO ] [MAIN ] Derivative Progress: 710/2211 symbols completed. EQR took 1.3s. Estimated remaining: 10m 30s. Rate: 142.8 symbols/min [2025-09-29T02:14:55.190677] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:55.236401] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:55.268260] [INFO ] [MAIN ] EQT: Generated 1820 derivative records from 54462 primary records. [2025-09-29T02:14:55.286675] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-29T02:14:55.380070] [DEBUG] [LOCAL ] EQT: Derivative data saved (1820 records). [2025-09-29T02:14:55.551202] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-29T02:14:55.563960] [INFO ] [MAIN ] Derivative Progress: 711/2211 symbols completed. EQT took 1.6s. Estimated remaining: 10m 30s. Rate: 142.9 symbols/min [2025-09-29T02:14:55.564773] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:55.642956] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:55.643314] [DEBUG] [LOCAL ] ERJ: Loaded 51477 existing records from primary storage. [2025-09-29T02:14:55.644421] [INFO ] [MAIN ] EQV: Generated 1820 derivative records from 2840 primary records. [2025-09-29T02:14:55.644737] [INFO ] [MAIN ] ERJ: Loaded 51477 primary data records. [2025-09-29T02:14:55.644980] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-29T02:14:55.771782] [DEBUG] [LOCAL ] EQV: Derivative data saved (1820 records). [2025-09-29T02:14:55.790765] [DEBUG] [LOCAL ] ERO: Loaded 41901 existing records from primary storage. [2025-09-29T02:14:55.801720] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-29T02:14:55.809952] [INFO ] [MAIN ] Derivative Progress: 712/2211 symbols completed. EQV took 0.7s. Estimated remaining: 10m 29s. Rate: 142.9 symbols/min [2025-09-29T02:14:55.810125] [INFO ] [MAIN ] ERO: Loaded 41901 primary data records. [2025-09-29T02:14:55.830905] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:56.401206] [DEBUG] [LOCAL ] ES: Loaded 53309 existing records from primary storage. [2025-09-29T02:14:56.402148] [INFO ] [MAIN ] ES: Loaded 53309 primary data records. [2025-09-29T02:14:56.570519] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:56.622042] [INFO ] [MAIN ] ERJ: Generated 1820 derivative records from 51477 primary records. [2025-09-29T02:14:56.628500] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-29T02:14:56.791951] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:56.792812] [INFO ] [MAIN ] ERO: Generated 1820 derivative records from 41901 primary records. [2025-09-29T02:14:56.793112] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-29T02:14:56.791082] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1820 records). [2025-09-29T02:14:56.794040] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-29T02:14:56.797329] [INFO ] [MAIN ] Derivative Progress: 713/2211 symbols completed. ERJ took 1.6s. Estimated remaining: 10m 30s. Rate: 142.7 symbols/min [2025-09-29T02:14:56.799060] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:56.817450] [DEBUG] [LOCAL ] ERO: Derivative data saved (1820 records). [2025-09-29T02:14:56.817783] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-29T02:14:56.820439] [INFO ] [MAIN ] Derivative Progress: 714/2211 symbols completed. ERO took 1.3s. Estimated remaining: 10m 29s. Rate: 142.9 symbols/min [2025-09-29T02:14:56.820896] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:56.850250] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:56.851174] [INFO ] [MAIN ] ES: Generated 1820 derivative records from 53309 primary records. [2025-09-29T02:14:56.855265] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-29T02:14:56.874082] [DEBUG] [LOCAL ] ESAB: Loaded 26683 existing records from primary storage. [2025-09-29T02:14:56.885903] [INFO ] [MAIN ] ESAB: Loaded 26683 primary data records. [2025-09-29T02:14:56.885796] [DEBUG] [LOCAL ] ESE: Loaded 16878 existing records from primary storage. [2025-09-29T02:14:56.898988] [INFO ] [MAIN ] ESE: Loaded 16878 primary data records. [2025-09-29T02:14:57.020761] [DEBUG] [LOCAL ] ES: Derivative data saved (1820 records). [2025-09-29T02:14:57.098163] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-29T02:14:57.150118] [INFO ] [MAIN ] Derivative Progress: 715/2211 symbols completed. ES took 1.3s. Estimated remaining: 10m 28s. Rate: 142.9 symbols/min [2025-09-29T02:14:57.167188] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:57.834438] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:57.835900] [INFO ] [MAIN ] ESAB: Generated 1820 derivative records from 26683 primary records. [2025-09-29T02:14:57.836129] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-29T02:14:57.887771] [DEBUG] [LOCAL ] ESI: Loaded 51566 existing records from primary storage. [2025-09-29T02:14:57.890163] [INFO ] [MAIN ] ESI: Loaded 51566 primary data records. [2025-09-29T02:14:57.892623] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1820 records). [2025-09-29T02:14:57.893011] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-29T02:14:57.897023] [INFO ] [MAIN ] Derivative Progress: 716/2211 symbols completed. ESAB took 1.1s. Estimated remaining: 10m 28s. Rate: 142.7 symbols/min [2025-09-29T02:14:57.939118] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:57.983509] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:58.032820] [INFO ] [MAIN ] ESE: Generated 1820 derivative records from 16878 primary records. [2025-09-29T02:14:58.064364] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-29T02:14:58.229524] [DEBUG] [LOCAL ] ESE: Derivative data saved (1820 records). [2025-09-29T02:14:58.347392] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-29T02:14:58.350564] [INFO ] [MAIN ] Derivative Progress: 717/2211 symbols completed. ESE took 1.5s. Estimated remaining: 10m 28s. Rate: 142.7 symbols/min [2025-09-29T02:14:58.351074] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:58.376128] [DEBUG] [LOCAL ] ESNT: Loaded 39065 existing records from primary storage. [2025-09-29T02:14:58.376798] [INFO ] [MAIN ] ESNT: Loaded 39065 primary data records. [2025-09-29T02:14:58.775557] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-09-29T02:14:58.773714] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:58.776853] [INFO ] [MAIN ] ESI: Generated 1820 derivative records from 51566 primary records. [2025-09-29T02:14:58.776970] [INFO ] [MAIN ] ESRT: Loaded 47104 primary data records. [2025-09-29T02:14:58.777322] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-29T02:14:58.910622] [DEBUG] [LOCAL ] ESI: Derivative data saved (1820 records). [2025-09-29T02:14:58.922140] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-29T02:14:58.941343] [INFO ] [MAIN ] Derivative Progress: 718/2211 symbols completed. ESI took 1.8s. Estimated remaining: 10m 28s. Rate: 142.6 symbols/min [2025-09-29T02:14:59.152848] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:59.154384] [INFO ] [MAIN ] ESNT: Generated 1820 derivative records from 39065 primary records. [2025-09-29T02:14:59.154872] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-29T02:14:59.174207] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1820 records). [2025-09-29T02:14:59.174526] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-29T02:14:59.178003] [INFO ] [MAIN ] Derivative Progress: 719/2211 symbols completed. ESNT took 1.2s. Estimated remaining: 10m 27s. Rate: 142.7 symbols/min [2025-09-29T02:14:59.195481] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:59.196297] [INFO ] [MAIN ] ESRT: Generated 1820 derivative records from 47104 primary records. [2025-09-29T02:14:59.196383] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-29T02:14:59.212339] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1820 records). [2025-09-29T02:14:59.212435] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-29T02:14:59.215145] [INFO ] [MAIN ] Derivative Progress: 720/2211 symbols completed. ESRT took 0.9s. Estimated remaining: 10m 26s. Rate: 142.9 symbols/min [2025-09-29T02:14:59.215626] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:59.215711] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:59.215774] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:59.269734] [DEBUG] [LOCAL ] ESS: Loaded 30441 existing records from primary storage. [2025-09-29T02:14:59.270180] [INFO ] [MAIN ] ESS: Loaded 30441 primary data records. [2025-09-29T02:14:59.454550] [DEBUG] [LOCAL ] ESTC: Loaded 50744 existing records from primary storage. [2025-09-29T02:14:59.461044] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-29T02:14:59.523539] [INFO ] [MAIN ] ESTC: Loaded 50744 primary data records. [2025-09-29T02:14:59.528074] [INFO ] [MAIN ] ET: Loaded 54569 primary data records. [2025-09-29T02:15:00.469910] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:00.470945] [INFO ] [MAIN ] ESS: Generated 1820 derivative records from 30441 primary records. [2025-09-29T02:15:00.471219] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-29T02:15:00.492693] [DEBUG] [LOCAL ] ESS: Derivative data saved (1820 records). [2025-09-29T02:15:00.493496] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-29T02:15:00.496138] [INFO ] [MAIN ] Derivative Progress: 721/2211 symbols completed. ESS took 1.3s. Estimated remaining: 10m 27s. Rate: 142.5 symbols/min [2025-09-29T02:15:00.497905] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:00.523845] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:00.525086] [INFO ] [MAIN ] ET: Generated 1820 derivative records from 54569 primary records. [2025-09-29T02:15:00.542169] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:00.543192] [INFO ] [MAIN ] ESTC: Generated 1820 derivative records from 50744 primary records. [2025-09-29T02:15:00.541821] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-29T02:15:00.543907] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-29T02:15:00.580912] [DEBUG] [LOCAL ] ETB: Loaded 12181 existing records from primary storage. [2025-09-29T02:15:00.579514] [DEBUG] [LOCAL ] ET: Derivative data saved (1820 records). [2025-09-29T02:15:00.581191] [INFO ] [MAIN ] ETB: Loaded 12181 primary data records. [2025-09-29T02:15:00.582166] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-29T02:15:00.611705] [INFO ] [MAIN ] Derivative Progress: 722/2211 symbols completed. ET took 1.4s. Estimated remaining: 10m 26s. Rate: 142.7 symbols/min [2025-09-29T02:15:00.628315] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:00.634202] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1820 records). [2025-09-29T02:15:00.651770] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-29T02:15:00.654830] [INFO ] [MAIN ] Derivative Progress: 723/2211 symbols completed. ESTC took 1.4s. Estimated remaining: 10m 25s. Rate: 142.8 symbols/min [2025-09-29T02:15:00.696299] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:00.956730] [DEBUG] [LOCAL ] ETG: Loaded 16710 existing records from primary storage. [2025-09-29T02:15:00.957589] [INFO ] [MAIN ] ETG: Loaded 16710 primary data records. [2025-09-29T02:15:00.958714] [DEBUG] [LOCAL ] ETD: Loaded 27661 existing records from primary storage. [2025-09-29T02:15:00.959223] [INFO ] [MAIN ] ETD: Loaded 27661 primary data records. [2025-09-29T02:15:01.675735] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:01.677338] [INFO ] [MAIN ] ETB: Generated 1820 derivative records from 12181 primary records. [2025-09-29T02:15:01.677508] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-29T02:15:01.698357] [DEBUG] [LOCAL ] ETB: Derivative data saved (1820 records). [2025-09-29T02:15:01.699462] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-29T02:15:01.702075] [INFO ] [MAIN ] Derivative Progress: 724/2211 symbols completed. ETB took 1.2s. Estimated remaining: 10m 26s. Rate: 142.5 symbols/min [2025-09-29T02:15:01.702738] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:01.728449] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:01.742828] [INFO ] [MAIN ] ETG: Generated 1820 derivative records from 16710 primary records. [2025-09-29T02:15:01.748013] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:01.748260] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-29T02:15:01.751082] [INFO ] [MAIN ] ETD: Generated 1820 derivative records from 27661 primary records. [2025-09-29T02:15:01.752803] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-29T02:15:01.781624] [DEBUG] [LOCAL ] ETJ: Loaded 16938 existing records from primary storage. [2025-09-29T02:15:01.787198] [INFO ] [MAIN ] ETJ: Loaded 16938 primary data records. [2025-09-29T02:15:01.824190] [DEBUG] [LOCAL ] ETG: Derivative data saved (1820 records). [2025-09-29T02:15:01.869735] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-29T02:15:01.906897] [DEBUG] [LOCAL ] ETD: Derivative data saved (1820 records). [2025-09-29T02:15:01.909781] [INFO ] [MAIN ] Derivative Progress: 725/2211 symbols completed. ETG took 1.2s. Estimated remaining: 10m 25s. Rate: 142.6 symbols/min [2025-09-29T02:15:01.940133] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:01.926366] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-29T02:15:01.943373] [INFO ] [MAIN ] Derivative Progress: 726/2211 symbols completed. ETD took 1.3s. Estimated remaining: 10m 24s. Rate: 142.8 symbols/min [2025-09-29T02:15:01.960275] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:02.232495] [DEBUG] [LOCAL ] ETO: Loaded 6600 existing records from primary storage. [2025-09-29T02:15:02.234807] [INFO ] [MAIN ] ETO: Loaded 6600 primary data records. [2025-09-29T02:15:02.627211] [DEBUG] [LOCAL ] ETN: Loaded 53593 existing records from primary storage. [2025-09-29T02:15:02.628113] [INFO ] [MAIN ] ETN: Loaded 53593 primary data records. [2025-09-29T02:15:02.705236] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:02.739944] [INFO ] [MAIN ] ETJ: Generated 1820 derivative records from 16938 primary records. [2025-09-29T02:15:02.761735] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-29T02:15:03.010236] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1820 records). [2025-09-29T02:15:03.012100] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-29T02:15:03.014308] [INFO ] [MAIN ] Derivative Progress: 727/2211 symbols completed. ETJ took 1.3s. Estimated remaining: 10m 25s. Rate: 142.5 symbols/min [2025-09-29T02:15:03.014567] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:03.042635] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:03.043908] [INFO ] [MAIN ] ETO: Generated 1820 derivative records from 6600 primary records. [2025-09-29T02:15:03.044275] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-29T02:15:03.063006] [DEBUG] [LOCAL ] ETO: Derivative data saved (1820 records). [2025-09-29T02:15:03.063547] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-29T02:15:03.066117] [INFO ] [MAIN ] Derivative Progress: 728/2211 symbols completed. ETO took 1.1s. Estimated remaining: 10m 24s. Rate: 142.7 symbols/min [2025-09-29T02:15:03.066542] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:03.088817] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:03.089813] [INFO ] [MAIN ] ETN: Generated 1820 derivative records from 53593 primary records. [2025-09-29T02:15:03.089968] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-29T02:15:03.131413] [DEBUG] [LOCAL ] ETN: Derivative data saved (1820 records). [2025-09-29T02:15:03.139688] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-29T02:15:03.161966] [INFO ] [MAIN ] Derivative Progress: 729/2211 symbols completed. ETN took 1.2s. Estimated remaining: 10m 23s. Rate: 142.8 symbols/min [2025-09-29T02:15:03.158463] [DEBUG] [LOCAL ] ETV: Loaded 21729 existing records from primary storage. [2025-09-29T02:15:03.164198] [DEBUG] [LOCAL ] ETR: Loaded 54001 existing records from primary storage. [2025-09-29T02:15:03.164570] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:03.165127] [INFO ] [MAIN ] ETR: Loaded 54001 primary data records. [2025-09-29T02:15:03.165020] [INFO ] [MAIN ] ETV: Loaded 21729 primary data records. [2025-09-29T02:15:03.438711] [DEBUG] [LOCAL ] ETW: Loaded 25463 existing records from primary storage. [2025-09-29T02:15:03.455242] [INFO ] [MAIN ] ETW: Loaded 25463 primary data records. [2025-09-29T02:15:04.360473] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:04.361801] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:04.364173] [INFO ] [MAIN ] ETR: Generated 1820 derivative records from 54001 primary records. [2025-09-29T02:15:04.363318] [INFO ] [MAIN ] ETV: Generated 1820 derivative records from 21729 primary records. [2025-09-29T02:15:04.364557] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-29T02:15:04.364443] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-29T02:15:04.403165] [DEBUG] [LOCAL ] ETV: Derivative data saved (1820 records). [2025-09-29T02:15:04.403857] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-29T02:15:04.409182] [INFO ] [MAIN ] Derivative Progress: 730/2211 symbols completed. ETV took 1.3s. Estimated remaining: 10m 24s. Rate: 142.5 symbols/min [2025-09-29T02:15:04.409512] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:04.426716] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:04.428150] [DEBUG] [LOCAL ] ETR: Derivative data saved (1820 records). [2025-09-29T02:15:04.430277] [INFO ] [MAIN ] ETW: Generated 1820 derivative records from 25463 primary records. [2025-09-29T02:15:04.430466] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-29T02:15:04.428371] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-29T02:15:04.434417] [INFO ] [MAIN ] Derivative Progress: 731/2211 symbols completed. ETR took 1.4s. Estimated remaining: 10m 23s. Rate: 142.6 symbols/min [2025-09-29T02:15:04.438294] [DEBUG] [LOCAL ] ETX: Loaded 5028 existing records from primary storage. [2025-09-29T02:15:04.438747] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:04.446181] [INFO ] [MAIN ] ETX: Loaded 5028 primary data records. [2025-09-29T02:15:04.475700] [DEBUG] [LOCAL ] ETW: Derivative data saved (1820 records). [2025-09-29T02:15:04.512832] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-29T02:15:04.543260] [INFO ] [MAIN ] Derivative Progress: 732/2211 symbols completed. ETW took 1.4s. Estimated remaining: 10m 22s. Rate: 142.8 symbols/min [2025-09-29T02:15:04.568505] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:04.676250] [DEBUG] [LOCAL ] ETY: Loaded 23078 existing records from primary storage. [2025-09-29T02:15:04.684094] [INFO ] [MAIN ] ETY: Loaded 23078 primary data records. [2025-09-29T02:15:04.881324] [DEBUG] [LOCAL ] EVC: Loaded 19415 existing records from primary storage. [2025-09-29T02:15:04.919355] [INFO ] [MAIN ] EVC: Loaded 19415 primary data records. [2025-09-29T02:15:05.567445] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:05.568999] [INFO ] [MAIN ] ETX: Generated 1820 derivative records from 5028 primary records. [2025-09-29T02:15:05.570115] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-29T02:15:05.610892] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:05.612219] [INFO ] [MAIN ] ETY: Generated 1820 derivative records from 23078 primary records. [2025-09-29T02:15:05.610969] [DEBUG] [LOCAL ] ETX: Derivative data saved (1820 records). [2025-09-29T02:15:05.612475] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-29T02:15:05.613008] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-29T02:15:05.617976] [INFO ] [MAIN ] Derivative Progress: 733/2211 symbols completed. ETX took 1.2s. Estimated remaining: 10m 22s. Rate: 142.5 symbols/min [2025-09-29T02:15:05.649895] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:05.649614] [DEBUG] [LOCAL ] ETY: Derivative data saved (1820 records). [2025-09-29T02:15:05.650109] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-29T02:15:05.650836] [INFO ] [MAIN ] EVC: Generated 1820 derivative records from 19415 primary records. [2025-09-29T02:15:05.653729] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-29T02:15:05.653530] [INFO ] [MAIN ] Derivative Progress: 734/2211 symbols completed. ETY took 1.2s. Estimated remaining: 10m 21s. Rate: 142.7 symbols/min [2025-09-29T02:15:05.669816] [DEBUG] [LOCAL ] EVC: Derivative data saved (1820 records). [2025-09-29T02:15:05.669911] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-29T02:15:05.673240] [INFO ] [MAIN ] Derivative Progress: 735/2211 symbols completed. EVC took 1.1s. Estimated remaining: 10m 20s. Rate: 142.8 symbols/min [2025-09-29T02:15:05.674057] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:05.674169] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:05.673957] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:05.693682] [DEBUG] [LOCAL ] EVF: Loaded 9501 existing records from primary storage. [2025-09-29T02:15:05.694108] [DEBUG] [LOCAL ] EVG: Loaded 5862 existing records from primary storage. [2025-09-29T02:15:05.694471] [INFO ] [MAIN ] EVF: Loaded 9501 primary data records. [2025-09-29T02:15:05.694592] [INFO ] [MAIN ] EVG: Loaded 5862 primary data records. [2025-09-29T02:15:05.997829] [DEBUG] [LOCAL ] EVEX: Loaded 30549 existing records from primary storage. [2025-09-29T02:15:06.049705] [INFO ] [MAIN ] EVEX: Loaded 30549 primary data records. [2025-09-29T02:15:06.817437] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:06.820941] [INFO ] [MAIN ] EVG: Generated 1820 derivative records from 5862 primary records. [2025-09-29T02:15:06.821314] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-29T02:15:06.836891] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:06.849491] [INFO ] [MAIN ] EVF: Generated 1820 derivative records from 9501 primary records. [2025-09-29T02:15:06.853330] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-29T02:15:06.853400] [DEBUG] [LOCAL ] EVG: Derivative data saved (1820 records). [2025-09-29T02:15:06.854394] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-29T02:15:06.857154] [INFO ] [MAIN ] Derivative Progress: 736/2211 symbols completed. EVG took 1.2s. Estimated remaining: 10m 21s. Rate: 142.5 symbols/min [2025-09-29T02:15:06.857877] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:06.877329] [DEBUG] [LOCAL ] EVF: Derivative data saved (1820 records). [2025-09-29T02:15:06.877692] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-29T02:15:06.880365] [INFO ] [MAIN ] Derivative Progress: 737/2211 symbols completed. EVF took 1.2s. Estimated remaining: 10m 20s. Rate: 142.7 symbols/min [2025-09-29T02:15:06.880901] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:06.897326] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:06.898223] [INFO ] [MAIN ] EVEX: Generated 1820 derivative records from 30549 primary records. [2025-09-29T02:15:06.898396] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-29T02:15:06.922673] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1820 records). [2025-09-29T02:15:06.922987] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-29T02:15:06.926167] [INFO ] [MAIN ] Derivative Progress: 738/2211 symbols completed. EVEX took 1.3s. Estimated remaining: 10m 19s. Rate: 142.8 symbols/min [2025-09-29T02:15:06.926717] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:06.933544] [DEBUG] [LOCAL ] EVN: Loaded 11217 existing records from primary storage. [2025-09-29T02:15:06.933732] [INFO ] [MAIN ] EVN: Loaded 11217 primary data records. [2025-09-29T02:15:07.141790] [DEBUG] [LOCAL ] EVH: Loaded 50111 existing records from primary storage. [2025-09-29T02:15:07.178736] [INFO ] [MAIN ] EVH: Loaded 50111 primary data records. [2025-09-29T02:15:07.403766] [DEBUG] [LOCAL ] EVR: Loaded 35882 existing records from primary storage. [2025-09-29T02:15:07.445302] [INFO ] [MAIN ] EVR: Loaded 35882 primary data records. [2025-09-29T02:15:08.036424] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:08.039209] [INFO ] [MAIN ] EVN: Generated 1820 derivative records from 11217 primary records. [2025-09-29T02:15:08.039692] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-29T02:15:08.065174] [DEBUG] [LOCAL ] EVN: Derivative data saved (1820 records). [2025-09-29T02:15:08.073527] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-29T02:15:08.082834] [INFO ] [MAIN ] Derivative Progress: 739/2211 symbols completed. EVN took 1.2s. Estimated remaining: 10m 20s. Rate: 142.5 symbols/min [2025-09-29T02:15:08.083680] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:08.084181] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:08.085516] [INFO ] [MAIN ] EVH: Generated 1820 derivative records from 50111 primary records. [2025-09-29T02:15:08.085708] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-29T02:15:08.105753] [DEBUG] [LOCAL ] EVH: Derivative data saved (1820 records). [2025-09-29T02:15:08.106289] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-29T02:15:08.118262] [INFO ] [MAIN ] Derivative Progress: 740/2211 symbols completed. EVH took 1.3s. Estimated remaining: 10m 19s. Rate: 142.7 symbols/min [2025-09-29T02:15:08.125021] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:08.124394] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:08.126638] [INFO ] [MAIN ] EVR: Generated 1819 derivative records from 35882 primary records. [2025-09-29T02:15:08.127214] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-29T02:15:08.156512] [DEBUG] [LOCAL ] EVT: Loaded 17270 existing records from primary storage. [2025-09-29T02:15:08.156769] [INFO ] [MAIN ] EVT: Loaded 17270 primary data records. [2025-09-29T02:15:08.155031] [DEBUG] [LOCAL ] EVR: Derivative data saved (1819 records). [2025-09-29T02:15:08.162141] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-29T02:15:08.195470] [INFO ] [MAIN ] Derivative Progress: 741/2211 symbols completed. EVR took 1.3s. Estimated remaining: 10m 17s. Rate: 142.8 symbols/min [2025-09-29T02:15:08.200887] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:08.301170] [DEBUG] [LOCAL ] EVTC: Loaded 26745 existing records from primary storage. [2025-09-29T02:15:08.341808] [INFO ] [MAIN ] EVTC: Loaded 26745 primary data records. [2025-09-29T02:15:08.679415] [DEBUG] [LOCAL ] EVTL: Loaded 38140 existing records from primary storage. [2025-09-29T02:15:08.821233] [INFO ] [MAIN ] EVTL: Loaded 38140 primary data records. [2025-09-29T02:15:09.293411] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:09.310462] [INFO ] [MAIN ] EVT: Generated 1820 derivative records from 17270 primary records. [2025-09-29T02:15:09.311298] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-29T02:15:09.333137] [DEBUG] [LOCAL ] EVT: Derivative data saved (1820 records). [2025-09-29T02:15:09.335904] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-29T02:15:09.339738] [INFO ] [MAIN ] Derivative Progress: 742/2211 symbols completed. EVT took 1.3s. Estimated remaining: 10m 18s. Rate: 142.5 symbols/min [2025-09-29T02:15:09.340243] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:09.356378] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:09.358062] [INFO ] [MAIN ] EVTC: Generated 1820 derivative records from 26745 primary records. [2025-09-29T02:15:09.358201] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-29T02:15:09.377688] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1820 records). [2025-09-29T02:15:09.378102] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-29T02:15:09.381271] [INFO ] [MAIN ] Derivative Progress: 743/2211 symbols completed. EVTC took 1.3s. Estimated remaining: 10m 17s. Rate: 142.7 symbols/min [2025-09-29T02:15:09.381721] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:09.409320] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:09.410425] [INFO ] [MAIN ] EVTL: Generated 1820 derivative records from 38140 primary records. [2025-09-29T02:15:09.410810] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-29T02:15:09.438038] [DEBUG] [LOCAL ] EVTR: Loaded 23675 existing records from primary storage. [2025-09-29T02:15:09.439806] [INFO ] [MAIN ] EVTR: Loaded 23675 primary data records. [2025-09-29T02:15:09.503626] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1820 records). [2025-09-29T02:15:09.547899] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-29T02:15:09.579447] [INFO ] [MAIN ] Derivative Progress: 744/2211 symbols completed. EVTL took 1.4s. Estimated remaining: 10m 16s. Rate: 142.8 symbols/min [2025-09-29T02:15:09.622881] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:09.642767] [DEBUG] [LOCAL ] EW: Loaded 54176 existing records from primary storage. [2025-09-29T02:15:09.683633] [INFO ] [MAIN ] EW: Loaded 54176 primary data records. [2025-09-29T02:15:10.066799] [DEBUG] [LOCAL ] EXG: Loaded 34725 existing records from primary storage. [2025-09-29T02:15:10.202472] [INFO ] [MAIN ] EXG: Loaded 34725 primary data records. [2025-09-29T02:15:10.368283] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:10.394111] [INFO ] [MAIN ] EVTR: Generated 1819 derivative records from 23675 primary records. [2025-09-29T02:15:10.431827] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-29T02:15:10.586199] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1819 records). [2025-09-29T02:15:10.588203] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-29T02:15:10.591888] [INFO ] [MAIN ] Derivative Progress: 745/2211 symbols completed. EVTR took 1.3s. Estimated remaining: 10m 17s. Rate: 142.5 symbols/min [2025-09-29T02:15:10.592760] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:10.613149] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:10.615076] [INFO ] [MAIN ] EW: Generated 1820 derivative records from 54176 primary records. [2025-09-29T02:15:10.615387] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-29T02:15:10.644363] [DEBUG] [LOCAL ] EW: Derivative data saved (1820 records). [2025-09-29T02:15:10.645097] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-29T02:15:10.649888] [INFO ] [MAIN ] Derivative Progress: 746/2211 symbols completed. EW took 1.3s. Estimated remaining: 10m 16s. Rate: 142.7 symbols/min [2025-09-29T02:15:10.650575] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:10.670976] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:10.671949] [INFO ] [MAIN ] EXG: Generated 1820 derivative records from 34725 primary records. [2025-09-29T02:15:10.672101] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-29T02:15:10.703605] [DEBUG] [LOCAL ] EXG: Derivative data saved (1820 records). [2025-09-29T02:15:10.703847] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-29T02:15:10.706585] [INFO ] [MAIN ] Derivative Progress: 747/2211 symbols completed. EXG took 1.1s. Estimated remaining: 10m 15s. Rate: 142.8 symbols/min [2025-09-29T02:15:10.706966] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:10.737098] [DEBUG] [LOCAL ] EXK: Loaded 53904 existing records from primary storage. [2025-09-29T02:15:10.737298] [INFO ] [MAIN ] EXK: Loaded 53904 primary data records. [2025-09-29T02:15:10.856601] [DEBUG] [LOCAL ] EXP: Loaded 30275 existing records from primary storage. [2025-09-29T02:15:10.861426] [INFO ] [MAIN ] EXP: Loaded 30275 primary data records. [2025-09-29T02:15:11.471949] [DEBUG] [LOCAL ] EXPD: Loaded 48786 existing records from primary storage. [2025-09-29T02:15:11.487347] [INFO ] [MAIN ] EXPD: Loaded 48786 primary data records. [2025-09-29T02:15:11.851634] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:11.862316] [INFO ] [MAIN ] EXK: Generated 1820 derivative records from 53904 primary records. [2025-09-29T02:15:11.868438] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:11.870756] [INFO ] [MAIN ] EXP: Generated 1820 derivative records from 30275 primary records. [2025-09-29T02:15:11.868112] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-29T02:15:11.871093] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-29T02:15:11.902748] [DEBUG] [LOCAL ] EXK: Derivative data saved (1820 records). [2025-09-29T02:15:11.903221] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-29T02:15:11.908079] [INFO ] [MAIN ] Derivative Progress: 748/2211 symbols completed. EXK took 1.3s. Estimated remaining: 10m 16s. Rate: 142.5 symbols/min [2025-09-29T02:15:11.911986] [DEBUG] [LOCAL ] EXP: Derivative data saved (1820 records). [2025-09-29T02:15:11.912101] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-29T02:15:11.915685] [INFO ] [MAIN ] Derivative Progress: 749/2211 symbols completed. EXP took 1.3s. Estimated remaining: 10m 15s. Rate: 142.7 symbols/min [2025-09-29T02:15:11.932180] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:11.932976] [INFO ] [MAIN ] EXPD: Generated 1820 derivative records from 48786 primary records. [2025-09-29T02:15:11.933062] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-29T02:15:11.949489] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1820 records). [2025-09-29T02:15:11.949686] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-29T02:15:11.953158] [INFO ] [MAIN ] Derivative Progress: 750/2211 symbols completed. EXPD took 1.2s. Estimated remaining: 10m 14s. Rate: 142.9 symbols/min [2025-09-29T02:15:11.953830] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:11.953943] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:11.953880] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:12.032063] [DEBUG] [LOCAL ] FAF: Loaded 42474 existing records from primary storage. [2025-09-29T02:15:12.033811] [INFO ] [MAIN ] FAF: Loaded 42474 primary data records. [2025-09-29T02:15:12.096999] [DEBUG] [LOCAL ] EXR: Loaded 46080 existing records from primary storage. [2025-09-29T02:15:12.167435] [INFO ] [MAIN ] EXR: Loaded 46080 primary data records. [2025-09-29T02:15:12.159687] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-29T02:15:12.167721] [INFO ] [MAIN ] F: Loaded 54600 primary data records. [2025-09-29T02:15:13.240476] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:13.242262] [INFO ] [MAIN ] EXR: Generated 1820 derivative records from 46080 primary records. [2025-09-29T02:15:13.242402] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-29T02:15:13.240980] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:13.244252] [INFO ] [MAIN ] FAF: Generated 1820 derivative records from 42474 primary records. [2025-09-29T02:15:13.244706] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-29T02:15:13.277737] [DEBUG] [LOCAL ] FAF: Derivative data saved (1820 records). [2025-09-29T02:15:13.279633] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-29T02:15:13.294348] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:13.295778] [INFO ] [MAIN ] F: Generated 1820 derivative records from 54600 primary records. [2025-09-29T02:15:13.298109] [INFO ] [MAIN ] Derivative Progress: 751/2211 symbols completed. FAF took 1.3s. Estimated remaining: 10m 15s. Rate: 142.4 symbols/min [2025-09-29T02:15:13.299532] [DEBUG] [LOCAL ] EXR: Derivative data saved (1820 records). [2025-09-29T02:15:13.300037] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-29T02:15:13.299605] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-29T02:15:13.299902] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:13.303974] [INFO ] [MAIN ] Derivative Progress: 752/2211 symbols completed. EXR took 1.4s. Estimated remaining: 10m 14s. Rate: 142.6 symbols/min [2025-09-29T02:15:13.317186] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:13.321505] [DEBUG] [LOCAL ] F: Derivative data saved (1820 records). [2025-09-29T02:15:13.322289] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-29T02:15:13.326152] [INFO ] [MAIN ] Derivative Progress: 753/2211 symbols completed. F took 1.4s. Estimated remaining: 10m 13s. Rate: 142.8 symbols/min [2025-09-29T02:15:13.326673] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:13.364508] [DEBUG] [LOCAL ] FBK: Loaded 26066 existing records from primary storage. [2025-09-29T02:15:13.364727] [INFO ] [MAIN ] FBK: Loaded 26066 primary data records. [2025-09-29T02:15:13.547791] [DEBUG] [LOCAL ] FBP: Loaded 46874 existing records from primary storage. [2025-09-29T02:15:13.642402] [DEBUG] [LOCAL ] FBIN: Loaded 51061 existing records from primary storage. [2025-09-29T02:15:13.617587] [INFO ] [MAIN ] FBP: Loaded 46874 primary data records. [2025-09-29T02:15:13.649722] [INFO ] [MAIN ] FBIN: Loaded 51061 primary data records. [2025-09-29T02:15:14.502674] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:14.504302] [INFO ] [MAIN ] FBK: Generated 1820 derivative records from 26066 primary records. [2025-09-29T02:15:14.507208] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-29T02:15:14.537927] [DEBUG] [LOCAL ] FBK: Derivative data saved (1820 records). [2025-09-29T02:15:14.538198] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-29T02:15:14.541162] [INFO ] [MAIN ] Derivative Progress: 754/2211 symbols completed. FBK took 1.2s. Estimated remaining: 10m 14s. Rate: 142.4 symbols/min [2025-09-29T02:15:14.542491] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:14.567352] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:14.569217] [INFO ] [MAIN ] FBP: Generated 1820 derivative records from 46874 primary records. [2025-09-29T02:15:14.569742] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-29T02:15:14.585510] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:14.596512] [INFO ] [MAIN ] FBIN: Generated 1820 derivative records from 51061 primary records. [2025-09-29T02:15:14.605430] [DEBUG] [LOCAL ] FBP: Derivative data saved (1820 records). [2025-09-29T02:15:14.605576] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-29T02:15:14.606070] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-29T02:15:14.614466] [INFO ] [MAIN ] Derivative Progress: 755/2211 symbols completed. FBP took 1.3s. Estimated remaining: 10m 13s. Rate: 142.6 symbols/min [2025-09-29T02:15:14.615459] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:14.647570] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1820 records). [2025-09-29T02:15:14.647795] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-29T02:15:14.651405] [INFO ] [MAIN ] Derivative Progress: 756/2211 symbols completed. FBIN took 1.4s. Estimated remaining: 10m 11s. Rate: 142.8 symbols/min [2025-09-29T02:15:14.653093] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:14.667688] [DEBUG] [LOCAL ] FBRT: Loaded 34985 existing records from primary storage. [2025-09-29T02:15:14.668244] [INFO ] [MAIN ] FBRT: Loaded 34985 primary data records. [2025-09-29T02:15:14.814894] [DEBUG] [LOCAL ] FC: Loaded 15634 existing records from primary storage. [2025-09-29T02:15:14.842326] [INFO ] [MAIN ] FC: Loaded 15634 primary data records. [2025-09-29T02:15:15.193267] [DEBUG] [LOCAL ] FCF: Loaded 40237 existing records from primary storage. [2025-09-29T02:15:15.198150] [INFO ] [MAIN ] FCF: Loaded 40237 primary data records. [2025-09-29T02:15:15.900943] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:15.902404] [INFO ] [MAIN ] FBRT: Generated 1820 derivative records from 34985 primary records. [2025-09-29T02:15:15.902892] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-29T02:15:15.926033] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1820 records). [2025-09-29T02:15:15.939801] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-29T02:15:15.940778] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:15.943218] [INFO ] [MAIN ] Derivative Progress: 757/2211 symbols completed. FBRT took 1.4s. Estimated remaining: 10m 13s. Rate: 142.4 symbols/min [2025-09-29T02:15:15.944719] [INFO ] [MAIN ] FC: Generated 1820 derivative records from 15634 primary records. [2025-09-29T02:15:15.945072] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-29T02:15:15.945797] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:15.966867] [DEBUG] [LOCAL ] FC: Derivative data saved (1820 records). [2025-09-29T02:15:15.967265] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-29T02:15:15.970005] [INFO ] [MAIN ] Derivative Progress: 758/2211 symbols completed. FC took 1.4s. Estimated remaining: 10m 12s. Rate: 142.6 symbols/min [2025-09-29T02:15:15.978318] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:15.984034] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:15.985179] [INFO ] [MAIN ] FCF: Generated 1820 derivative records from 40237 primary records. [2025-09-29T02:15:15.985314] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-29T02:15:16.012142] [DEBUG] [LOCAL ] FCF: Derivative data saved (1820 records). [2025-09-29T02:15:16.012447] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-29T02:15:16.015403] [INFO ] [MAIN ] Derivative Progress: 759/2211 symbols completed. FCF took 1.4s. Estimated remaining: 10m 10s. Rate: 142.7 symbols/min [2025-09-29T02:15:16.016730] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:16.026813] [DEBUG] [LOCAL ] FCN: Loaded 26559 existing records from primary storage. [2025-09-29T02:15:16.027802] [INFO ] [MAIN ] FCN: Loaded 26559 primary data records. [2025-09-29T02:15:16.184034] [DEBUG] [LOCAL ] FCT: Loaded 14613 existing records from primary storage. [2025-09-29T02:15:16.205993] [DEBUG] [LOCAL ] FCPT: Loaded 37955 existing records from primary storage. [2025-09-29T02:15:16.206189] [INFO ] [MAIN ] FCPT: Loaded 37955 primary data records. [2025-09-29T02:15:16.206286] [INFO ] [MAIN ] FCT: Loaded 14613 primary data records. [2025-09-29T02:15:17.086040] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:17.087353] [INFO ] [MAIN ] FCN: Generated 1820 derivative records from 26559 primary records. [2025-09-29T02:15:17.087738] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-29T02:15:17.124984] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:17.123929] [DEBUG] [LOCAL ] FCN: Derivative data saved (1820 records). [2025-09-29T02:15:17.128245] [INFO ] [MAIN ] FCT: Generated 1820 derivative records from 14613 primary records. [2025-09-29T02:15:17.127192] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-29T02:15:17.128503] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-29T02:15:17.139895] [INFO ] [MAIN ] Derivative Progress: 760/2211 symbols completed. FCN took 1.2s. Estimated remaining: 10m 11s. Rate: 142.4 symbols/min [2025-09-29T02:15:17.145843] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:17.147618] [INFO ] [MAIN ] FCPT: Generated 1820 derivative records from 37955 primary records. [2025-09-29T02:15:17.147769] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-29T02:15:17.146045] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:17.180313] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1820 records). [2025-09-29T02:15:17.183041] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-29T02:15:17.187760] [INFO ] [MAIN ] Derivative Progress: 761/2211 symbols completed. FCPT took 1.2s. Estimated remaining: 10m 10s. Rate: 142.6 symbols/min [2025-09-29T02:15:17.184467] [DEBUG] [LOCAL ] FCT: Derivative data saved (1820 records). [2025-09-29T02:15:17.188044] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:17.188243] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-29T02:15:17.192139] [INFO ] [MAIN ] Derivative Progress: 762/2211 symbols completed. FCT took 1.2s. Estimated remaining: 10m 9s. Rate: 142.8 symbols/min [2025-09-29T02:15:17.192417] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:17.237301] [DEBUG] [LOCAL ] FDP: Loaded 30760 existing records from primary storage. [2025-09-29T02:15:17.237694] [INFO ] [MAIN ] FDP: Loaded 30760 primary data records. [2025-09-29T02:15:17.348289] [DEBUG] [LOCAL ] FDS: Loaded 26759 existing records from primary storage. [2025-09-29T02:15:17.380991] [INFO ] [MAIN ] FDS: Loaded 26759 primary data records. [2025-09-29T02:15:17.462531] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-29T02:15:17.666014] [INFO ] [MAIN ] FCX: Loaded 54480 primary data records. [2025-09-29T02:15:18.413533] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:18.414971] [INFO ] [MAIN ] FDP: Generated 1820 derivative records from 30760 primary records. [2025-09-29T02:15:18.415729] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-29T02:15:18.436198] [DEBUG] [LOCAL ] FDP: Derivative data saved (1820 records). [2025-09-29T02:15:18.436493] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-29T02:15:18.439233] [INFO ] [MAIN ] Derivative Progress: 763/2211 symbols completed. FDP took 1.3s. Estimated remaining: 10m 10s. Rate: 142.4 symbols/min [2025-09-29T02:15:18.460198] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:18.461679] [INFO ] [MAIN ] FDS: Generated 1820 derivative records from 26759 primary records. [2025-09-29T02:15:18.462126] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-29T02:15:18.483443] [DEBUG] [LOCAL ] FDS: Derivative data saved (1820 records). [2025-09-29T02:15:18.496736] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-29T02:15:18.496495] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:18.500031] [INFO ] [MAIN ] Derivative Progress: 764/2211 symbols completed. FDS took 1.3s. Estimated remaining: 10m 9s. Rate: 142.6 symbols/min [2025-09-29T02:15:18.500977] [INFO ] [MAIN ] FCX: Generated 1820 derivative records from 54480 primary records. [2025-09-29T02:15:18.501293] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-29T02:15:18.518222] [DEBUG] [LOCAL ] FCX: Derivative data saved (1820 records). [2025-09-29T02:15:18.518376] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-29T02:15:18.521820] [INFO ] [MAIN ] Derivative Progress: 765/2211 symbols completed. FCX took 1.4s. Estimated remaining: 10m 8s. Rate: 142.7 symbols/min [2025-09-29T02:15:18.522393] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:18.522346] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:18.522512] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:18.649032] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-09-29T02:15:18.650601] [DEBUG] [LOCAL ] FERG: Loaded 49691 existing records from primary storage. [2025-09-29T02:15:18.650852] [INFO ] [MAIN ] FE: Loaded 54208 primary data records. [2025-09-29T02:15:18.669950] [DEBUG] [LOCAL ] FDX: Loaded 52362 existing records from primary storage. [2025-09-29T02:15:18.670213] [INFO ] [MAIN ] FDX: Loaded 52362 primary data records. [2025-09-29T02:15:18.651122] [INFO ] [MAIN ] FERG: Loaded 49691 primary data records. [2025-09-29T02:15:19.747546] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:19.748114] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:19.749241] [INFO ] [MAIN ] FE: Generated 1820 derivative records from 54208 primary records. [2025-09-29T02:15:19.749440] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-29T02:15:19.758039] [INFO ] [MAIN ] FDX: Generated 1820 derivative records from 52362 primary records. [2025-09-29T02:15:19.759356] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-29T02:15:19.766321] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:19.791386] [INFO ] [MAIN ] FERG: Generated 1820 derivative records from 49691 primary records. [2025-09-29T02:15:19.795992] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-29T02:15:19.797951] [DEBUG] [LOCAL ] FE: Derivative data saved (1820 records). [2025-09-29T02:15:19.801753] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-29T02:15:19.802725] [DEBUG] [LOCAL ] FDX: Derivative data saved (1820 records). [2025-09-29T02:15:19.819276] [INFO ] [MAIN ] Derivative Progress: 766/2211 symbols completed. FE took 1.3s. Estimated remaining: 10m 9s. Rate: 142.3 symbols/min [2025-09-29T02:15:19.820154] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:19.822762] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-29T02:15:19.828495] [DEBUG] [LOCAL ] FERG: Derivative data saved (1820 records). [2025-09-29T02:15:19.827756] [INFO ] [MAIN ] Derivative Progress: 767/2211 symbols completed. FDX took 1.3s. Estimated remaining: 10m 8s. Rate: 142.5 symbols/min [2025-09-29T02:15:19.828966] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:19.828824] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-29T02:15:19.832501] [INFO ] [MAIN ] Derivative Progress: 768/2211 symbols completed. FERG took 1.3s. Estimated remaining: 10m 7s. Rate: 142.7 symbols/min [2025-09-29T02:15:19.832995] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:19.856234] [DEBUG] [LOCAL ] FFA: Loaded 5800 existing records from primary storage. [2025-09-29T02:15:19.862031] [INFO ] [MAIN ] FFA: Loaded 5800 primary data records. [2025-09-29T02:15:19.862516] [DEBUG] [LOCAL ] FET: Loaded 12984 existing records from primary storage. [2025-09-29T02:15:19.880421] [INFO ] [MAIN ] FET: Loaded 12984 primary data records. [2025-09-29T02:15:20.068797] [DEBUG] [LOCAL ] FF: Loaded 25768 existing records from primary storage. [2025-09-29T02:15:20.087610] [INFO ] [MAIN ] FF: Loaded 25768 primary data records. [2025-09-29T02:15:20.982941] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:20.986732] [INFO ] [MAIN ] FFA: Generated 1820 derivative records from 5800 primary records. [2025-09-29T02:15:20.994960] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-29T02:15:21.001122] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:21.016109] [INFO ] [MAIN ] FET: Generated 1820 derivative records from 12984 primary records. [2025-09-29T02:15:21.017958] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-29T02:15:21.020035] [DEBUG] [LOCAL ] FFA: Derivative data saved (1820 records). [2025-09-29T02:15:21.020152] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-29T02:15:21.023173] [INFO ] [MAIN ] Derivative Progress: 769/2211 symbols completed. FFA took 1.2s. Estimated remaining: 10m 8s. Rate: 142.4 symbols/min [2025-09-29T02:15:21.023971] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:21.044177] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:21.045342] [INFO ] [MAIN ] FF: Generated 1820 derivative records from 25768 primary records. [2025-09-29T02:15:21.050216] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-29T02:15:21.054608] [DEBUG] [LOCAL ] FET: Derivative data saved (1820 records). [2025-09-29T02:15:21.056151] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-29T02:15:21.070200] [INFO ] [MAIN ] Derivative Progress: 770/2211 symbols completed. FET took 1.3s. Estimated remaining: 10m 7s. Rate: 142.5 symbols/min [2025-09-29T02:15:21.073826] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:21.075897] [DEBUG] [LOCAL ] FF: Derivative data saved (1820 records). [2025-09-29T02:15:21.076133] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-29T02:15:21.079521] [INFO ] [MAIN ] Derivative Progress: 771/2211 symbols completed. FF took 1.3s. Estimated remaining: 10m 5s. Rate: 142.7 symbols/min [2025-09-29T02:15:21.079961] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:21.096516] [DEBUG] [LOCAL ] FFC: Loaded 16899 existing records from primary storage. [2025-09-29T02:15:21.096704] [INFO ] [MAIN ] FFC: Loaded 16899 primary data records. [2025-09-29T02:15:21.282204] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-09-29T02:15:21.283563] [DEBUG] [LOCAL ] FFWM: Loaded 36532 existing records from primary storage. [2025-09-29T02:15:21.313783] [INFO ] [MAIN ] FG: Loaded 22819 primary data records. [2025-09-29T02:15:21.451206] [INFO ] [MAIN ] FFWM: Loaded 36532 primary data records. [2025-09-29T02:15:22.240338] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:22.242785] [INFO ] [MAIN ] FFC: Generated 1820 derivative records from 16899 primary records. [2025-09-29T02:15:22.243579] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-29T02:15:22.265306] [DEBUG] [LOCAL ] FFC: Derivative data saved (1820 records). [2025-09-29T02:15:22.265863] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-29T02:15:22.268468] [INFO ] [MAIN ] Derivative Progress: 772/2211 symbols completed. FFC took 1.2s. Estimated remaining: 10m 6s. Rate: 142.4 symbols/min [2025-09-29T02:15:22.269079] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:22.281879] [DEBUG] [LOCAL ] FGN: Loaded 3915 existing records from primary storage. [2025-09-29T02:15:22.297258] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:22.291678] [INFO ] [MAIN ] FGN: Loaded 3915 primary data records. [2025-09-29T02:15:22.303447] [INFO ] [MAIN ] FG: Generated 1820 derivative records from 22819 primary records. [2025-09-29T02:15:22.360769] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-29T02:15:22.352411] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:22.406947] [INFO ] [MAIN ] FFWM: Generated 1820 derivative records from 36532 primary records. [2025-09-29T02:15:22.442446] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-29T02:15:22.481946] [DEBUG] [LOCAL ] FG: Derivative data saved (1820 records). [2025-09-29T02:15:22.489556] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1820 records). [2025-09-29T02:15:22.494980] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-29T02:15:22.494871] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-29T02:15:22.498208] [INFO ] [MAIN ] Derivative Progress: 773/2211 symbols completed. FFWM took 1.4s. Estimated remaining: 10m 6s. Rate: 142.5 symbols/min [2025-09-29T02:15:22.501364] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:22.501520] [INFO ] [MAIN ] Derivative Progress: 774/2211 symbols completed. FG took 1.4s. Estimated remaining: 10m 4s. Rate: 142.6 symbols/min [2025-09-29T02:15:22.676685] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:22.738286] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:22.739105] [INFO ] [MAIN ] FGN: Generated 1820 derivative records from 3915 primary records. [2025-09-29T02:15:22.739285] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-29T02:15:22.771775] [DEBUG] [LOCAL ] FGN: Derivative data saved (1820 records). [2025-09-29T02:15:22.773274] [DEBUG] [LOCAL ] FHI: Loaded 41203 existing records from primary storage. [2025-09-29T02:15:22.773532] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-29T02:15:22.773738] [INFO ] [MAIN ] FHI: Loaded 41203 primary data records. [2025-09-29T02:15:22.777204] [INFO ] [MAIN ] Derivative Progress: 775/2211 symbols completed. FGN took 0.5s. Estimated remaining: 10m 4s. Rate: 142.7 symbols/min [2025-09-29T02:15:22.793170] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:22.958506] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-29T02:15:22.974433] [INFO ] [MAIN ] FHN: Loaded 54148 primary data records. [2025-09-29T02:15:23.546255] [DEBUG] [LOCAL ] FI: Loaded 54281 existing records from primary storage. [2025-09-29T02:15:23.546766] [INFO ] [MAIN ] FI: Loaded 54281 primary data records. [2025-09-29T02:15:23.843057] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:23.922087] [INFO ] [MAIN ] FHI: Generated 1820 derivative records from 41203 primary records. [2025-09-29T02:15:23.922800] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-29T02:15:23.948548] [DEBUG] [LOCAL ] FHI: Derivative data saved (1820 records). [2025-09-29T02:15:23.949020] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-29T02:15:23.953406] [INFO ] [MAIN ] Derivative Progress: 776/2211 symbols completed. FHI took 1.5s. Estimated remaining: 10m 5s. Rate: 142.4 symbols/min [2025-09-29T02:15:23.968379] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:23.968826] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:23.970962] [INFO ] [MAIN ] FHN: Generated 1820 derivative records from 54148 primary records. [2025-09-29T02:15:23.971318] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-29T02:15:23.994085] [DEBUG] [LOCAL ] FHN: Derivative data saved (1820 records). [2025-09-29T02:15:23.994514] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-29T02:15:23.997867] [INFO ] [MAIN ] Derivative Progress: 777/2211 symbols completed. FHN took 1.3s. Estimated remaining: 10m 4s. Rate: 142.5 symbols/min [2025-09-29T02:15:24.004883] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:24.022304] [DEBUG] [LOCAL ] FICO: Loaded 20674 existing records from primary storage. [2025-09-29T02:15:24.035379] [INFO ] [MAIN ] FICO: Loaded 20674 primary data records. [2025-09-29T02:15:24.035934] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:24.058192] [INFO ] [MAIN ] FI: Generated 1820 derivative records from 54281 primary records. [2025-09-29T02:15:24.109465] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-29T02:15:24.439995] [DEBUG] [LOCAL ] FI: Derivative data saved (1820 records). [2025-09-29T02:15:24.440434] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-29T02:15:24.444802] [INFO ] [MAIN ] Derivative Progress: 778/2211 symbols completed. FI took 1.7s. Estimated remaining: 10m 3s. Rate: 142.5 symbols/min [2025-09-29T02:15:24.446447] [DEBUG] [LOCAL ] FIGS: Loaded 49651 existing records from primary storage. [2025-09-29T02:15:24.446624] [INFO ] [MAIN ] FIGS: Loaded 49651 primary data records. [2025-09-29T02:15:24.851098] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:24.852339] [INFO ] [MAIN ] FICO: Generated 1820 derivative records from 20674 primary records. [2025-09-29T02:15:24.852568] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-29T02:15:24.870376] [DEBUG] [LOCAL ] FICO: Derivative data saved (1820 records). [2025-09-29T02:15:24.870632] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-29T02:15:24.873039] [INFO ] [MAIN ] Derivative Progress: 779/2211 symbols completed. FICO took 0.9s. Estimated remaining: 10m 3s. Rate: 142.5 symbols/min [2025-09-29T02:15:24.890088] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:24.890806] [INFO ] [MAIN ] FIGS: Generated 1820 derivative records from 49651 primary records. [2025-09-29T02:15:24.890897] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-29T02:15:24.906662] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1820 records). [2025-09-29T02:15:24.906755] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-29T02:15:24.909906] [INFO ] [MAIN ] Derivative Progress: 780/2211 symbols completed. FIGS took 0.9s. Estimated remaining: 10m 2s. Rate: 142.7 symbols/min [2025-09-29T02:15:24.910331] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:24.910409] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:24.910573] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:24.930411] [DEBUG] [LOCAL ] FINS: Loaded 8309 existing records from primary storage. [2025-09-29T02:15:24.930620] [INFO ] [MAIN ] FINS: Loaded 8309 primary data records. [2025-09-29T02:15:25.331566] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-29T02:15:25.331954] [INFO ] [MAIN ] FIHL: Loaded 40851 primary data records. [2025-09-29T02:15:25.346952] [DEBUG] [LOCAL ] FINV: Loaded 45772 existing records from primary storage. [2025-09-29T02:15:25.385211] [INFO ] [MAIN ] FINV: Loaded 45772 primary data records. [2025-09-29T02:15:26.034819] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:26.037170] [INFO ] [MAIN ] FINS: Generated 1819 derivative records from 8309 primary records. [2025-09-29T02:15:26.038785] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-29T02:15:26.059898] [DEBUG] [LOCAL ] FINS: Derivative data saved (1819 records). [2025-09-29T02:15:26.060275] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-29T02:15:26.063118] [INFO ] [MAIN ] Derivative Progress: 781/2211 symbols completed. FINS took 1.2s. Estimated remaining: 10m 3s. Rate: 142.4 symbols/min [2025-09-29T02:15:26.065120] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:26.091359] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:26.094898] [INFO ] [MAIN ] FIHL: Generated 1820 derivative records from 40851 primary records. [2025-09-29T02:15:26.095077] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-29T02:15:26.129588] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:26.133454] [INFO ] [MAIN ] FINV: Generated 1820 derivative records from 45772 primary records. [2025-09-29T02:15:26.134120] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-29T02:15:26.137314] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1820 records). [2025-09-29T02:15:26.137835] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-29T02:15:26.141276] [INFO ] [MAIN ] Derivative Progress: 782/2211 symbols completed. FIHL took 1.2s. Estimated remaining: 10m 2s. Rate: 142.5 symbols/min [2025-09-29T02:15:26.153687] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:26.158947] [DEBUG] [LOCAL ] FINV: Derivative data saved (1820 records). [2025-09-29T02:15:26.159341] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-29T02:15:26.162615] [INFO ] [MAIN ] Derivative Progress: 783/2211 symbols completed. FINV took 1.3s. Estimated remaining: 10m 0s. Rate: 142.7 symbols/min [2025-09-29T02:15:26.163255] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:26.189725] [DEBUG] [LOCAL ] FLC: Loaded 5559 existing records from primary storage. [2025-09-29T02:15:26.190088] [INFO ] [MAIN ] FLC: Loaded 5559 primary data records. [2025-09-29T02:15:26.328384] [DEBUG] [LOCAL ] FIS: Loaded 54144 existing records from primary storage. [2025-09-29T02:15:26.328735] [INFO ] [MAIN ] FIS: Loaded 54144 primary data records. [2025-09-29T02:15:26.469105] [DEBUG] [LOCAL ] FIX: Loaded 30763 existing records from primary storage. [2025-09-29T02:15:26.505548] [INFO ] [MAIN ] FIX: Loaded 30763 primary data records. [2025-09-29T02:15:27.350844] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:27.352222] [INFO ] [MAIN ] FLC: Generated 1820 derivative records from 5559 primary records. [2025-09-29T02:15:27.355101] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-29T02:15:27.384199] [DEBUG] [LOCAL ] FLC: Derivative data saved (1820 records). [2025-09-29T02:15:27.398685] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-29T02:15:27.401400] [INFO ] [MAIN ] Derivative Progress: 784/2211 symbols completed. FLC took 1.2s. Estimated remaining: 10m 1s. Rate: 142.3 symbols/min [2025-09-29T02:15:27.402071] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:27.402334] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:27.403855] [INFO ] [MAIN ] FIS: Generated 1820 derivative records from 54144 primary records. [2025-09-29T02:15:27.407690] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-29T02:15:27.444177] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:27.448016] [INFO ] [MAIN ] FIX: Generated 1819 derivative records from 30763 primary records. [2025-09-29T02:15:27.448924] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-29T02:15:27.451026] [DEBUG] [LOCAL ] FIS: Derivative data saved (1820 records). [2025-09-29T02:15:27.459296] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-29T02:15:27.470424] [INFO ] [MAIN ] Derivative Progress: 785/2211 symbols completed. FIS took 1.4s. Estimated remaining: 10m 0s. Rate: 142.5 symbols/min [2025-09-29T02:15:27.473669] [DEBUG] [LOCAL ] FIX: Derivative data saved (1819 records). [2025-09-29T02:15:27.474171] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:27.474387] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-29T02:15:27.478592] [INFO ] [MAIN ] Derivative Progress: 786/2211 symbols completed. FIX took 1.3s. Estimated remaining: 9m 59s. Rate: 142.7 symbols/min [2025-09-29T02:15:27.479060] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:27.530499] [DEBUG] [LOCAL ] FLG: Loaded 54105 existing records from primary storage. [2025-09-29T02:15:27.541153] [INFO ] [MAIN ] FLG: Loaded 54105 primary data records. [2025-09-29T02:15:27.705094] [DEBUG] [LOCAL ] FLNG: Loaded 34431 existing records from primary storage. [2025-09-29T02:15:27.718585] [INFO ] [MAIN ] FLNG: Loaded 34431 primary data records. [2025-09-29T02:15:27.826301] [DEBUG] [LOCAL ] FLO: Loaded 52656 existing records from primary storage. [2025-09-29T02:15:28.024054] [INFO ] [MAIN ] FLO: Loaded 52656 primary data records. [2025-09-29T02:15:28.667981] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:28.669963] [INFO ] [MAIN ] FLG: Generated 1820 derivative records from 54105 primary records. [2025-09-29T02:15:28.673033] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-29T02:15:28.704372] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:28.707600] [INFO ] [MAIN ] FLNG: Generated 1820 derivative records from 34431 primary records. [2025-09-29T02:15:28.708844] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-29T02:15:28.726974] [DEBUG] [LOCAL ] FLG: Derivative data saved (1820 records). [2025-09-29T02:15:28.730359] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-29T02:15:28.739354] [INFO ] [MAIN ] Derivative Progress: 787/2211 symbols completed. FLG took 1.3s. Estimated remaining: 10m 0s. Rate: 142.3 symbols/min [2025-09-29T02:15:28.740360] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:28.752291] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1820 records). [2025-09-29T02:15:28.757815] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-29T02:15:28.758159] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:28.763087] [INFO ] [MAIN ] FLO: Generated 1820 derivative records from 52656 primary records. [2025-09-29T02:15:28.761948] [INFO ] [MAIN ] Derivative Progress: 788/2211 symbols completed. FLNG took 1.3s. Estimated remaining: 9m 59s. Rate: 142.5 symbols/min [2025-09-29T02:15:28.763422] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:28.763668] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-29T02:15:28.783546] [DEBUG] [LOCAL ] FLO: Derivative data saved (1820 records). [2025-09-29T02:15:28.783953] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-29T02:15:28.789239] [INFO ] [MAIN ] Derivative Progress: 789/2211 symbols completed. FLO took 1.3s. Estimated remaining: 9m 58s. Rate: 142.7 symbols/min [2025-09-29T02:15:28.789820] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:28.891366] [DEBUG] [LOCAL ] FLR: Loaded 53892 existing records from primary storage. [2025-09-29T02:15:28.892072] [INFO ] [MAIN ] FLR: Loaded 53892 primary data records. [2025-09-29T02:15:28.940448] [DEBUG] [LOCAL ] FLS: Loaded 50934 existing records from primary storage. [2025-09-29T02:15:28.970070] [INFO ] [MAIN ] FLS: Loaded 50934 primary data records. [2025-09-29T02:15:29.118492] [DEBUG] [LOCAL ] FLUT: Loaded 51580 existing records from primary storage. [2025-09-29T02:15:29.164535] [INFO ] [MAIN ] FLUT: Loaded 51580 primary data records. [2025-09-29T02:15:30.010443] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:30.012041] [INFO ] [MAIN ] FLR: Generated 1820 derivative records from 53892 primary records. [2025-09-29T02:15:30.012698] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-29T02:15:30.035767] [DEBUG] [LOCAL ] FLR: Derivative data saved (1820 records). [2025-09-29T02:15:30.049811] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:30.049438] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-29T02:15:30.065358] [INFO ] [MAIN ] Derivative Progress: 790/2211 symbols completed. FLR took 1.3s. Estimated remaining: 9m 59s. Rate: 142.3 symbols/min [2025-09-29T02:15:30.067322] [INFO ] [MAIN ] FLS: Generated 1820 derivative records from 50934 primary records. [2025-09-29T02:15:30.067995] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:30.067753] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:30.068549] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-29T02:15:30.071164] [INFO ] [MAIN ] FLUT: Generated 1820 derivative records from 51580 primary records. [2025-09-29T02:15:30.079363] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-29T02:15:30.089327] [DEBUG] [LOCAL ] FLS: Derivative data saved (1820 records). [2025-09-29T02:15:30.089827] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-29T02:15:30.102630] [INFO ] [MAIN ] Derivative Progress: 791/2211 symbols completed. FLS took 1.3s. Estimated remaining: 9m 58s. Rate: 142.5 symbols/min [2025-09-29T02:15:30.102969] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:30.117837] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1820 records). [2025-09-29T02:15:30.118249] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-29T02:15:30.121924] [INFO ] [MAIN ] Derivative Progress: 792/2211 symbols completed. FLUT took 1.3s. Estimated remaining: 9m 57s. Rate: 142.6 symbols/min [2025-09-29T02:15:30.122235] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:30.132865] [DEBUG] [LOCAL ] FLXR: Loaded 20315 existing records from primary storage. [2025-09-29T02:15:30.133150] [INFO ] [MAIN ] FLXR: Loaded 20315 primary data records. [2025-09-29T02:15:30.227132] [DEBUG] [LOCAL ] FMN: Loaded 6097 existing records from primary storage. [2025-09-29T02:15:30.253276] [INFO ] [MAIN ] FMN: Loaded 6097 primary data records. [2025-09-29T02:15:30.712713] [DEBUG] [LOCAL ] FMC: Loaded 52560 existing records from primary storage. [2025-09-29T02:15:30.841030] [INFO ] [MAIN ] FMC: Loaded 52560 primary data records. [2025-09-29T02:15:31.229321] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:31.232377] [INFO ] [MAIN ] FLXR: Generated 1820 derivative records from 20315 primary records. [2025-09-29T02:15:31.247463] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-29T02:15:31.247855] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:31.249726] [INFO ] [MAIN ] FMN: Generated 1820 derivative records from 6097 primary records. [2025-09-29T02:15:31.250044] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-29T02:15:31.282326] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1820 records). [2025-09-29T02:15:31.284983] [DEBUG] [LOCAL ] FMN: Derivative data saved (1820 records). [2025-09-29T02:15:31.285283] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-29T02:15:31.285596] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-29T02:15:31.288539] [INFO ] [MAIN ] Derivative Progress: 793/2211 symbols completed. FLXR took 1.2s. Estimated remaining: 9m 58s. Rate: 142.3 symbols/min [2025-09-29T02:15:31.292220] [INFO ] [MAIN ] Derivative Progress: 794/2211 symbols completed. FMN took 1.2s. Estimated remaining: 9m 57s. Rate: 142.5 symbols/min [2025-09-29T02:15:31.311626] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:31.312440] [INFO ] [MAIN ] FMC: Generated 1820 derivative records from 52560 primary records. [2025-09-29T02:15:31.312527] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-29T02:15:31.330004] [DEBUG] [LOCAL ] FMC: Derivative data saved (1820 records). [2025-09-29T02:15:31.330125] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-29T02:15:31.334725] [INFO ] [MAIN ] Derivative Progress: 795/2211 symbols completed. FMC took 1.2s. Estimated remaining: 9m 56s. Rate: 142.6 symbols/min [2025-09-29T02:15:31.335230] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:31.335478] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:31.335603] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:31.343178] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-29T02:15:31.343538] [INFO ] [MAIN ] FMY: Loaded 1400 primary data records. [2025-09-29T02:15:31.753998] [DEBUG] [LOCAL ] FMS: Loaded 30771 existing records from primary storage. [2025-09-29T02:15:31.755068] [DEBUG] [LOCAL ] FMX: Loaded 41276 existing records from primary storage. [2025-09-29T02:15:31.756334] [INFO ] [MAIN ] FMX: Loaded 41276 primary data records. [2025-09-29T02:15:31.756238] [INFO ] [MAIN ] FMS: Loaded 30771 primary data records. [2025-09-29T02:15:32.486082] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7805 incomplete bins [2025-09-29T02:15:32.489561] [INFO ] [MAIN ] FMY: Generated 1809 derivative records from 1400 primary records. [2025-09-29T02:15:32.490357] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-29T02:15:32.514271] [DEBUG] [LOCAL ] FMY: Derivative data saved (1809 records). [2025-09-29T02:15:32.515360] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-29T02:15:32.518808] [INFO ] [MAIN ] Derivative Progress: 796/2211 symbols completed. FMY took 1.2s. Estimated remaining: 9m 57s. Rate: 142.3 symbols/min [2025-09-29T02:15:32.519544] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:32.543572] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:32.545891] [INFO ] [MAIN ] FMS: Generated 1820 derivative records from 30771 primary records. [2025-09-29T02:15:32.546168] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-29T02:15:32.559681] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:32.561388] [INFO ] [MAIN ] FMX: Generated 1820 derivative records from 41276 primary records. [2025-09-29T02:15:32.562231] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-29T02:15:32.593822] [DEBUG] [LOCAL ] FMS: Derivative data saved (1820 records). [2025-09-29T02:15:32.595436] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-29T02:15:32.599772] [DEBUG] [LOCAL ] FMX: Derivative data saved (1820 records). [2025-09-29T02:15:32.603285] [INFO ] [MAIN ] Derivative Progress: 797/2211 symbols completed. FMS took 1.3s. Estimated remaining: 9m 56s. Rate: 142.5 symbols/min [2025-09-29T02:15:32.603767] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:32.603603] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-29T02:15:32.619189] [INFO ] [MAIN ] Derivative Progress: 798/2211 symbols completed. FMX took 1.3s. Estimated remaining: 9m 54s. Rate: 142.6 symbols/min [2025-09-29T02:15:32.619602] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:32.641296] [DEBUG] [LOCAL ] FN: Loaded 39795 existing records from primary storage. [2025-09-29T02:15:32.641843] [INFO ] [MAIN ] FN: Loaded 39795 primary data records. [2025-09-29T02:15:33.050866] [DEBUG] [LOCAL ] FNB: Loaded 53226 existing records from primary storage. [2025-09-29T02:15:33.051235] [INFO ] [MAIN ] FNB: Loaded 53226 primary data records. [2025-09-29T02:15:33.077741] [DEBUG] [LOCAL ] FND: Loaded 52871 existing records from primary storage. [2025-09-29T02:15:33.084043] [INFO ] [MAIN ] FND: Loaded 52871 primary data records. [2025-09-29T02:15:33.803107] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:33.804439] [INFO ] [MAIN ] FN: Generated 1820 derivative records from 39795 primary records. [2025-09-29T02:15:33.804917] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-29T02:15:33.825884] [DEBUG] [LOCAL ] FN: Derivative data saved (1820 records). [2025-09-29T02:15:33.826742] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-29T02:15:33.829674] [INFO ] [MAIN ] Derivative Progress: 799/2211 symbols completed. FN took 1.3s. Estimated remaining: 9m 55s. Rate: 142.3 symbols/min [2025-09-29T02:15:33.830053] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:33.848773] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:33.849828] [INFO ] [MAIN ] FNB: Generated 1820 derivative records from 53226 primary records. [2025-09-29T02:15:33.850936] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-29T02:15:33.883766] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:33.884914] [DEBUG] [LOCAL ] FNB: Derivative data saved (1820 records). [2025-09-29T02:15:33.885984] [INFO ] [MAIN ] FND: Generated 1820 derivative records from 52871 primary records. [2025-09-29T02:15:33.886117] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-29T02:15:33.889460] [INFO ] [MAIN ] Derivative Progress: 800/2211 symbols completed. FNB took 1.3s. Estimated remaining: 9m 54s. Rate: 142.5 symbols/min [2025-09-29T02:15:33.889834] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:33.889725] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-29T02:15:33.910169] [DEBUG] [LOCAL ] FND: Derivative data saved (1820 records). [2025-09-29T02:15:33.922459] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-29T02:15:33.925988] [INFO ] [MAIN ] Derivative Progress: 801/2211 symbols completed. FND took 1.3s. Estimated remaining: 9m 53s. Rate: 142.6 symbols/min [2025-09-29T02:15:33.926345] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:33.950826] [DEBUG] [LOCAL ] FNF: Loaded 49871 existing records from primary storage. [2025-09-29T02:15:33.955574] [INFO ] [MAIN ] FNF: Loaded 49871 primary data records. [2025-09-29T02:15:34.061178] [DEBUG] [LOCAL ] FOA: Loaded 13484 existing records from primary storage. [2025-09-29T02:15:34.089551] [INFO ] [MAIN ] FOA: Loaded 13484 primary data records. [2025-09-29T02:15:34.273627] [DEBUG] [LOCAL ] FNV: Loaded 47028 existing records from primary storage. [2025-09-29T02:15:34.429923] [INFO ] [MAIN ] FNV: Loaded 47028 primary data records. [2025-09-29T02:15:35.065666] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:35.069635] [INFO ] [MAIN ] FNF: Generated 1820 derivative records from 49871 primary records. [2025-09-29T02:15:35.070087] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-29T02:15:35.084793] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:35.088849] [INFO ] [MAIN ] FOA: Generated 1820 derivative records from 13484 primary records. [2025-09-29T02:15:35.100972] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-29T02:15:35.107715] [DEBUG] [LOCAL ] FNF: Derivative data saved (1820 records). [2025-09-29T02:15:35.108489] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-29T02:15:35.132909] [INFO ] [MAIN ] Derivative Progress: 802/2211 symbols completed. FNF took 1.3s. Estimated remaining: 9m 54s. Rate: 142.3 symbols/min [2025-09-29T02:15:35.133499] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:35.138802] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:35.146171] [DEBUG] [LOCAL ] FOA: Derivative data saved (1820 records). [2025-09-29T02:15:35.144986] [INFO ] [MAIN ] FNV: Generated 1820 derivative records from 47028 primary records. [2025-09-29T02:15:35.146526] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-29T02:15:35.149766] [INFO ] [MAIN ] Derivative Progress: 803/2211 symbols completed. FOA took 1.2s. Estimated remaining: 9m 53s. Rate: 142.5 symbols/min [2025-09-29T02:15:35.150026] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:35.146850] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-29T02:15:35.177557] [DEBUG] [LOCAL ] FNV: Derivative data saved (1820 records). [2025-09-29T02:15:35.178343] [DEBUG] [LOCAL ] FOF: Loaded 8510 existing records from primary storage. [2025-09-29T02:15:35.178445] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-29T02:15:35.178578] [INFO ] [MAIN ] FOF: Loaded 8510 primary data records. [2025-09-29T02:15:35.181629] [INFO ] [MAIN ] Derivative Progress: 804/2211 symbols completed. FNV took 1.3s. Estimated remaining: 9m 52s. Rate: 142.6 symbols/min [2025-09-29T02:15:35.200768] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:35.295494] [DEBUG] [LOCAL ] FOR: Loaded 20362 existing records from primary storage. [2025-09-29T02:15:35.328758] [INFO ] [MAIN ] FOR: Loaded 20362 primary data records. [2025-09-29T02:15:35.980058] [DEBUG] [LOCAL ] FOUR: Loaded 50306 existing records from primary storage. [2025-09-29T02:15:35.994728] [INFO ] [MAIN ] FOUR: Loaded 50306 primary data records. [2025-09-29T02:15:36.374744] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:36.376395] [INFO ] [MAIN ] FOF: Generated 1820 derivative records from 8510 primary records. [2025-09-29T02:15:36.376670] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-29T02:15:36.399534] [DEBUG] [LOCAL ] FOF: Derivative data saved (1820 records). [2025-09-29T02:15:36.413330] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-29T02:15:36.413892] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:36.418249] [INFO ] [MAIN ] FOR: Generated 1820 derivative records from 20362 primary records. [2025-09-29T02:15:36.416685] [INFO ] [MAIN ] Derivative Progress: 805/2211 symbols completed. FOF took 1.3s. Estimated remaining: 9m 53s. Rate: 142.3 symbols/min [2025-09-29T02:15:36.418667] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-29T02:15:36.418864] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:36.439467] [DEBUG] [LOCAL ] FOR: Derivative data saved (1820 records). [2025-09-29T02:15:36.439931] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-29T02:15:36.443094] [INFO ] [MAIN ] Derivative Progress: 806/2211 symbols completed. FOR took 1.3s. Estimated remaining: 9m 52s. Rate: 142.4 symbols/min [2025-09-29T02:15:36.443337] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:36.483154] [DEBUG] [LOCAL ] FPF: Loaded 17998 existing records from primary storage. [2025-09-29T02:15:36.483396] [INFO ] [MAIN ] FPF: Loaded 17998 primary data records. [2025-09-29T02:15:36.489531] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:36.546118] [DEBUG] [LOCAL ] FPH: Loaded 19890 existing records from primary storage. [2025-09-29T02:15:36.547631] [INFO ] [MAIN ] FOUR: Generated 1820 derivative records from 50306 primary records. [2025-09-29T02:15:36.547959] [INFO ] [MAIN ] FPH: Loaded 19890 primary data records. [2025-09-29T02:15:36.581136] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-29T02:15:36.846601] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1820 records). [2025-09-29T02:15:36.866552] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-29T02:15:36.870080] [INFO ] [MAIN ] Derivative Progress: 807/2211 symbols completed. FOUR took 1.7s. Estimated remaining: 9m 51s. Rate: 142.4 symbols/min [2025-09-29T02:15:37.024595] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:37.262523] [DEBUG] [LOCAL ] FPI: Loaded 31525 existing records from primary storage. [2025-09-29T02:15:37.262988] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:37.276253] [INFO ] [MAIN ] FPI: Loaded 31525 primary data records. [2025-09-29T02:15:37.277229] [INFO ] [MAIN ] FPF: Generated 1820 derivative records from 17998 primary records. [2025-09-29T02:15:37.278126] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:37.278353] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-29T02:15:37.284361] [INFO ] [MAIN ] FPH: Generated 1820 derivative records from 19890 primary records. [2025-09-29T02:15:37.297472] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-29T02:15:37.372911] [DEBUG] [LOCAL ] FPF: Derivative data saved (1820 records). [2025-09-29T02:15:37.390744] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-29T02:15:37.408106] [INFO ] [MAIN ] Derivative Progress: 808/2211 symbols completed. FPF took 1.0s. Estimated remaining: 9m 51s. Rate: 142.4 symbols/min [2025-09-29T02:15:37.404974] [DEBUG] [LOCAL ] FPH: Derivative data saved (1820 records). [2025-09-29T02:15:37.422614] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-29T02:15:37.435610] [INFO ] [MAIN ] Derivative Progress: 809/2211 symbols completed. FPH took 1.0s. Estimated remaining: 9m 50s. Rate: 142.6 symbols/min [2025-09-29T02:15:37.669912] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:37.670689] [INFO ] [MAIN ] FPI: Generated 1820 derivative records from 31525 primary records. [2025-09-29T02:15:37.670777] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-29T02:15:37.687199] [DEBUG] [LOCAL ] FPI: Derivative data saved (1820 records). [2025-09-29T02:15:37.687371] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-29T02:15:37.690281] [INFO ] [MAIN ] Derivative Progress: 810/2211 symbols completed. FPI took 0.7s. Estimated remaining: 9m 49s. Rate: 142.6 symbols/min [2025-09-29T02:15:37.690929] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:37.691009] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:37.690858] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:37.723051] [DEBUG] [LOCAL ] FRA: Loaded 14717 existing records from primary storage. [2025-09-29T02:15:37.730368] [INFO ] [MAIN ] FRA: Loaded 14717 primary data records. [2025-09-29T02:15:37.730820] [DEBUG] [LOCAL ] FRGE: Loaded 18571 existing records from primary storage. [2025-09-29T02:15:37.742686] [INFO ] [MAIN ] FRGE: Loaded 18571 primary data records. [2025-09-29T02:15:38.062156] [DEBUG] [LOCAL ] FR: Loaded 47174 existing records from primary storage. [2025-09-29T02:15:38.135205] [INFO ] [MAIN ] FR: Loaded 47174 primary data records. [2025-09-29T02:15:38.892455] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:38.907385] [INFO ] [MAIN ] FRGE: Generated 1820 derivative records from 18571 primary records. [2025-09-29T02:15:38.908631] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:38.909501] [INFO ] [MAIN ] FRA: Generated 1820 derivative records from 14717 primary records. [2025-09-29T02:15:38.908258] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-29T02:15:38.909619] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-29T02:15:38.946206] [DEBUG] [LOCAL ] FRA: Derivative data saved (1820 records). [2025-09-29T02:15:38.948459] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1820 records). [2025-09-29T02:15:38.948923] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-29T02:15:38.948794] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-29T02:15:38.952097] [INFO ] [MAIN ] Derivative Progress: 811/2211 symbols completed. FRGE took 1.3s. Estimated remaining: 9m 50s. Rate: 142.3 symbols/min [2025-09-29T02:15:38.954912] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:38.955020] [INFO ] [MAIN ] Derivative Progress: 812/2211 symbols completed. FRA took 1.3s. Estimated remaining: 9m 49s. Rate: 142.5 symbols/min [2025-09-29T02:15:38.955602] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:38.974692] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:38.975397] [INFO ] [MAIN ] FR: Generated 1820 derivative records from 47174 primary records. [2025-09-29T02:15:38.975482] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-29T02:15:38.992537] [DEBUG] [LOCAL ] FR: Derivative data saved (1820 records). [2025-09-29T02:15:38.992828] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-29T02:15:38.996132] [INFO ] [MAIN ] Derivative Progress: 813/2211 symbols completed. FR took 1.3s. Estimated remaining: 9m 48s. Rate: 142.6 symbols/min [2025-09-29T02:15:38.996421] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:39.056911] [DEBUG] [LOCAL ] FRT: Loaded 42808 existing records from primary storage. [2025-09-29T02:15:39.068810] [INFO ] [MAIN ] FRT: Loaded 42808 primary data records. [2025-09-29T02:15:39.134502] [DEBUG] [LOCAL ] FRO: Loaded 52603 existing records from primary storage. [2025-09-29T02:15:39.186870] [INFO ] [MAIN ] FRO: Loaded 52603 primary data records. [2025-09-29T02:15:39.270332] [DEBUG] [LOCAL ] FSCO: Loaded 37725 existing records from primary storage. [2025-09-29T02:15:39.307694] [INFO ] [MAIN ] FSCO: Loaded 37725 primary data records. [2025-09-29T02:15:40.198934] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:40.213845] [INFO ] [MAIN ] FRT: Generated 1820 derivative records from 42808 primary records. [2025-09-29T02:15:40.212625] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:40.217196] [INFO ] [MAIN ] FRO: Generated 1820 derivative records from 52603 primary records. [2025-09-29T02:15:40.215362] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-29T02:15:40.217306] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-29T02:15:40.261885] [DEBUG] [LOCAL ] FRT: Derivative data saved (1820 records). [2025-09-29T02:15:40.267465] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:40.267759] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-29T02:15:40.267017] [DEBUG] [LOCAL ] FRO: Derivative data saved (1820 records). [2025-09-29T02:15:40.270865] [INFO ] [MAIN ] Derivative Progress: 814/2211 symbols completed. FRT took 1.3s. Estimated remaining: 9m 49s. Rate: 142.3 symbols/min [2025-09-29T02:15:40.272019] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-29T02:15:40.272127] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:40.272330] [INFO ] [MAIN ] FSCO: Generated 1820 derivative records from 37725 primary records. [2025-09-29T02:15:40.276192] [INFO ] [MAIN ] Derivative Progress: 815/2211 symbols completed. FRO took 1.3s. Estimated remaining: 9m 48s. Rate: 142.4 symbols/min [2025-09-29T02:15:40.277166] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:40.277034] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-29T02:15:40.296187] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1820 records). [2025-09-29T02:15:40.296331] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-29T02:15:40.299590] [INFO ] [MAIN ] Derivative Progress: 816/2211 symbols completed. FSCO took 1.3s. Estimated remaining: 9m 47s. Rate: 142.6 symbols/min [2025-09-29T02:15:40.300235] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:40.396854] [DEBUG] [LOCAL ] FSK: Loaded 50173 existing records from primary storage. [2025-09-29T02:15:40.397812] [DEBUG] [LOCAL ] FSLY: Loaded 51989 existing records from primary storage. [2025-09-29T02:15:40.399818] [INFO ] [MAIN ] FSK: Loaded 50173 primary data records. [2025-09-29T02:15:40.399890] [INFO ] [MAIN ] FSLY: Loaded 51989 primary data records. [2025-09-29T02:15:40.462168] [DEBUG] [LOCAL ] FSM: Loaded 54065 existing records from primary storage. [2025-09-29T02:15:40.553219] [INFO ] [MAIN ] FSM: Loaded 54065 primary data records. [2025-09-29T02:15:41.497399] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:41.501962] [INFO ] [MAIN ] FSK: Generated 1820 derivative records from 50173 primary records. [2025-09-29T02:15:41.502821] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-29T02:15:41.517637] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:41.519418] [INFO ] [MAIN ] FSLY: Generated 1820 derivative records from 51989 primary records. [2025-09-29T02:15:41.519922] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-29T02:15:41.550337] [DEBUG] [LOCAL ] FSK: Derivative data saved (1820 records). [2025-09-29T02:15:41.552319] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-29T02:15:41.560182] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1820 records). [2025-09-29T02:15:41.561347] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-29T02:15:41.557961] [INFO ] [MAIN ] Derivative Progress: 817/2211 symbols completed. FSK took 1.3s. Estimated remaining: 9m 48s. Rate: 142.2 symbols/min [2025-09-29T02:15:41.562047] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:41.565966] [INFO ] [MAIN ] Derivative Progress: 818/2211 symbols completed. FSLY took 1.3s. Estimated remaining: 9m 47s. Rate: 142.4 symbols/min [2025-09-29T02:15:41.567093] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:41.589242] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:41.590216] [INFO ] [MAIN ] FSM: Generated 1820 derivative records from 54065 primary records. [2025-09-29T02:15:41.590386] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-29T02:15:41.615310] [DEBUG] [LOCAL ] FSM: Derivative data saved (1820 records). [2025-09-29T02:15:41.615901] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-29T02:15:41.624463] [INFO ] [MAIN ] Derivative Progress: 819/2211 symbols completed. FSM took 1.3s. Estimated remaining: 9m 46s. Rate: 142.6 symbols/min [2025-09-29T02:15:41.624901] [DEBUG] [LOCAL ] FT: Loaded 6432 existing records from primary storage. [2025-09-29T02:15:41.625375] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:41.625834] [INFO ] [MAIN ] FT: Loaded 6432 primary data records. [2025-09-29T02:15:41.784575] [DEBUG] [LOCAL ] FTHY: Loaded 11947 existing records from primary storage. [2025-09-29T02:15:41.796388] [DEBUG] [LOCAL ] FSS: Loaded 34888 existing records from primary storage. [2025-09-29T02:15:41.812137] [INFO ] [MAIN ] FTHY: Loaded 11947 primary data records. [2025-09-29T02:15:41.845260] [INFO ] [MAIN ] FSS: Loaded 34888 primary data records. [2025-09-29T02:15:42.769556] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:42.771558] [INFO ] [MAIN ] FT: Generated 1820 derivative records from 6432 primary records. [2025-09-29T02:15:42.771735] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-29T02:15:42.791785] [DEBUG] [LOCAL ] FT: Derivative data saved (1820 records). [2025-09-29T02:15:42.791982] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-29T02:15:42.794041] [INFO ] [MAIN ] Derivative Progress: 820/2211 symbols completed. FT took 1.2s. Estimated remaining: 9m 47s. Rate: 142.3 symbols/min [2025-09-29T02:15:42.797826] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:42.815440] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:42.817053] [INFO ] [MAIN ] FTHY: Generated 1820 derivative records from 11947 primary records. [2025-09-29T02:15:42.817185] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-29T02:15:42.836727] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1820 records). [2025-09-29T02:15:42.836924] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-29T02:15:42.840852] [INFO ] [MAIN ] Derivative Progress: 821/2211 symbols completed. FTHY took 1.2s. Estimated remaining: 9m 46s. Rate: 142.4 symbols/min [2025-09-29T02:15:42.841273] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:42.857769] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:42.858707] [INFO ] [MAIN ] FSS: Generated 1820 derivative records from 34888 primary records. [2025-09-29T02:15:42.858871] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-29T02:15:42.879236] [DEBUG] [LOCAL ] FSS: Derivative data saved (1820 records). [2025-09-29T02:15:42.879471] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-29T02:15:42.883942] [INFO ] [MAIN ] Derivative Progress: 822/2211 symbols completed. FSS took 1.3s. Estimated remaining: 9m 45s. Rate: 142.6 symbols/min [2025-09-29T02:15:42.884218] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:42.931309] [DEBUG] [LOCAL ] FTK: Loaded 32755 existing records from primary storage. [2025-09-29T02:15:42.947226] [INFO ] [MAIN ] FTK: Loaded 32755 primary data records. [2025-09-29T02:15:42.960844] [DEBUG] [LOCAL ] FTI: Loaded 54078 existing records from primary storage. [2025-09-29T02:15:42.988051] [INFO ] [MAIN ] FTI: Loaded 54078 primary data records. [2025-09-29T02:15:43.332800] [DEBUG] [LOCAL ] FTS: Loaded 42695 existing records from primary storage. [2025-09-29T02:15:43.474996] [INFO ] [MAIN ] FTS: Loaded 42695 primary data records. [2025-09-29T02:15:44.075744] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:44.077438] [INFO ] [MAIN ] FTK: Generated 1820 derivative records from 32755 primary records. [2025-09-29T02:15:44.078624] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-29T02:15:44.095038] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:44.112709] [DEBUG] [LOCAL ] FTK: Derivative data saved (1820 records). [2025-09-29T02:15:44.108377] [INFO ] [MAIN ] FTI: Generated 1820 derivative records from 54078 primary records. [2025-09-29T02:15:44.113103] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-29T02:15:44.113245] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-29T02:15:44.116903] [INFO ] [MAIN ] Derivative Progress: 823/2211 symbols completed. FTK took 1.3s. Estimated remaining: 9m 46s. Rate: 142.2 symbols/min [2025-09-29T02:15:44.135551] [DEBUG] [LOCAL ] FTI: Derivative data saved (1820 records). [2025-09-29T02:15:44.135851] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-29T02:15:44.139884] [INFO ] [MAIN ] Derivative Progress: 824/2211 symbols completed. FTI took 1.3s. Estimated remaining: 9m 44s. Rate: 142.4 symbols/min [2025-09-29T02:15:44.160031] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:44.160831] [INFO ] [MAIN ] FTS: Generated 1820 derivative records from 42695 primary records. [2025-09-29T02:15:44.160931] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-29T02:15:44.177028] [DEBUG] [LOCAL ] FTS: Derivative data saved (1820 records). [2025-09-29T02:15:44.177181] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-29T02:15:44.181437] [INFO ] [MAIN ] Derivative Progress: 825/2211 symbols completed. FTS took 1.3s. Estimated remaining: 9m 43s. Rate: 142.6 symbols/min [2025-09-29T02:15:44.182168] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:44.181974] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:44.182062] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:44.189029] [DEBUG] [LOCAL ] FTWO: Loaded 1837 existing records from primary storage. [2025-09-29T02:15:44.189408] [INFO ] [MAIN ] FTWO: Loaded 1837 primary data records. [2025-09-29T02:15:44.591128] [DEBUG] [LOCAL ] FUBO: Loaded 54476 existing records from primary storage. [2025-09-29T02:15:44.591693] [INFO ] [MAIN ] FUBO: Loaded 54476 primary data records. [2025-09-29T02:15:44.737214] [DEBUG] [LOCAL ] FTV: Loaded 53686 existing records from primary storage. [2025-09-29T02:15:44.750600] [INFO ] [MAIN ] FTV: Loaded 53686 primary data records. [2025-09-29T02:15:45.364943] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:45.366130] [INFO ] [MAIN ] FTWO: Generated 1819 derivative records from 1837 primary records. [2025-09-29T02:15:45.366267] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-29T02:15:45.383895] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1819 records). [2025-09-29T02:15:45.384401] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-29T02:15:45.387287] [INFO ] [MAIN ] Derivative Progress: 826/2211 symbols completed. FTWO took 1.2s. Estimated remaining: 9m 44s. Rate: 142.2 symbols/min [2025-09-29T02:15:45.387972] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:45.420025] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:45.421239] [INFO ] [MAIN ] FUBO: Generated 1820 derivative records from 54476 primary records. [2025-09-29T02:15:45.443361] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:45.434184] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-29T02:15:45.444407] [INFO ] [MAIN ] FTV: Generated 1820 derivative records from 53686 primary records. [2025-09-29T02:15:45.445481] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-29T02:15:45.486372] [DEBUG] [LOCAL ] FUL: Loaded 33570 existing records from primary storage. [2025-09-29T02:15:45.486845] [INFO ] [MAIN ] FUL: Loaded 33570 primary data records. [2025-09-29T02:15:45.487950] [DEBUG] [LOCAL ] FTV: Derivative data saved (1820 records). [2025-09-29T02:15:45.525687] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-29T02:15:45.525545] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1820 records). [2025-09-29T02:15:45.592112] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-29T02:15:45.607494] [INFO ] [MAIN ] Derivative Progress: 827/2211 symbols completed. FTV took 1.4s. Estimated remaining: 9m 43s. Rate: 142.3 symbols/min [2025-09-29T02:15:45.621922] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:45.622088] [INFO ] [MAIN ] Derivative Progress: 828/2211 symbols completed. FUBO took 1.4s. Estimated remaining: 9m 42s. Rate: 142.5 symbols/min [2025-09-29T02:15:45.633154] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:45.864507] [DEBUG] [LOCAL ] FVR: Loaded 22328 existing records from primary storage. [2025-09-29T02:15:45.879786] [INFO ] [MAIN ] FVR: Loaded 22328 primary data records. [2025-09-29T02:15:46.021928] [DEBUG] [LOCAL ] FUN: Loaded 52349 existing records from primary storage. [2025-09-29T02:15:46.038807] [INFO ] [MAIN ] FUN: Loaded 52349 primary data records. [2025-09-29T02:15:46.296551] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:46.343619] [INFO ] [MAIN ] FUL: Generated 1820 derivative records from 33570 primary records. [2025-09-29T02:15:46.357569] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-29T02:15:46.453768] [DEBUG] [LOCAL ] FUL: Derivative data saved (1820 records). [2025-09-29T02:15:46.495554] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-29T02:15:46.610522] [INFO ] [MAIN ] Derivative Progress: 829/2211 symbols completed. FUL took 1.2s. Estimated remaining: 9m 43s. Rate: 142.2 symbols/min [2025-09-29T02:15:46.626719] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:46.654431] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:46.656444] [INFO ] [MAIN ] FVR: Generated 1820 derivative records from 22328 primary records. [2025-09-29T02:15:46.656878] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-29T02:15:46.687356] [DEBUG] [LOCAL ] FVR: Derivative data saved (1820 records). [2025-09-29T02:15:46.687847] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-29T02:15:46.690706] [INFO ] [MAIN ] Derivative Progress: 830/2211 symbols completed. FVR took 1.1s. Estimated remaining: 9m 42s. Rate: 142.4 symbols/min [2025-09-29T02:15:46.691337] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:46.724775] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:46.727422] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-09-29T02:15:46.729155] [INFO ] [MAIN ] FUN: Generated 1820 derivative records from 52349 primary records. [2025-09-29T02:15:46.729380] [INFO ] [MAIN ] FXED: Loaded 1259 primary data records. [2025-09-29T02:15:46.729614] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-29T02:15:46.745713] [DEBUG] [LOCAL ] FVRR: Loaded 40749 existing records from primary storage. [2025-09-29T02:15:46.768707] [INFO ] [MAIN ] FVRR: Loaded 40749 primary data records. [2025-09-29T02:15:46.909585] [DEBUG] [LOCAL ] FUN: Derivative data saved (1820 records). [2025-09-29T02:15:46.932619] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-29T02:15:46.973029] [INFO ] [MAIN ] Derivative Progress: 831/2211 symbols completed. FUN took 1.4s. Estimated remaining: 9m 41s. Rate: 142.4 symbols/min [2025-09-29T02:15:47.026545] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:47.548976] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:47.550141] [INFO ] [MAIN ] FXED: Generated 1819 derivative records from 1259 primary records. [2025-09-29T02:15:47.553216] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-29T02:15:47.586244] [DEBUG] [LOCAL ] G: Loaded 50547 existing records from primary storage. [2025-09-29T02:15:47.587269] [INFO ] [MAIN ] G: Loaded 50547 primary data records. [2025-09-29T02:15:47.589610] [DEBUG] [LOCAL ] FXED: Derivative data saved (1819 records). [2025-09-29T02:15:47.613385] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-29T02:15:47.677931] [INFO ] [MAIN ] Derivative Progress: 832/2211 symbols completed. FXED took 1.0s. Estimated remaining: 9m 41s. Rate: 142.3 symbols/min [2025-09-29T02:15:47.710568] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:47.780633] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:47.816946] [INFO ] [MAIN ] FVRR: Generated 1820 derivative records from 40749 primary records. [2025-09-29T02:15:47.945718] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-29T02:15:47.978966] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1820 records). [2025-09-29T02:15:47.989436] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-29T02:15:47.993839] [DEBUG] [LOCAL ] GAB: Loaded 28493 existing records from primary storage. [2025-09-29T02:15:47.994051] [INFO ] [MAIN ] GAB: Loaded 28493 primary data records. [2025-09-29T02:15:47.992451] [INFO ] [MAIN ] Derivative Progress: 833/2211 symbols completed. FVRR took 1.4s. Estimated remaining: 9m 41s. Rate: 142.4 symbols/min [2025-09-29T02:15:47.994517] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:48.137915] [DEBUG] [LOCAL ] GAM: Loaded 4174 existing records from primary storage. [2025-09-29T02:15:48.181191] [INFO ] [MAIN ] GAM: Loaded 4174 primary data records. [2025-09-29T02:15:48.485543] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:48.506185] [INFO ] [MAIN ] G: Generated 1820 derivative records from 50547 primary records. [2025-09-29T02:15:48.513287] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-29T02:15:48.650953] [DEBUG] [LOCAL ] G: Derivative data saved (1820 records). [2025-09-29T02:15:48.745076] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-29T02:15:48.749069] [INFO ] [MAIN ] Derivative Progress: 834/2211 symbols completed. G took 1.7s. Estimated remaining: 9m 41s. Rate: 142.2 symbols/min [2025-09-29T02:15:48.749413] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:48.773123] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:48.775169] [INFO ] [MAIN ] GAB: Generated 1820 derivative records from 28493 primary records. [2025-09-29T02:15:48.775311] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-29T02:15:48.795521] [DEBUG] [LOCAL ] GAB: Derivative data saved (1820 records). [2025-09-29T02:15:48.795717] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-29T02:15:48.798454] [INFO ] [MAIN ] Derivative Progress: 835/2211 symbols completed. GAB took 1.1s. Estimated remaining: 9m 40s. Rate: 142.4 symbols/min [2025-09-29T02:15:48.799050] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:48.823214] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:48.841203] [INFO ] [MAIN ] GAM: Generated 1820 derivative records from 4174 primary records. [2025-09-29T02:15:48.841699] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-29T02:15:48.864457] [DEBUG] [LOCAL ] GAM: Derivative data saved (1820 records). [2025-09-29T02:15:48.872323] [DEBUG] [LOCAL ] GATX: Loaded 18437 existing records from primary storage. [2025-09-29T02:15:48.889691] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-29T02:15:48.893128] [INFO ] [MAIN ] Derivative Progress: 836/2211 symbols completed. GAM took 0.9s. Estimated remaining: 9m 39s. Rate: 142.5 symbols/min [2025-09-29T02:15:48.894839] [DEBUG] [LOCAL ] GAP: Loaded 54435 existing records from primary storage. [2025-09-29T02:15:48.895054] [INFO ] [MAIN ] GAP: Loaded 54435 primary data records. [2025-09-29T02:15:48.895380] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:48.895173] [INFO ] [MAIN ] GATX: Loaded 18437 primary data records. [2025-09-29T02:15:49.131022] [DEBUG] [LOCAL ] GBAB: Loaded 13142 existing records from primary storage. [2025-09-29T02:15:49.153243] [INFO ] [MAIN ] GBAB: Loaded 13142 primary data records. [2025-09-29T02:15:50.009673] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:50.013456] [INFO ] [MAIN ] GATX: Generated 1820 derivative records from 18437 primary records. [2025-09-29T02:15:50.013860] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-29T02:15:50.029497] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:50.039563] [INFO ] [MAIN ] GAP: Generated 1820 derivative records from 54435 primary records. [2025-09-29T02:15:50.050790] [DEBUG] [LOCAL ] GATX: Derivative data saved (1820 records). [2025-09-29T02:15:50.051326] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-29T02:15:50.051537] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-29T02:15:50.054440] [INFO ] [MAIN ] Derivative Progress: 837/2211 symbols completed. GATX took 1.3s. Estimated remaining: 9m 40s. Rate: 142.2 symbols/min [2025-09-29T02:15:50.077683] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:50.069224] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:50.086241] [INFO ] [MAIN ] GBAB: Generated 1820 derivative records from 13142 primary records. [2025-09-29T02:15:50.086500] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-29T02:15:50.090033] [DEBUG] [LOCAL ] GAP: Derivative data saved (1820 records). [2025-09-29T02:15:50.099186] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-29T02:15:50.102009] [INFO ] [MAIN ] Derivative Progress: 838/2211 symbols completed. GAP took 1.4s. Estimated remaining: 9m 39s. Rate: 142.4 symbols/min [2025-09-29T02:15:50.111691] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1820 records). [2025-09-29T02:15:50.111869] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-29T02:15:50.115183] [INFO ] [MAIN ] Derivative Progress: 839/2211 symbols completed. GBAB took 1.2s. Estimated remaining: 9m 38s. Rate: 142.5 symbols/min [2025-09-29T02:15:50.155220] [DEBUG] [LOCAL ] GBCI: Loaded 40720 existing records from primary storage. [2025-09-29T02:15:50.155413] [INFO ] [MAIN ] GBCI: Loaded 40720 primary data records. [2025-09-29T02:15:50.500892] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:50.501712] [INFO ] [MAIN ] GBCI: Generated 1820 derivative records from 40720 primary records. [2025-09-29T02:15:50.501799] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-29T02:15:50.517397] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1820 records). [2025-09-29T02:15:50.517487] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-29T02:15:50.520264] [INFO ] [MAIN ] Derivative Progress: 840/2211 symbols completed. GBCI took 0.5s. Estimated remaining: 9m 37s. Rate: 142.5 symbols/min [2025-09-29T02:15:50.520740] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:50.520865] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:50.521016] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:50.578542] [DEBUG] [LOCAL ] GBX: Loaded 29497 existing records from primary storage. [2025-09-29T02:15:50.580423] [INFO ] [MAIN ] GBX: Loaded 29497 primary data records. [2025-09-29T02:15:50.644275] [DEBUG] [LOCAL ] GBTG: Loaded 40807 existing records from primary storage. [2025-09-29T02:15:50.691430] [DEBUG] [LOCAL ] GCI: Loaded 44828 existing records from primary storage. [2025-09-29T02:15:50.722071] [INFO ] [MAIN ] GBTG: Loaded 40807 primary data records. [2025-09-29T02:15:50.722180] [INFO ] [MAIN ] GCI: Loaded 44828 primary data records. [2025-09-29T02:15:51.698954] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:51.700149] [INFO ] [MAIN ] GBX: Generated 1820 derivative records from 29497 primary records. [2025-09-29T02:15:51.700434] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-29T02:15:51.735203] [DEBUG] [LOCAL ] GBX: Derivative data saved (1820 records). [2025-09-29T02:15:51.735955] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:51.736085] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-29T02:15:51.737474] [INFO ] [MAIN ] GCI: Generated 1820 derivative records from 44828 primary records. [2025-09-29T02:15:51.741336] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-29T02:15:51.741060] [INFO ] [MAIN ] Derivative Progress: 841/2211 symbols completed. GBX took 1.2s. Estimated remaining: 9m 38s. Rate: 142.2 symbols/min [2025-09-29T02:15:51.742920] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:51.768276] [DEBUG] [LOCAL ] GCI: Derivative data saved (1820 records). [2025-09-29T02:15:51.768688] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-29T02:15:51.771748] [INFO ] [MAIN ] Derivative Progress: 842/2211 symbols completed. GCI took 1.3s. Estimated remaining: 9m 37s. Rate: 142.4 symbols/min [2025-09-29T02:15:51.785370] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:51.786339] [INFO ] [MAIN ] GBTG: Generated 1820 derivative records from 40807 primary records. [2025-09-29T02:15:51.786526] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-29T02:15:51.785539] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:51.811559] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1820 records). [2025-09-29T02:15:51.811937] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-29T02:15:51.815759] [INFO ] [MAIN ] Derivative Progress: 843/2211 symbols completed. GBTG took 1.3s. Estimated remaining: 9m 36s. Rate: 142.5 symbols/min [2025-09-29T02:15:51.816033] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:51.833469] [DEBUG] [LOCAL ] GCO: Loaded 25686 existing records from primary storage. [2025-09-29T02:15:51.834071] [INFO ] [MAIN ] GCO: Loaded 25686 primary data records. [2025-09-29T02:15:51.900067] [DEBUG] [LOCAL ] GCV: Loaded 7333 existing records from primary storage. [2025-09-29T02:15:51.923099] [INFO ] [MAIN ] GCV: Loaded 7333 primary data records. [2025-09-29T02:15:51.931213] [DEBUG] [LOCAL ] GCTS: Loaded 20060 existing records from primary storage. [2025-09-29T02:15:51.968230] [INFO ] [MAIN ] GCTS: Loaded 20060 primary data records. [2025-09-29T02:15:52.860962] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:52.862325] [INFO ] [MAIN ] GCO: Generated 1820 derivative records from 25686 primary records. [2025-09-29T02:15:52.863257] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-29T02:15:52.882513] [DEBUG] [LOCAL ] GCO: Derivative data saved (1820 records). [2025-09-29T02:15:52.882986] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-29T02:15:52.885875] [INFO ] [MAIN ] Derivative Progress: 844/2211 symbols completed. GCO took 1.1s. Estimated remaining: 9m 37s. Rate: 142.3 symbols/min [2025-09-29T02:15:52.887312] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:52.920244] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:52.919792] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:52.921886] [INFO ] [MAIN ] GCTS: Generated 1820 derivative records from 20060 primary records. [2025-09-29T02:15:52.921163] [INFO ] [MAIN ] GCV: Generated 1820 derivative records from 7333 primary records. [2025-09-29T02:15:52.922022] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-29T02:15:52.922115] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-29T02:15:52.950685] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1820 records). [2025-09-29T02:15:52.954842] [DEBUG] [LOCAL ] GCV: Derivative data saved (1820 records). [2025-09-29T02:15:52.955121] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-29T02:15:52.954957] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-29T02:15:52.958335] [INFO ] [MAIN ] Derivative Progress: 845/2211 symbols completed. GCTS took 1.2s. Estimated remaining: 9m 36s. Rate: 142.4 symbols/min [2025-09-29T02:15:52.961481] [INFO ] [MAIN ] Derivative Progress: 846/2211 symbols completed. GCV took 1.1s. Estimated remaining: 9m 34s. Rate: 142.6 symbols/min [2025-09-29T02:15:52.961711] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:52.958714] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:52.970578] [DEBUG] [LOCAL ] GDIV: Loaded 3724 existing records from primary storage. [2025-09-29T02:15:52.970805] [INFO ] [MAIN ] GDIV: Loaded 3724 primary data records. [2025-09-29T02:15:53.388780] [DEBUG] [LOCAL ] GD: Loaded 47940 existing records from primary storage. [2025-09-29T02:15:53.400855] [INFO ] [MAIN ] GD: Loaded 47940 primary data records. [2025-09-29T02:15:53.534310] [DEBUG] [LOCAL ] GDDY: Loaded 50449 existing records from primary storage. [2025-09-29T02:15:53.592728] [INFO ] [MAIN ] GDDY: Loaded 50449 primary data records. [2025-09-29T02:15:53.888461] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:53.889585] [INFO ] [MAIN ] GDIV: Generated 1819 derivative records from 3724 primary records. [2025-09-29T02:15:53.889719] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-29T02:15:54.201936] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1819 records). [2025-09-29T02:15:54.231632] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-29T02:15:54.250994] [INFO ] [MAIN ] Derivative Progress: 847/2211 symbols completed. GDIV took 1.3s. Estimated remaining: 9m 35s. Rate: 142.2 symbols/min [2025-09-29T02:15:54.274844] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:54.470565] [DEBUG] [LOCAL ] GDL: Loaded 2572 existing records from primary storage. [2025-09-29T02:15:54.471555] [INFO ] [MAIN ] GDL: Loaded 2572 primary data records. [2025-09-29T02:15:54.677020] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:54.820854] [INFO ] [MAIN ] GD: Generated 1820 derivative records from 47940 primary records. [2025-09-29T02:15:54.835984] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-29T02:15:54.858171] [DEBUG] [LOCAL ] GD: Derivative data saved (1820 records). [2025-09-29T02:15:54.859067] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-29T02:15:54.864189] [INFO ] [MAIN ] Derivative Progress: 848/2211 symbols completed. GD took 2.0s. Estimated remaining: 9m 35s. Rate: 142.2 symbols/min [2025-09-29T02:15:54.866097] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:54.882410] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:54.883439] [INFO ] [MAIN ] GDDY: Generated 1820 derivative records from 50449 primary records. [2025-09-29T02:15:54.883958] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-29T02:15:54.902956] [DEBUG] [LOCAL ] GDO: Loaded 6076 existing records from primary storage. [2025-09-29T02:15:54.903785] [INFO ] [MAIN ] GDO: Loaded 6076 primary data records. [2025-09-29T02:15:55.016347] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1820 records). [2025-09-29T02:15:55.037110] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-29T02:15:55.033008] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:55.040768] [INFO ] [MAIN ] Derivative Progress: 849/2211 symbols completed. GDDY took 2.1s. Estimated remaining: 9m 34s. Rate: 142.3 symbols/min [2025-09-29T02:15:55.041006] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:55.042226] [INFO ] [MAIN ] GDL: Generated 1819 derivative records from 2572 primary records. [2025-09-29T02:15:55.043299] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-29T02:15:55.281183] [DEBUG] [LOCAL ] GDL: Derivative data saved (1819 records). [2025-09-29T02:15:55.281531] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-29T02:15:55.285005] [INFO ] [MAIN ] Derivative Progress: 850/2211 symbols completed. GDL took 1.0s. Estimated remaining: 9m 34s. Rate: 142.3 symbols/min [2025-09-29T02:15:55.285525] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:55.327575] [DEBUG] [LOCAL ] GDV: Loaded 19971 existing records from primary storage. [2025-09-29T02:15:55.339367] [INFO ] [MAIN ] GDV: Loaded 19971 primary data records. [2025-09-29T02:15:55.360757] [DEBUG] [LOCAL ] GDOT: Loaded 39279 existing records from primary storage. [2025-09-29T02:15:55.406904] [INFO ] [MAIN ] GDOT: Loaded 39279 primary data records. [2025-09-29T02:15:55.682260] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:55.835224] [INFO ] [MAIN ] GDO: Generated 1820 derivative records from 6076 primary records. [2025-09-29T02:15:55.853833] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-29T02:15:56.114915] [DEBUG] [LOCAL ] GDO: Derivative data saved (1820 records). [2025-09-29T02:15:56.115128] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-29T02:15:56.117422] [INFO ] [MAIN ] Derivative Progress: 851/2211 symbols completed. GDO took 1.3s. Estimated remaining: 9m 34s. Rate: 142.2 symbols/min [2025-09-29T02:15:56.117835] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:56.152698] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:56.154859] [INFO ] [MAIN ] GDV: Generated 1820 derivative records from 19971 primary records. [2025-09-29T02:15:56.155242] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-29T02:15:56.173789] [DEBUG] [LOCAL ] GDV: Derivative data saved (1820 records). [2025-09-29T02:15:56.174215] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-29T02:15:56.177429] [INFO ] [MAIN ] Derivative Progress: 852/2211 symbols completed. GDV took 0.9s. Estimated remaining: 9m 33s. Rate: 142.3 symbols/min [2025-09-29T02:15:56.178081] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:56.212631] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:56.214909] [INFO ] [MAIN ] GDOT: Generated 1820 derivative records from 39279 primary records. [2025-09-29T02:15:56.215085] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-29T02:15:56.240997] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1820 records). [2025-09-29T02:15:56.257835] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-29T02:15:56.261735] [INFO ] [MAIN ] Derivative Progress: 853/2211 symbols completed. GDOT took 1.2s. Estimated remaining: 9m 32s. Rate: 142.4 symbols/min [2025-09-29T02:15:56.277086] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-09-29T02:15:56.277953] [DEBUG] [LOCAL ] GEF: Loaded 20965 existing records from primary storage. [2025-09-29T02:15:56.278106] [INFO ] [MAIN ] GE: Loaded 54493 primary data records. [2025-09-29T02:15:56.278340] [INFO ] [MAIN ] GEF: Loaded 20965 primary data records. [2025-09-29T02:15:56.987860] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:56.988522] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:56.989399] [INFO ] [MAIN ] GE: Generated 1820 derivative records from 54493 primary records. [2025-09-29T02:15:56.989504] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-29T02:15:56.990204] [INFO ] [MAIN ] GEF: Generated 1820 derivative records from 20965 primary records. [2025-09-29T02:15:56.990312] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-29T02:15:57.028387] [DEBUG] [LOCAL ] GEF: Derivative data saved (1820 records). [2025-09-29T02:15:57.030722] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-29T02:15:57.030543] [DEBUG] [LOCAL ] GE: Derivative data saved (1820 records). [2025-09-29T02:15:57.033818] [INFO ] [MAIN ] Derivative Progress: 854/2211 symbols completed. GEF took 0.9s. Estimated remaining: 9m 32s. Rate: 142.3 symbols/min [2025-09-29T02:15:57.034236] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-29T02:15:57.038689] [INFO ] [MAIN ] Derivative Progress: 855/2211 symbols completed. GE took 0.9s. Estimated remaining: 9m 31s. Rate: 142.5 symbols/min [2025-09-29T02:15:57.039203] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:57.039339] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:57.039814] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:57.106082] [DEBUG] [LOCAL ] GEL: Loaded 34252 existing records from primary storage. [2025-09-29T02:15:57.106498] [INFO ] [MAIN ] GEL: Loaded 34252 primary data records. [2025-09-29T02:15:57.360438] [DEBUG] [LOCAL ] GENI: Loaded 53679 existing records from primary storage. [2025-09-29T02:15:57.502955] [INFO ] [MAIN ] GENI: Loaded 53679 primary data records. [2025-09-29T02:15:57.502843] [DEBUG] [LOCAL ] GEO: Loaded 52812 existing records from primary storage. [2025-09-29T02:15:57.513741] [INFO ] [MAIN ] GEO: Loaded 52812 primary data records. [2025-09-29T02:15:58.362005] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:58.364001] [INFO ] [MAIN ] GEL: Generated 1820 derivative records from 34252 primary records. [2025-09-29T02:15:58.364327] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-29T02:15:58.384203] [DEBUG] [LOCAL ] GEL: Derivative data saved (1820 records). [2025-09-29T02:15:58.384761] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-29T02:15:58.387750] [INFO ] [MAIN ] Derivative Progress: 856/2211 symbols completed. GEL took 1.3s. Estimated remaining: 9m 32s. Rate: 142.1 symbols/min [2025-09-29T02:15:58.388381] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:58.427705] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:58.428936] [INFO ] [MAIN ] GENI: Generated 1820 derivative records from 53679 primary records. [2025-09-29T02:15:58.428062] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:58.430443] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-29T02:15:58.430324] [INFO ] [MAIN ] GEO: Generated 1820 derivative records from 52812 primary records. [2025-09-29T02:15:58.431675] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-29T02:15:58.467289] [DEBUG] [LOCAL ] GENI: Derivative data saved (1820 records). [2025-09-29T02:15:58.468879] [DEBUG] [LOCAL ] GEO: Derivative data saved (1820 records). [2025-09-29T02:15:58.478025] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-29T02:15:58.481296] [INFO ] [MAIN ] Derivative Progress: 857/2211 symbols completed. GENI took 1.4s. Estimated remaining: 9m 31s. Rate: 142.2 symbols/min [2025-09-29T02:15:58.477884] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-29T02:15:58.485108] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:58.485400] [INFO ] [MAIN ] Derivative Progress: 858/2211 symbols completed. GEO took 1.4s. Estimated remaining: 9m 30s. Rate: 142.4 symbols/min [2025-09-29T02:15:58.486010] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:58.511923] [DEBUG] [LOCAL ] GES: Loaded 40424 existing records from primary storage. [2025-09-29T02:15:58.512335] [INFO ] [MAIN ] GES: Loaded 40424 primary data records. [2025-09-29T02:15:58.755688] [DEBUG] [LOCAL ] GETY: Loaded 36378 existing records from primary storage. [2025-09-29T02:15:58.894850] [INFO ] [MAIN ] GETY: Loaded 36378 primary data records. [2025-09-29T02:15:59.018753] [DEBUG] [LOCAL ] GEV: Loaded 53878 existing records from primary storage. [2025-09-29T02:15:59.038884] [INFO ] [MAIN ] GEV: Loaded 53878 primary data records. [2025-09-29T02:15:59.643523] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:59.646404] [INFO ] [MAIN ] GES: Generated 1820 derivative records from 40424 primary records. [2025-09-29T02:15:59.650883] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-29T02:15:59.672728] [DEBUG] [LOCAL ] GES: Derivative data saved (1820 records). [2025-09-29T02:15:59.673911] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-29T02:15:59.678030] [INFO ] [MAIN ] Derivative Progress: 859/2211 symbols completed. GES took 1.3s. Estimated remaining: 9m 31s. Rate: 142.1 symbols/min [2025-09-29T02:15:59.678309] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:59.689877] [DEBUG] [LOCAL ] GF: Loaded 3220 existing records from primary storage. [2025-09-29T02:15:59.704626] [INFO ] [MAIN ] GF: Loaded 3220 primary data records. [2025-09-29T02:15:59.705169] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:59.719122] [INFO ] [MAIN ] GETY: Generated 1820 derivative records from 36378 primary records. [2025-09-29T02:15:59.755365] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-29T02:15:59.915745] [DEBUG] [LOCAL ] GETY: Derivative data saved (1820 records). [2025-09-29T02:15:59.927767] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:59.963755] [INFO ] [MAIN ] GEV: Generated 1820 derivative records from 53878 primary records. [2025-09-29T02:15:59.964155] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-29T02:15:59.955038] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-29T02:15:59.967315] [INFO ] [MAIN ] Derivative Progress: 860/2211 symbols completed. GETY took 1.5s. Estimated remaining: 9m 30s. Rate: 142.1 symbols/min [2025-09-29T02:15:59.997718] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:00.230691] [DEBUG] [LOCAL ] GEV: Derivative data saved (1820 records). [2025-09-29T02:16:00.233567] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-29T02:16:00.236487] [INFO ] [MAIN ] Derivative Progress: 861/2211 symbols completed. GEV took 1.8s. Estimated remaining: 9m 30s. Rate: 142.2 symbols/min [2025-09-29T02:16:00.236989] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:00.277602] [DEBUG] [LOCAL ] GFF: Loaded 31088 existing records from primary storage. [2025-09-29T02:16:00.278389] [INFO ] [MAIN ] GFF: Loaded 31088 primary data records. [2025-09-29T02:16:00.298029] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:00.338258] [INFO ] [MAIN ] GF: Generated 1820 derivative records from 3220 primary records. [2025-09-29T02:16:00.421869] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-29T02:16:00.570732] [DEBUG] [LOCAL ] GFI: Loaded 53887 existing records from primary storage. [2025-09-29T02:16:00.607023] [INFO ] [MAIN ] GFI: Loaded 53887 primary data records. [2025-09-29T02:16:00.719197] [DEBUG] [LOCAL ] GF: Derivative data saved (1820 records). [2025-09-29T02:16:00.725029] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-29T02:16:00.761119] [INFO ] [MAIN ] Derivative Progress: 862/2211 symbols completed. GF took 1.1s. Estimated remaining: 9m 29s. Rate: 142.2 symbols/min [2025-09-29T02:16:00.802257] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:01.168549] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:01.184952] [INFO ] [MAIN ] GFF: Generated 1820 derivative records from 31088 primary records. [2025-09-29T02:16:01.187188] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-29T02:16:01.189205] [DEBUG] [LOCAL ] GFL: Loaded 48755 existing records from primary storage. [2025-09-29T02:16:01.199473] [INFO ] [MAIN ] GFL: Loaded 48755 primary data records. [2025-09-29T02:16:01.209230] [DEBUG] [LOCAL ] GFF: Derivative data saved (1820 records). [2025-09-29T02:16:01.241201] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-29T02:16:01.292710] [INFO ] [MAIN ] Derivative Progress: 863/2211 symbols completed. GFF took 1.3s. Estimated remaining: 9m 29s. Rate: 142.1 symbols/min [2025-09-29T02:16:01.318365] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:01.450739] [DEBUG] [LOCAL ] GFR: Loaded 8572 existing records from primary storage. [2025-09-29T02:16:01.611833] [INFO ] [MAIN ] GFR: Loaded 8572 primary data records. [2025-09-29T02:16:01.625408] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:01.634533] [INFO ] [MAIN ] GFI: Generated 1820 derivative records from 53887 primary records. [2025-09-29T02:16:01.689730] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-29T02:16:02.009289] [DEBUG] [LOCAL ] GFI: Derivative data saved (1820 records). [2025-09-29T02:16:02.009589] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-29T02:16:02.015347] [INFO ] [MAIN ] Derivative Progress: 864/2211 symbols completed. GFI took 1.8s. Estimated remaining: 9m 29s. Rate: 142.0 symbols/min [2025-09-29T02:16:02.016124] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:02.039527] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:02.040987] [INFO ] [MAIN ] GFL: Generated 1820 derivative records from 48755 primary records. [2025-09-29T02:16:02.041250] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-29T02:16:02.064781] [DEBUG] [LOCAL ] GFL: Derivative data saved (1820 records). [2025-09-29T02:16:02.065157] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-29T02:16:02.068442] [INFO ] [MAIN ] Derivative Progress: 865/2211 symbols completed. GFL took 1.3s. Estimated remaining: 9m 28s. Rate: 142.1 symbols/min [2025-09-29T02:16:02.068733] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:02.089028] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:02.090271] [INFO ] [MAIN ] GFR: Generated 1820 derivative records from 8572 primary records. [2025-09-29T02:16:02.107486] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-29T02:16:02.128220] [DEBUG] [LOCAL ] GFR: Derivative data saved (1820 records). [2025-09-29T02:16:02.145423] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-29T02:16:02.148808] [INFO ] [MAIN ] Derivative Progress: 866/2211 symbols completed. GFR took 0.8s. Estimated remaining: 9m 27s. Rate: 142.3 symbols/min [2025-09-29T02:16:02.150504] [DEBUG] [LOCAL ] GGB: Loaded 51813 existing records from primary storage. [2025-09-29T02:16:02.150952] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:02.151034] [INFO ] [MAIN ] GGB: Loaded 51813 primary data records. [2025-09-29T02:16:02.287220] [DEBUG] [LOCAL ] GGG: Loaded 41580 existing records from primary storage. [2025-09-29T02:16:02.287569] [INFO ] [MAIN ] GGG: Loaded 41580 primary data records. [2025-09-29T02:16:02.293374] [DEBUG] [LOCAL ] GGT: Loaded 14309 existing records from primary storage. [2025-09-29T02:16:02.341447] [INFO ] [MAIN ] GGT: Loaded 14309 primary data records. [2025-09-29T02:16:03.445051] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:03.446165] [INFO ] [MAIN ] GGG: Generated 1820 derivative records from 41580 primary records. [2025-09-29T02:16:03.446729] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-29T02:16:03.477893] [DEBUG] [LOCAL ] GGG: Derivative data saved (1820 records). [2025-09-29T02:16:03.492548] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-29T02:16:03.506798] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:03.509667] [INFO ] [MAIN ] Derivative Progress: 867/2211 symbols completed. GGG took 1.4s. Estimated remaining: 9m 28s. Rate: 141.9 symbols/min [2025-09-29T02:16:03.506429] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:03.510856] [INFO ] [MAIN ] GGB: Generated 1820 derivative records from 51813 primary records. [2025-09-29T02:16:03.509880] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:03.511343] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-29T02:16:03.512521] [INFO ] [MAIN ] GGT: Generated 1820 derivative records from 14309 primary records. [2025-09-29T02:16:03.514339] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-29T02:16:03.545209] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-09-29T02:16:03.552086] [INFO ] [MAIN ] GGZ: Loaded 2465 primary data records. [2025-09-29T02:16:03.541085] [DEBUG] [LOCAL ] GGB: Derivative data saved (1820 records). [2025-09-29T02:16:03.565316] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-29T02:16:03.571213] [DEBUG] [LOCAL ] GGT: Derivative data saved (1820 records). [2025-09-29T02:16:03.593284] [INFO ] [MAIN ] Derivative Progress: 868/2211 symbols completed. GGB took 1.6s. Estimated remaining: 9m 27s. Rate: 142.0 symbols/min [2025-09-29T02:16:03.593620] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-29T02:16:03.597085] [INFO ] [MAIN ] Derivative Progress: 869/2211 symbols completed. GGT took 1.4s. Estimated remaining: 9m 26s. Rate: 142.2 symbols/min [2025-09-29T02:16:03.915105] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:03.915920] [INFO ] [MAIN ] GGZ: Generated 1820 derivative records from 2465 primary records. [2025-09-29T02:16:03.916055] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-29T02:16:03.930104] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1820 records). [2025-09-29T02:16:03.930260] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-29T02:16:03.932618] [INFO ] [MAIN ] Derivative Progress: 870/2211 symbols completed. GGZ took 0.4s. Estimated remaining: 9m 26s. Rate: 142.2 symbols/min [2025-09-29T02:16:03.933212] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:03.933291] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:03.933341] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:03.940944] [DEBUG] [LOCAL ] GHC: Loaded 2664 existing records from primary storage. [2025-09-29T02:16:03.941565] [INFO ] [MAIN ] GHC: Loaded 2664 primary data records. [2025-09-29T02:16:03.943795] [DEBUG] [LOCAL ] GHG: Loaded 3226 existing records from primary storage. [2025-09-29T02:16:03.980625] [INFO ] [MAIN ] GHG: Loaded 3226 primary data records. [2025-09-29T02:16:04.071638] [DEBUG] [LOCAL ] GHI: Loaded 6963 existing records from primary storage. [2025-09-29T02:16:04.102796] [INFO ] [MAIN ] GHI: Loaded 6963 primary data records. [2025-09-29T02:16:05.006169] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:05.007504] [INFO ] [MAIN ] GHC: Generated 1820 derivative records from 2664 primary records. [2025-09-29T02:16:05.010745] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-29T02:16:05.041501] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:16:05.042199] [DEBUG] [LOCAL ] GHC: Derivative data saved (1820 records). [2025-09-29T02:16:05.044042] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-29T02:16:05.044847] [INFO ] [MAIN ] GHG: Generated 1819 derivative records from 3226 primary records. [2025-09-29T02:16:05.047292] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-29T02:16:05.047201] [INFO ] [MAIN ] Derivative Progress: 871/2211 symbols completed. GHC took 1.1s. Estimated remaining: 9m 26s. Rate: 142.0 symbols/min [2025-09-29T02:16:05.047570] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:05.073985] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:05.077828] [INFO ] [MAIN ] GHI: Generated 1820 derivative records from 6963 primary records. [2025-09-29T02:16:05.078250] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-29T02:16:05.083109] [DEBUG] [LOCAL ] GHLD: Loaded 4168 existing records from primary storage. [2025-09-29T02:16:05.083257] [INFO ] [MAIN ] GHLD: Loaded 4168 primary data records. [2025-09-29T02:16:05.089447] [DEBUG] [LOCAL ] GHG: Derivative data saved (1819 records). [2025-09-29T02:16:05.114506] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-29T02:16:05.151264] [INFO ] [MAIN ] Derivative Progress: 872/2211 symbols completed. GHG took 1.2s. Estimated remaining: 9m 25s. Rate: 142.1 symbols/min [2025-09-29T02:16:05.162485] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:05.200989] [DEBUG] [LOCAL ] GHI: Derivative data saved (1820 records). [2025-09-29T02:16:05.223109] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-29T02:16:05.225971] [INFO ] [MAIN ] Derivative Progress: 873/2211 symbols completed. GHI took 1.3s. Estimated remaining: 9m 24s. Rate: 142.2 symbols/min [2025-09-29T02:16:05.243534] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:05.480001] [DEBUG] [LOCAL ] GHM: Loaded 14350 existing records from primary storage. [2025-09-29T02:16:05.492292] [INFO ] [MAIN ] GHM: Loaded 14350 primary data records. [2025-09-29T02:16:05.624171] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-09-29T02:16:05.638157] [INFO ] [MAIN ] GHY: Loaded 21190 primary data records. [2025-09-29T02:16:06.236934] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:06.238679] [INFO ] [MAIN ] GHLD: Generated 1820 derivative records from 4168 primary records. [2025-09-29T02:16:06.238795] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-29T02:16:06.258672] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1820 records). [2025-09-29T02:16:06.259228] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-29T02:16:06.261743] [INFO ] [MAIN ] Derivative Progress: 874/2211 symbols completed. GHLD took 1.2s. Estimated remaining: 9m 25s. Rate: 142.0 symbols/min [2025-09-29T02:16:06.262195] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:06.282343] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:06.283911] [INFO ] [MAIN ] GHM: Generated 1820 derivative records from 14350 primary records. [2025-09-29T02:16:06.284245] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-29T02:16:06.320629] [DEBUG] [LOCAL ] GHM: Derivative data saved (1820 records). [2025-09-29T02:16:06.330267] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-29T02:16:06.333747] [INFO ] [MAIN ] Derivative Progress: 875/2211 symbols completed. GHM took 1.2s. Estimated remaining: 9m 24s. Rate: 142.1 symbols/min [2025-09-29T02:16:06.330159] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:06.334206] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:06.335522] [INFO ] [MAIN ] GHY: Generated 1820 derivative records from 21190 primary records. [2025-09-29T02:16:06.335933] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-29T02:16:06.364251] [DEBUG] [LOCAL ] GIB: Loaded 32653 existing records from primary storage. [2025-09-29T02:16:06.369540] [INFO ] [MAIN ] GIB: Loaded 32653 primary data records. [2025-09-29T02:16:06.370308] [DEBUG] [LOCAL ] GHY: Derivative data saved (1820 records). [2025-09-29T02:16:06.383968] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-29T02:16:06.416553] [INFO ] [MAIN ] Derivative Progress: 876/2211 symbols completed. GHY took 1.2s. Estimated remaining: 9m 23s. Rate: 142.3 symbols/min [2025-09-29T02:16:06.424200] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:06.493254] [DEBUG] [LOCAL ] GIC: Loaded 13796 existing records from primary storage. [2025-09-29T02:16:06.497854] [INFO ] [MAIN ] GIC: Loaded 13796 primary data records. [2025-09-29T02:16:07.143125] [DEBUG] [LOCAL ] GIL: Loaded 43906 existing records from primary storage. [2025-09-29T02:16:07.144427] [INFO ] [MAIN ] GIL: Loaded 43906 primary data records. [2025-09-29T02:16:07.485890] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:07.497447] [INFO ] [MAIN ] GIB: Generated 1820 derivative records from 32653 primary records. [2025-09-29T02:16:07.498166] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-29T02:16:07.520879] [DEBUG] [LOCAL ] GIB: Derivative data saved (1820 records). [2025-09-29T02:16:07.521962] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-29T02:16:07.533550] [INFO ] [MAIN ] Derivative Progress: 877/2211 symbols completed. GIB took 1.3s. Estimated remaining: 9m 24s. Rate: 142.0 symbols/min [2025-09-29T02:16:07.540341] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:07.540044] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:07.541837] [INFO ] [MAIN ] GIC: Generated 1820 derivative records from 13796 primary records. [2025-09-29T02:16:07.543263] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-29T02:16:07.560234] [DEBUG] [LOCAL ] GIC: Derivative data saved (1820 records). [2025-09-29T02:16:07.560757] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-29T02:16:07.564071] [INFO ] [MAIN ] Derivative Progress: 878/2211 symbols completed. GIC took 1.2s. Estimated remaining: 9m 23s. Rate: 142.1 symbols/min [2025-09-29T02:16:07.564393] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:07.585055] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:07.586731] [INFO ] [MAIN ] GIL: Generated 1820 derivative records from 43906 primary records. [2025-09-29T02:16:07.586933] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-29T02:16:07.608177] [DEBUG] [LOCAL ] GIL: Derivative data saved (1820 records). [2025-09-29T02:16:07.608364] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-29T02:16:07.611693] [INFO ] [MAIN ] Derivative Progress: 879/2211 symbols completed. GIL took 1.2s. Estimated remaining: 9m 22s. Rate: 142.3 symbols/min [2025-09-29T02:16:07.611995] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:07.662758] [DEBUG] [LOCAL ] GKOS: Loaded 43585 existing records from primary storage. [2025-09-29T02:16:07.663350] [INFO ] [MAIN ] GKOS: Loaded 43585 primary data records. [2025-09-29T02:16:07.814806] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-09-29T02:16:07.816762] [INFO ] [MAIN ] GIS: Loaded 54455 primary data records. [2025-09-29T02:16:07.933282] [DEBUG] [LOCAL ] GL: Loaded 38382 existing records from primary storage. [2025-09-29T02:16:08.034865] [INFO ] [MAIN ] GL: Loaded 38382 primary data records. [2025-09-29T02:16:08.866567] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:08.873266] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:08.874282] [INFO ] [MAIN ] GKOS: Generated 1820 derivative records from 43585 primary records. [2025-09-29T02:16:08.875564] [INFO ] [MAIN ] GIS: Generated 1820 derivative records from 54455 primary records. [2025-09-29T02:16:08.875741] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-29T02:16:08.875803] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-29T02:16:08.913548] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1820 records). [2025-09-29T02:16:08.912383] [DEBUG] [LOCAL ] GIS: Derivative data saved (1820 records). [2025-09-29T02:16:08.913890] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-29T02:16:08.916774] [INFO ] [MAIN ] Derivative Progress: 880/2211 symbols completed. GKOS took 1.4s. Estimated remaining: 9m 23s. Rate: 141.9 symbols/min [2025-09-29T02:16:08.914013] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-29T02:16:08.921003] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:08.921094] [INFO ] [MAIN ] Derivative Progress: 881/2211 symbols completed. GIS took 1.4s. Estimated remaining: 9m 22s. Rate: 142.1 symbols/min [2025-09-29T02:16:08.922829] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:08.940973] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:08.942012] [INFO ] [MAIN ] GL: Generated 1820 derivative records from 38382 primary records. [2025-09-29T02:16:08.942164] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-29T02:16:08.970688] [DEBUG] [LOCAL ] GLP: Loaded 9585 existing records from primary storage. [2025-09-29T02:16:08.971299] [INFO ] [MAIN ] GLP: Loaded 9585 primary data records. [2025-09-29T02:16:08.971792] [DEBUG] [LOCAL ] GL: Derivative data saved (1820 records). [2025-09-29T02:16:08.985284] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-29T02:16:09.017737] [INFO ] [MAIN ] Derivative Progress: 882/2211 symbols completed. GL took 1.4s. Estimated remaining: 9m 21s. Rate: 142.2 symbols/min [2025-09-29T02:16:09.031938] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:09.190857] [DEBUG] [LOCAL ] GLOB: Loaded 48111 existing records from primary storage. [2025-09-29T02:16:09.240724] [INFO ] [MAIN ] GLOB: Loaded 48111 primary data records. [2025-09-29T02:16:09.739687] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-29T02:16:09.750226] [INFO ] [MAIN ] GLW: Loaded 54415 primary data records. [2025-09-29T02:16:09.949572] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:09.983507] [INFO ] [MAIN ] GLP: Generated 1820 derivative records from 9585 primary records. [2025-09-29T02:16:10.153241] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-29T02:16:10.186976] [DEBUG] [LOCAL ] GLP: Derivative data saved (1820 records). [2025-09-29T02:16:10.187784] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-29T02:16:10.190209] [INFO ] [MAIN ] Derivative Progress: 883/2211 symbols completed. GLP took 1.3s. Estimated remaining: 9m 21s. Rate: 141.9 symbols/min [2025-09-29T02:16:10.205006] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:10.206235] [INFO ] [MAIN ] GLOB: Generated 1820 derivative records from 48111 primary records. [2025-09-29T02:16:10.206340] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-29T02:16:10.224845] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1820 records). [2025-09-29T02:16:10.225003] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-29T02:16:10.228109] [INFO ] [MAIN ] Derivative Progress: 884/2211 symbols completed. GLOB took 1.3s. Estimated remaining: 9m 20s. Rate: 142.1 symbols/min [2025-09-29T02:16:10.246277] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:10.247094] [INFO ] [MAIN ] GLW: Generated 1820 derivative records from 54415 primary records. [2025-09-29T02:16:10.247183] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-29T02:16:10.263451] [DEBUG] [LOCAL ] GLW: Derivative data saved (1820 records). [2025-09-29T02:16:10.263547] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-29T02:16:10.267708] [INFO ] [MAIN ] Derivative Progress: 885/2211 symbols completed. GLW took 1.2s. Estimated remaining: 9m 19s. Rate: 142.2 symbols/min [2025-09-29T02:16:10.268342] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:10.268242] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:10.268469] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:10.391207] [DEBUG] [LOCAL ] GMED: Loaded 49096 existing records from primary storage. [2025-09-29T02:16:10.392490] [DEBUG] [LOCAL ] GME: Loaded 54540 existing records from primary storage. [2025-09-29T02:16:10.392839] [INFO ] [MAIN ] GME: Loaded 54540 primary data records. [2025-09-29T02:16:10.392627] [INFO ] [MAIN ] GMED: Loaded 49096 primary data records. [2025-09-29T02:16:10.394149] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-29T02:16:10.399613] [INFO ] [MAIN ] GM: Loaded 54508 primary data records. [2025-09-29T02:16:11.466559] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:11.493823] [INFO ] [MAIN ] GME: Generated 1820 derivative records from 54540 primary records. [2025-09-29T02:16:11.492923] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:11.494068] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-29T02:16:11.494674] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:11.495391] [INFO ] [MAIN ] GM: Generated 1820 derivative records from 54508 primary records. [2025-09-29T02:16:11.497119] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-29T02:16:11.497045] [INFO ] [MAIN ] GMED: Generated 1820 derivative records from 49096 primary records. [2025-09-29T02:16:11.497276] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-29T02:16:11.554742] [DEBUG] [LOCAL ] GMED: Derivative data saved (1820 records). [2025-09-29T02:16:11.554913] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-29T02:16:11.559338] [INFO ] [MAIN ] Derivative Progress: 886/2211 symbols completed. GMED took 1.3s. Estimated remaining: 9m 20s. Rate: 141.9 symbols/min [2025-09-29T02:16:11.551404] [DEBUG] [LOCAL ] GME: Derivative data saved (1820 records). [2025-09-29T02:16:11.559611] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:11.560283] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-29T02:16:11.564270] [INFO ] [MAIN ] Derivative Progress: 887/2211 symbols completed. GME took 1.3s. Estimated remaining: 9m 19s. Rate: 142.1 symbols/min [2025-09-29T02:16:11.564582] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:11.560958] [DEBUG] [LOCAL ] GM: Derivative data saved (1820 records). [2025-09-29T02:16:11.565177] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-29T02:16:11.568971] [INFO ] [MAIN ] Derivative Progress: 888/2211 symbols completed. GM took 1.3s. Estimated remaining: 9m 18s. Rate: 142.2 symbols/min [2025-09-29T02:16:11.569326] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:11.594985] [DEBUG] [LOCAL ] GNE: Loaded 17940 existing records from primary storage. [2025-09-29T02:16:11.595181] [INFO ] [MAIN ] GNE: Loaded 17940 primary data records. [2025-09-29T02:16:11.763154] [DEBUG] [LOCAL ] GMRE: Loaded 38133 existing records from primary storage. [2025-09-29T02:16:11.779208] [INFO ] [MAIN ] GMRE: Loaded 38133 primary data records. [2025-09-29T02:16:11.786043] [DEBUG] [LOCAL ] GNK: Loaded 41039 existing records from primary storage. [2025-09-29T02:16:11.870973] [INFO ] [MAIN ] GNK: Loaded 41039 primary data records. [2025-09-29T02:16:12.769051] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:12.771139] [INFO ] [MAIN ] GNE: Generated 1820 derivative records from 17940 primary records. [2025-09-29T02:16:12.771670] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-29T02:16:12.791224] [DEBUG] [LOCAL ] GNE: Derivative data saved (1820 records). [2025-09-29T02:16:12.792421] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-29T02:16:12.795058] [INFO ] [MAIN ] Derivative Progress: 889/2211 symbols completed. GNE took 1.2s. Estimated remaining: 9m 19s. Rate: 141.9 symbols/min [2025-09-29T02:16:12.797049] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:12.814540] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:12.815589] [INFO ] [MAIN ] GMRE: Generated 1820 derivative records from 38133 primary records. [2025-09-29T02:16:12.816214] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-29T02:16:12.852707] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1820 records). [2025-09-29T02:16:12.852977] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:12.853379] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-29T02:16:12.854159] [INFO ] [MAIN ] GNK: Generated 1820 derivative records from 41039 primary records. [2025-09-29T02:16:12.858165] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-29T02:16:12.857929] [INFO ] [MAIN ] Derivative Progress: 890/2211 symbols completed. GMRE took 1.3s. Estimated remaining: 9m 18s. Rate: 142.1 symbols/min [2025-09-29T02:16:12.859633] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:12.878390] [DEBUG] [LOCAL ] GNK: Derivative data saved (1820 records). [2025-09-29T02:16:12.878768] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-29T02:16:12.882570] [INFO ] [MAIN ] Derivative Progress: 891/2211 symbols completed. GNK took 1.3s. Estimated remaining: 9m 17s. Rate: 142.2 symbols/min [2025-09-29T02:16:12.882912] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:12.911123] [DEBUG] [LOCAL ] GNT: Loaded 8177 existing records from primary storage. [2025-09-29T02:16:12.911369] [INFO ] [MAIN ] GNT: Loaded 8177 primary data records. [2025-09-29T02:16:13.099802] [DEBUG] [LOCAL ] GNL: Loaded 47785 existing records from primary storage. [2025-09-29T02:16:13.101440] [DEBUG] [LOCAL ] GNRC: Loaded 45886 existing records from primary storage. [2025-09-29T02:16:13.112047] [INFO ] [MAIN ] GNL: Loaded 47785 primary data records. [2025-09-29T02:16:13.117385] [INFO ] [MAIN ] GNRC: Loaded 45886 primary data records. [2025-09-29T02:16:14.027506] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:14.030246] [INFO ] [MAIN ] GNT: Generated 1820 derivative records from 8177 primary records. [2025-09-29T02:16:14.030786] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-29T02:16:14.051047] [DEBUG] [LOCAL ] GNT: Derivative data saved (1820 records). [2025-09-29T02:16:14.051940] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-29T02:16:14.054760] [INFO ] [MAIN ] Derivative Progress: 892/2211 symbols completed. GNT took 1.2s. Estimated remaining: 9m 18s. Rate: 141.9 symbols/min [2025-09-29T02:16:14.055339] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:14.080507] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:14.098909] [DEBUG] [LOCAL ] GNTY: Loaded 7353 existing records from primary storage. [2025-09-29T02:16:14.100259] [INFO ] [MAIN ] GNRC: Generated 1820 derivative records from 45886 primary records. [2025-09-29T02:16:14.101127] [INFO ] [MAIN ] GNTY: Loaded 7353 primary data records. [2025-09-29T02:16:14.101037] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:14.101465] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-29T02:16:14.107938] [INFO ] [MAIN ] GNL: Generated 1820 derivative records from 47785 primary records. [2025-09-29T02:16:14.151074] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-29T02:16:14.220351] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1820 records). [2025-09-29T02:16:14.246439] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-29T02:16:14.255184] [INFO ] [MAIN ] Derivative Progress: 893/2211 symbols completed. GNRC took 1.4s. Estimated remaining: 9m 17s. Rate: 142.0 symbols/min [2025-09-29T02:16:14.256438] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:14.278544] [DEBUG] [LOCAL ] GNL: Derivative data saved (1820 records). [2025-09-29T02:16:14.319232] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-29T02:16:14.342744] [INFO ] [MAIN ] Derivative Progress: 894/2211 symbols completed. GNL took 1.5s. Estimated remaining: 9m 16s. Rate: 142.1 symbols/min [2025-09-29T02:16:14.500085] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:14.584606] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:16:14.597583] [INFO ] [MAIN ] GNTY: Generated 1819 derivative records from 7353 primary records. [2025-09-29T02:16:14.597983] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-29T02:16:14.600908] [DEBUG] [LOCAL ] GNW: Loaded 52086 existing records from primary storage. [2025-09-29T02:16:14.608551] [INFO ] [MAIN ] GNW: Loaded 52086 primary data records. [2025-09-29T02:16:14.674328] [DEBUG] [LOCAL ] GOF: Loaded 43374 existing records from primary storage. [2025-09-29T02:16:14.660336] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1819 records). [2025-09-29T02:16:14.711252] [INFO ] [MAIN ] GOF: Loaded 43374 primary data records. [2025-09-29T02:16:14.711426] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-29T02:16:14.741934] [INFO ] [MAIN ] Derivative Progress: 895/2211 symbols completed. GNTY took 0.7s. Estimated remaining: 9m 16s. Rate: 142.1 symbols/min [2025-09-29T02:16:14.808837] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:15.354489] [DEBUG] [LOCAL ] GOLF: Loaded 32049 existing records from primary storage. [2025-09-29T02:16:15.356134] [INFO ] [MAIN ] GOLF: Loaded 32049 primary data records. [2025-09-29T02:16:15.532345] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:15.568212] [INFO ] [MAIN ] GNW: Generated 1820 derivative records from 52086 primary records. [2025-09-29T02:16:15.593785] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-29T02:16:15.758290] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:15.761327] [INFO ] [MAIN ] GOF: Generated 1820 derivative records from 43374 primary records. [2025-09-29T02:16:15.760395] [DEBUG] [LOCAL ] GNW: Derivative data saved (1820 records). [2025-09-29T02:16:15.761718] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-29T02:16:15.762555] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-29T02:16:15.767126] [INFO ] [MAIN ] Derivative Progress: 896/2211 symbols completed. GNW took 1.5s. Estimated remaining: 9m 16s. Rate: 141.9 symbols/min [2025-09-29T02:16:15.775490] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:15.787815] [DEBUG] [LOCAL ] GOF: Derivative data saved (1820 records). [2025-09-29T02:16:15.787975] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-29T02:16:15.791193] [INFO ] [MAIN ] Derivative Progress: 897/2211 symbols completed. GOF took 1.3s. Estimated remaining: 9m 15s. Rate: 142.1 symbols/min [2025-09-29T02:16:15.791767] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:15.813312] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:15.814244] [INFO ] [MAIN ] GOLF: Generated 1820 derivative records from 32049 primary records. [2025-09-29T02:16:15.814380] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-29T02:16:15.842447] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1820 records). [2025-09-29T02:16:15.850955] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-29T02:16:15.854145] [INFO ] [MAIN ] Derivative Progress: 898/2211 symbols completed. GOLF took 1.0s. Estimated remaining: 9m 14s. Rate: 142.2 symbols/min [2025-09-29T02:16:15.887187] [DEBUG] [LOCAL ] GOTU: Loaded 39533 existing records from primary storage. [2025-09-29T02:16:15.888456] [DEBUG] [LOCAL ] GOOS: Loaded 46008 existing records from primary storage. [2025-09-29T02:16:15.888712] [INFO ] [MAIN ] GOTU: Loaded 39533 primary data records. [2025-09-29T02:16:15.888775] [INFO ] [MAIN ] GOOS: Loaded 46008 primary data records. [2025-09-29T02:16:16.662906] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:16.664151] [INFO ] [MAIN ] GOOS: Generated 1820 derivative records from 46008 primary records. [2025-09-29T02:16:16.664373] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-29T02:16:16.696144] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:16.698284] [INFO ] [MAIN ] GOTU: Generated 1820 derivative records from 39533 primary records. [2025-09-29T02:16:16.700060] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-29T02:16:16.701438] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1820 records). [2025-09-29T02:16:16.701804] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-29T02:16:16.705304] [INFO ] [MAIN ] Derivative Progress: 899/2211 symbols completed. GOOS took 0.9s. Estimated remaining: 9m 14s. Rate: 142.0 symbols/min [2025-09-29T02:16:16.721374] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1820 records). [2025-09-29T02:16:16.721533] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-29T02:16:16.724999] [INFO ] [MAIN ] Derivative Progress: 900/2211 symbols completed. GOTU took 0.9s. Estimated remaining: 9m 13s. Rate: 142.2 symbols/min [2025-09-29T02:16:16.725967] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:16.726144] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:16.726207] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:16.735334] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-09-29T02:16:16.735705] [INFO ] [MAIN ] GPJA: Loaded 4140 primary data records. [2025-09-29T02:16:16.876105] [DEBUG] [LOCAL ] GPI: Loaded 15126 existing records from primary storage. [2025-09-29T02:16:16.897840] [INFO ] [MAIN ] GPI: Loaded 15126 primary data records. [2025-09-29T02:16:17.357713] [DEBUG] [LOCAL ] GPC: Loaded 47289 existing records from primary storage. [2025-09-29T02:16:17.367811] [INFO ] [MAIN ] GPC: Loaded 47289 primary data records. [2025-09-29T02:16:17.916707] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:16:17.923408] [INFO ] [MAIN ] GPJA: Generated 1818 derivative records from 4140 primary records. [2025-09-29T02:16:17.923862] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-29T02:16:17.948350] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1818 records). [2025-09-29T02:16:17.961821] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-29T02:16:17.966504] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:16:17.965726] [INFO ] [MAIN ] Derivative Progress: 901/2211 symbols completed. GPJA took 1.2s. Estimated remaining: 9m 14s. Rate: 141.9 symbols/min [2025-09-29T02:16:17.968194] [INFO ] [MAIN ] GPI: Generated 1819 derivative records from 15126 primary records. [2025-09-29T02:16:17.968507] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-29T02:16:17.968920] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:17.989232] [DEBUG] [LOCAL ] GPI: Derivative data saved (1819 records). [2025-09-29T02:16:17.989718] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-29T02:16:17.992597] [INFO ] [MAIN ] Derivative Progress: 902/2211 symbols completed. GPI took 1.3s. Estimated remaining: 9m 13s. Rate: 142.0 symbols/min [2025-09-29T02:16:17.993215] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:18.012427] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:18.013473] [INFO ] [MAIN ] GPC: Generated 1820 derivative records from 47289 primary records. [2025-09-29T02:16:18.013685] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-29T02:16:18.032764] [DEBUG] [LOCAL ] GPC: Derivative data saved (1820 records). [2025-09-29T02:16:18.032952] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-29T02:16:18.036746] [INFO ] [MAIN ] Derivative Progress: 903/2211 symbols completed. GPC took 1.3s. Estimated remaining: 9m 12s. Rate: 142.2 symbols/min [2025-09-29T02:16:18.044503] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:18.072586] [DEBUG] [LOCAL ] GPMT: Loaded 26788 existing records from primary storage. [2025-09-29T02:16:18.072805] [INFO ] [MAIN ] GPMT: Loaded 26788 primary data records. [2025-09-29T02:16:18.207979] [DEBUG] [LOCAL ] GPK: Loaded 53441 existing records from primary storage. [2025-09-29T02:16:18.212552] [INFO ] [MAIN ] GPK: Loaded 53441 primary data records. [2025-09-29T02:16:18.612713] [DEBUG] [LOCAL ] GPN: Loaded 52822 existing records from primary storage. [2025-09-29T02:16:18.629678] [INFO ] [MAIN ] GPN: Loaded 52822 primary data records. [2025-09-29T02:16:19.280050] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:19.280950] [INFO ] [MAIN ] GPMT: Generated 1820 derivative records from 26788 primary records. [2025-09-29T02:16:19.281163] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-29T02:16:19.318705] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:19.319382] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1820 records). [2025-09-29T02:16:19.320286] [INFO ] [MAIN ] GPK: Generated 1820 derivative records from 53441 primary records. [2025-09-29T02:16:19.320398] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-29T02:16:19.320638] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-29T02:16:19.324282] [INFO ] [MAIN ] Derivative Progress: 904/2211 symbols completed. GPMT took 1.3s. Estimated remaining: 9m 13s. Rate: 141.8 symbols/min [2025-09-29T02:16:19.325072] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:19.344368] [DEBUG] [LOCAL ] GPK: Derivative data saved (1820 records). [2025-09-29T02:16:19.347188] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-29T02:16:19.349888] [INFO ] [MAIN ] Derivative Progress: 905/2211 symbols completed. GPK took 1.4s. Estimated remaining: 9m 12s. Rate: 142.0 symbols/min [2025-09-29T02:16:19.350341] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:19.370467] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:19.371406] [INFO ] [MAIN ] GPN: Generated 1820 derivative records from 52822 primary records. [2025-09-29T02:16:19.371529] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-29T02:16:19.397932] [DEBUG] [LOCAL ] GPOR: Loaded 23328 existing records from primary storage. [2025-09-29T02:16:19.399816] [INFO ] [MAIN ] GPOR: Loaded 23328 primary data records. [2025-09-29T02:16:19.399867] [DEBUG] [LOCAL ] GPN: Derivative data saved (1820 records). [2025-09-29T02:16:19.400234] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-29T02:16:19.442874] [INFO ] [MAIN ] Derivative Progress: 906/2211 symbols completed. GPN took 1.4s. Estimated remaining: 9m 11s. Rate: 142.1 symbols/min [2025-09-29T02:16:19.457061] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:19.629768] [DEBUG] [LOCAL ] GPRK: Loaded 39841 existing records from primary storage. [2025-09-29T02:16:19.759200] [INFO ] [MAIN ] GPRK: Loaded 39841 primary data records. [2025-09-29T02:16:19.863081] [DEBUG] [LOCAL ] GRBK: Loaded 27375 existing records from primary storage. [2025-09-29T02:16:19.884022] [INFO ] [MAIN ] GRBK: Loaded 27375 primary data records. [2025-09-29T02:16:20.512343] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:20.513424] [INFO ] [MAIN ] GPOR: Generated 1820 derivative records from 23328 primary records. [2025-09-29T02:16:20.513504] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-29T02:16:20.543525] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1820 records). [2025-09-29T02:16:20.544270] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-29T02:16:20.547783] [INFO ] [MAIN ] Derivative Progress: 907/2211 symbols completed. GPOR took 1.2s. Estimated remaining: 9m 12s. Rate: 141.9 symbols/min [2025-09-29T02:16:20.548357] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:20.572363] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:20.574151] [INFO ] [MAIN ] GPRK: Generated 1820 derivative records from 39841 primary records. [2025-09-29T02:16:20.578563] [DEBUG] [LOCAL ] GRC: Loaded 9061 existing records from primary storage. [2025-09-29T02:16:20.578804] [INFO ] [MAIN ] GRC: Loaded 9061 primary data records. [2025-09-29T02:16:20.578677] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-29T02:16:20.693892] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1820 records). [2025-09-29T02:16:20.714865] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-29T02:16:20.733192] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:20.737994] [INFO ] [MAIN ] Derivative Progress: 908/2211 symbols completed. GPRK took 1.4s. Estimated remaining: 9m 11s. Rate: 142.0 symbols/min [2025-09-29T02:16:20.750294] [INFO ] [MAIN ] GRBK: Generated 1820 derivative records from 27375 primary records. [2025-09-29T02:16:20.766209] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-29T02:16:20.771637] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:20.984350] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1820 records). [2025-09-29T02:16:20.984728] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-29T02:16:20.989053] [INFO ] [MAIN ] Derivative Progress: 909/2211 symbols completed. GRBK took 1.5s. Estimated remaining: 9m 10s. Rate: 142.0 symbols/min [2025-09-29T02:16:20.989316] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:21.011122] [DEBUG] [LOCAL ] GRDN: Loaded 20178 existing records from primary storage. [2025-09-29T02:16:21.012927] [INFO ] [MAIN ] GRDN: Loaded 20178 primary data records. [2025-09-29T02:16:21.424431] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:21.437280] [INFO ] [MAIN ] GRC: Generated 1820 derivative records from 9061 primary records. [2025-09-29T02:16:21.437414] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-29T02:16:21.440367] [DEBUG] [LOCAL ] GRMN: Loaded 41798 existing records from primary storage. [2025-09-29T02:16:21.441017] [INFO ] [MAIN ] GRMN: Loaded 41798 primary data records. [2025-09-29T02:16:21.586805] [DEBUG] [LOCAL ] GRC: Derivative data saved (1820 records). [2025-09-29T02:16:21.598236] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-29T02:16:21.632382] [INFO ] [MAIN ] Derivative Progress: 910/2211 symbols completed. GRC took 1.1s. Estimated remaining: 9m 10s. Rate: 141.9 symbols/min [2025-09-29T02:16:21.654767] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:21.828620] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:21.829536] [INFO ] [MAIN ] GRDN: Generated 1820 derivative records from 20178 primary records. [2025-09-29T02:16:21.829696] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-29T02:16:21.852296] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1820 records). [2025-09-29T02:16:21.853072] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-29T02:16:21.871075] [INFO ] [MAIN ] Derivative Progress: 911/2211 symbols completed. GRDN took 1.1s. Estimated remaining: 9m 9s. Rate: 142.0 symbols/min [2025-09-29T02:16:21.871500] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:21.912438] [DEBUG] [LOCAL ] GRND: Loaded 50744 existing records from primary storage. [2025-09-29T02:16:21.918304] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:21.918382] [INFO ] [MAIN ] GRND: Loaded 50744 primary data records. [2025-09-29T02:16:21.919363] [INFO ] [MAIN ] GRMN: Generated 1820 derivative records from 41798 primary records. [2025-09-29T02:16:21.942873] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-29T02:16:22.064954] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1820 records). [2025-09-29T02:16:22.108350] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-29T02:16:22.162132] [DEBUG] [LOCAL ] GRNT: Loaded 34235 existing records from primary storage. [2025-09-29T02:16:22.166478] [INFO ] [MAIN ] Derivative Progress: 912/2211 symbols completed. GRMN took 1.2s. Estimated remaining: 9m 9s. Rate: 142.0 symbols/min [2025-09-29T02:16:22.172296] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:22.289782] [INFO ] [MAIN ] GRNT: Loaded 34235 primary data records. [2025-09-29T02:16:22.403455] [DEBUG] [LOCAL ] GROV: Loaded 9240 existing records from primary storage. [2025-09-29T02:16:22.417042] [INFO ] [MAIN ] GROV: Loaded 9240 primary data records. [2025-09-29T02:16:23.009306] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:23.010526] [INFO ] [MAIN ] GRND: Generated 1820 derivative records from 50744 primary records. [2025-09-29T02:16:23.012041] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-29T02:16:23.033005] [DEBUG] [LOCAL ] GRND: Derivative data saved (1820 records). [2025-09-29T02:16:23.034483] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-29T02:16:23.038429] [INFO ] [MAIN ] Derivative Progress: 913/2211 symbols completed. GRND took 1.4s. Estimated remaining: 9m 9s. Rate: 141.9 symbols/min [2025-09-29T02:16:23.057492] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:23.058383] [INFO ] [MAIN ] GRNT: Generated 1820 derivative records from 34235 primary records. [2025-09-29T02:16:23.058686] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-29T02:16:23.076211] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1820 records). [2025-09-29T02:16:23.077512] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-29T02:16:23.081364] [INFO ] [MAIN ] Derivative Progress: 914/2211 symbols completed. GRNT took 1.2s. Estimated remaining: 9m 8s. Rate: 142.0 symbols/min [2025-09-29T02:16:23.096002] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:23.096731] [INFO ] [MAIN ] GROV: Generated 1820 derivative records from 9240 primary records. [2025-09-29T02:16:23.096850] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-29T02:16:23.114023] [DEBUG] [LOCAL ] GROV: Derivative data saved (1820 records). [2025-09-29T02:16:23.114160] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-29T02:16:23.116753] [INFO ] [MAIN ] Derivative Progress: 915/2211 symbols completed. GROV took 0.9s. Estimated remaining: 9m 7s. Rate: 142.2 symbols/min [2025-09-29T02:16:23.117536] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:23.117437] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:23.117702] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:23.132437] [DEBUG] [LOCAL ] GRX: Loaded 4547 existing records from primary storage. [2025-09-29T02:16:23.132818] [INFO ] [MAIN ] GRX: Loaded 4547 primary data records. [2025-09-29T02:16:23.396623] [DEBUG] [LOCAL ] GSBD: Loaded 39756 existing records from primary storage. [2025-09-29T02:16:23.605757] [INFO ] [MAIN ] GSBD: Loaded 39756 primary data records. [2025-09-29T02:16:23.623991] [DEBUG] [LOCAL ] GS: Loaded 52736 existing records from primary storage. [2025-09-29T02:16:23.656183] [INFO ] [MAIN ] GS: Loaded 52736 primary data records. [2025-09-29T02:16:24.367470] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:24.370759] [INFO ] [MAIN ] GRX: Generated 1820 derivative records from 4547 primary records. [2025-09-29T02:16:24.371242] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-29T02:16:24.390241] [DEBUG] [LOCAL ] GRX: Derivative data saved (1820 records). [2025-09-29T02:16:24.390749] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-29T02:16:24.398173] [INFO ] [MAIN ] Derivative Progress: 916/2211 symbols completed. GRX took 1.3s. Estimated remaining: 9m 8s. Rate: 141.8 symbols/min [2025-09-29T02:16:24.398684] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:24.414155] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:24.415351] [INFO ] [MAIN ] GSBD: Generated 1820 derivative records from 39756 primary records. [2025-09-29T02:16:24.416082] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-29T02:16:24.439333] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1820 records). [2025-09-29T02:16:24.453915] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-29T02:16:24.458539] [INFO ] [MAIN ] Derivative Progress: 917/2211 symbols completed. GSBD took 1.3s. Estimated remaining: 9m 7s. Rate: 142.0 symbols/min [2025-09-29T02:16:24.454569] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:24.458804] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:24.460080] [INFO ] [MAIN ] GS: Generated 1820 derivative records from 52736 primary records. [2025-09-29T02:16:24.460953] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-29T02:16:24.483486] [DEBUG] [LOCAL ] GS: Derivative data saved (1820 records). [2025-09-29T02:16:24.483949] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-29T02:16:24.487445] [INFO ] [MAIN ] Derivative Progress: 918/2211 symbols completed. GS took 1.4s. Estimated remaining: 9m 6s. Rate: 142.1 symbols/min [2025-09-29T02:16:24.487863] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:24.567637] [DEBUG] [LOCAL ] GSL: Loaded 33824 existing records from primary storage. [2025-09-29T02:16:24.570399] [INFO ] [MAIN ] GSL: Loaded 33824 primary data records. [2025-09-29T02:16:24.570191] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-09-29T02:16:24.571212] [INFO ] [MAIN ] GSK: Loaded 54272 primary data records. [2025-09-29T02:16:24.870905] [DEBUG] [LOCAL ] GTES: Loaded 51399 existing records from primary storage. [2025-09-29T02:16:24.928538] [INFO ] [MAIN ] GTES: Loaded 51399 primary data records. [2025-09-29T02:16:25.765039] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:25.765768] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:25.767923] [INFO ] [MAIN ] GSK: Generated 1820 derivative records from 54272 primary records. [2025-09-29T02:16:25.767042] [INFO ] [MAIN ] GSL: Generated 1820 derivative records from 33824 primary records. [2025-09-29T02:16:25.768179] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-29T02:16:25.769431] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-29T02:16:25.811917] [DEBUG] [LOCAL ] GSL: Derivative data saved (1820 records). [2025-09-29T02:16:25.826123] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:25.828413] [INFO ] [MAIN ] GTES: Generated 1820 derivative records from 51399 primary records. [2025-09-29T02:16:25.826682] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-29T02:16:25.828608] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-29T02:16:25.828529] [DEBUG] [LOCAL ] GSK: Derivative data saved (1820 records). [2025-09-29T02:16:25.832014] [INFO ] [MAIN ] Derivative Progress: 919/2211 symbols completed. GSL took 1.4s. Estimated remaining: 9m 7s. Rate: 141.8 symbols/min [2025-09-29T02:16:25.832136] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-29T02:16:25.836863] [INFO ] [MAIN ] Derivative Progress: 920/2211 symbols completed. GSK took 1.4s. Estimated remaining: 9m 6s. Rate: 141.9 symbols/min [2025-09-29T02:16:25.832365] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:25.837411] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:25.856380] [DEBUG] [LOCAL ] GTES: Derivative data saved (1820 records). [2025-09-29T02:16:25.856718] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-29T02:16:25.860187] [INFO ] [MAIN ] Derivative Progress: 921/2211 symbols completed. GTES took 1.4s. Estimated remaining: 9m 5s. Rate: 142.1 symbols/min [2025-09-29T02:16:25.860405] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:25.940878] [DEBUG] [LOCAL ] GTN: Loaded 46301 existing records from primary storage. [2025-09-29T02:16:25.941168] [INFO ] [MAIN ] GTN: Loaded 46301 primary data records. [2025-09-29T02:16:25.942519] [DEBUG] [LOCAL ] GTLS: Loaded 43461 existing records from primary storage. [2025-09-29T02:16:25.942817] [INFO ] [MAIN ] GTLS: Loaded 43461 primary data records. [2025-09-29T02:16:26.160005] [DEBUG] [LOCAL ] GTY: Loaded 30796 existing records from primary storage. [2025-09-29T02:16:26.216904] [INFO ] [MAIN ] GTY: Loaded 30796 primary data records. [2025-09-29T02:16:26.970221] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:26.972153] [INFO ] [MAIN ] GTN: Generated 1820 derivative records from 46301 primary records. [2025-09-29T02:16:26.972449] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-29T02:16:27.003012] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:27.006476] [INFO ] [MAIN ] GTLS: Generated 1820 derivative records from 43461 primary records. [2025-09-29T02:16:27.007403] [DEBUG] [LOCAL ] GTN: Derivative data saved (1820 records). [2025-09-29T02:16:27.007872] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-29T02:16:27.007953] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-29T02:16:27.011002] [INFO ] [MAIN ] Derivative Progress: 922/2211 symbols completed. GTN took 1.2s. Estimated remaining: 9m 5s. Rate: 141.8 symbols/min [2025-09-29T02:16:27.013629] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:27.041598] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1820 records). [2025-09-29T02:16:27.047404] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-29T02:16:27.050520] [INFO ] [MAIN ] Derivative Progress: 923/2211 symbols completed. GTLS took 1.2s. Estimated remaining: 9m 4s. Rate: 142.0 symbols/min [2025-09-29T02:16:27.047604] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:27.050900] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:27.052231] [INFO ] [MAIN ] GTY: Generated 1820 derivative records from 30796 primary records. [2025-09-29T02:16:27.056510] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-29T02:16:27.076045] [DEBUG] [LOCAL ] GUG: Loaded 12138 existing records from primary storage. [2025-09-29T02:16:27.077035] [INFO ] [MAIN ] GUG: Loaded 12138 primary data records. [2025-09-29T02:16:27.113174] [DEBUG] [LOCAL ] GTY: Derivative data saved (1820 records). [2025-09-29T02:16:27.151458] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-29T02:16:27.177249] [INFO ] [MAIN ] Derivative Progress: 924/2211 symbols completed. GTY took 1.3s. Estimated remaining: 9m 4s. Rate: 142.1 symbols/min [2025-09-29T02:16:27.202703] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:27.203393] [DEBUG] [LOCAL ] GUT: Loaded 15560 existing records from primary storage. [2025-09-29T02:16:27.203694] [INFO ] [MAIN ] GUT: Loaded 15560 primary data records. [2025-09-29T02:16:27.782766] [DEBUG] [LOCAL ] GVA: Loaded 34030 existing records from primary storage. [2025-09-29T02:16:27.784272] [INFO ] [MAIN ] GVA: Loaded 34030 primary data records. [2025-09-29T02:16:28.177749] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:28.178979] [INFO ] [MAIN ] GUG: Generated 1820 derivative records from 12138 primary records. [2025-09-29T02:16:28.179697] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-29T02:16:28.211989] [DEBUG] [LOCAL ] GUG: Derivative data saved (1820 records). [2025-09-29T02:16:28.218232] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:28.217811] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-29T02:16:28.219081] [INFO ] [MAIN ] GUT: Generated 1820 derivative records from 15560 primary records. [2025-09-29T02:16:28.222928] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-29T02:16:28.221359] [INFO ] [MAIN ] Derivative Progress: 925/2211 symbols completed. GUG took 1.2s. Estimated remaining: 9m 4s. Rate: 141.8 symbols/min [2025-09-29T02:16:28.224299] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:28.242794] [DEBUG] [LOCAL ] GUT: Derivative data saved (1820 records). [2025-09-29T02:16:28.243243] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-29T02:16:28.246253] [INFO ] [MAIN ] Derivative Progress: 926/2211 symbols completed. GUT took 1.2s. Estimated remaining: 9m 3s. Rate: 142.0 symbols/min [2025-09-29T02:16:28.247966] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:28.268719] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:28.276371] [INFO ] [MAIN ] GVA: Generated 1820 derivative records from 34030 primary records. [2025-09-29T02:16:28.276262] [DEBUG] [LOCAL ] GWH: Loaded 15825 existing records from primary storage. [2025-09-29T02:16:28.276603] [INFO ] [MAIN ] GWH: Loaded 15825 primary data records. [2025-09-29T02:16:28.276680] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-29T02:16:28.441925] [DEBUG] [LOCAL ] GVA: Derivative data saved (1820 records). [2025-09-29T02:16:28.475177] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-29T02:16:28.642995] [INFO ] [MAIN ] Derivative Progress: 927/2211 symbols completed. GVA took 1.4s. Estimated remaining: 9m 3s. Rate: 142.0 symbols/min [2025-09-29T02:16:28.654543] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:28.684607] [DEBUG] [LOCAL ] GWRE: Loaded 41564 existing records from primary storage. [2025-09-29T02:16:28.685221] [INFO ] [MAIN ] GWRE: Loaded 41564 primary data records. [2025-09-29T02:16:28.880139] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-29T02:16:29.030546] [INFO ] [MAIN ] GWW: Loaded 20108 primary data records. [2025-09-29T02:16:29.205101] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:29.239365] [INFO ] [MAIN ] GWH: Generated 1820 derivative records from 15825 primary records. [2025-09-29T02:16:29.268488] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-29T02:16:29.426165] [DEBUG] [LOCAL ] GWH: Derivative data saved (1820 records). [2025-09-29T02:16:29.427981] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-29T02:16:29.433096] [INFO ] [MAIN ] Derivative Progress: 928/2211 symbols completed. GWH took 1.2s. Estimated remaining: 9m 3s. Rate: 141.9 symbols/min [2025-09-29T02:16:29.447742] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:29.448667] [INFO ] [MAIN ] GWRE: Generated 1820 derivative records from 41564 primary records. [2025-09-29T02:16:29.448773] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-29T02:16:29.467968] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1820 records). [2025-09-29T02:16:29.468366] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-29T02:16:29.472479] [INFO ] [MAIN ] Derivative Progress: 929/2211 symbols completed. GWRE took 1.2s. Estimated remaining: 9m 2s. Rate: 142.0 symbols/min [2025-09-29T02:16:29.489004] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:29.489776] [INFO ] [MAIN ] GWW: Generated 1820 derivative records from 20108 primary records. [2025-09-29T02:16:29.489882] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-29T02:16:29.506416] [DEBUG] [LOCAL ] GWW: Derivative data saved (1820 records). [2025-09-29T02:16:29.506572] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-29T02:16:29.510884] [INFO ] [MAIN ] Derivative Progress: 930/2211 symbols completed. GWW took 0.9s. Estimated remaining: 9m 1s. Rate: 142.1 symbols/min [2025-09-29T02:16:29.511496] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:29.511355] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:29.511750] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:29.518880] [DEBUG] [LOCAL ] GYLD: Loaded 1569 existing records from primary storage. [2025-09-29T02:16:29.519146] [INFO ] [MAIN ] GYLD: Loaded 1569 primary data records. [2025-09-29T02:16:29.904374] [DEBUG] [LOCAL ] GXO: Loaded 48260 existing records from primary storage. [2025-09-29T02:16:29.907330] [INFO ] [MAIN ] GXO: Loaded 48260 primary data records. [2025-09-29T02:16:29.964972] [DEBUG] [LOCAL ] H: Loaded 45492 existing records from primary storage. [2025-09-29T02:16:29.996979] [INFO ] [MAIN ] H: Loaded 45492 primary data records. [2025-09-29T02:16:30.664750] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:16:30.665954] [INFO ] [MAIN ] GYLD: Generated 1818 derivative records from 1569 primary records. [2025-09-29T02:16:30.666114] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-29T02:16:30.688937] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1818 records). [2025-09-29T02:16:30.689778] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-29T02:16:30.692670] [INFO ] [MAIN ] Derivative Progress: 931/2211 symbols completed. GYLD took 1.2s. Estimated remaining: 9m 1s. Rate: 141.9 symbols/min [2025-09-29T02:16:30.693146] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:30.711824] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:30.712735] [INFO ] [MAIN ] GXO: Generated 1820 derivative records from 48260 primary records. [2025-09-29T02:16:30.712908] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-29T02:16:30.732900] [DEBUG] [LOCAL ] GXO: Derivative data saved (1820 records). [2025-09-29T02:16:30.733303] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-29T02:16:30.750163] [INFO ] [MAIN ] Derivative Progress: 932/2211 symbols completed. GXO took 1.2s. Estimated remaining: 9m 0s. Rate: 142.0 symbols/min [2025-09-29T02:16:30.751250] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:30.751405] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:30.752543] [INFO ] [MAIN ] H: Generated 1820 derivative records from 45492 primary records. [2025-09-29T02:16:30.753006] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-29T02:16:30.781921] [DEBUG] [LOCAL ] H: Derivative data saved (1820 records). [2025-09-29T02:16:30.782257] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-29T02:16:30.785168] [INFO ] [MAIN ] Derivative Progress: 933/2211 symbols completed. H took 1.3s. Estimated remaining: 8m 59s. Rate: 142.1 symbols/min [2025-09-29T02:16:30.785399] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:30.804887] [DEBUG] [LOCAL ] HAE: Loaded 40176 existing records from primary storage. [2025-09-29T02:16:30.805110] [INFO ] [MAIN ] HAE: Loaded 40176 primary data records. [2025-09-29T02:16:30.990765] [DEBUG] [LOCAL ] HAFN: Loaded 44189 existing records from primary storage. [2025-09-29T02:16:31.035572] [INFO ] [MAIN ] HAFN: Loaded 44189 primary data records. [2025-09-29T02:16:31.313615] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-29T02:16:31.329757] [INFO ] [MAIN ] HAL: Loaded 54498 primary data records. [2025-09-29T02:16:31.893127] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:31.895401] [INFO ] [MAIN ] HAE: Generated 1820 derivative records from 40176 primary records. [2025-09-29T02:16:31.895776] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-29T02:16:31.917232] [DEBUG] [LOCAL ] HAE: Derivative data saved (1820 records). [2025-09-29T02:16:31.917898] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-29T02:16:31.923543] [INFO ] [MAIN ] Derivative Progress: 934/2211 symbols completed. HAE took 1.2s. Estimated remaining: 9m 0s. Rate: 141.9 symbols/min [2025-09-29T02:16:31.928071] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:31.950615] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:31.951716] [INFO ] [MAIN ] HAFN: Generated 1820 derivative records from 44189 primary records. [2025-09-29T02:16:31.952067] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-29T02:16:31.985876] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1820 records). [2025-09-29T02:16:31.984823] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:31.986122] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-29T02:16:31.987083] [INFO ] [MAIN ] HAL: Generated 1820 derivative records from 54498 primary records. [2025-09-29T02:16:31.987185] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-29T02:16:31.991184] [INFO ] [MAIN ] Derivative Progress: 935/2211 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 59s. Rate: 142.0 symbols/min [2025-09-29T02:16:31.991527] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:32.022903] [DEBUG] [LOCAL ] HAL: Derivative data saved (1820 records). [2025-09-29T02:16:32.023252] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-29T02:16:32.027946] [INFO ] [MAIN ] Derivative Progress: 936/2211 symbols completed. HAL took 1.2s. Estimated remaining: 8m 58s. Rate: 142.1 symbols/min [2025-09-29T02:16:32.028436] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:32.055228] [DEBUG] [LOCAL ] HASI: Loaded 47868 existing records from primary storage. [2025-09-29T02:16:32.059378] [INFO ] [MAIN ] HASI: Loaded 47868 primary data records. [2025-09-29T02:16:32.059164] [DEBUG] [LOCAL ] HBB: Loaded 6912 existing records from primary storage. [2025-09-29T02:16:32.059589] [INFO ] [MAIN ] HBB: Loaded 6912 primary data records. [2025-09-29T02:16:32.377794] [DEBUG] [LOCAL ] HAYW: Loaded 49444 existing records from primary storage. [2025-09-29T02:16:32.493713] [INFO ] [MAIN ] HAYW: Loaded 49444 primary data records. [2025-09-29T02:16:33.153498] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:33.153937] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:33.155076] [INFO ] [MAIN ] HBB: Generated 1820 derivative records from 6912 primary records. [2025-09-29T02:16:33.156189] [INFO ] [MAIN ] HASI: Generated 1820 derivative records from 47868 primary records. [2025-09-29T02:16:33.157243] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-29T02:16:33.157096] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-29T02:16:33.186848] [DEBUG] [LOCAL ] HBB: Derivative data saved (1820 records). [2025-09-29T02:16:33.188421] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-29T02:16:33.191274] [INFO ] [MAIN ] Derivative Progress: 937/2211 symbols completed. HBB took 1.2s. Estimated remaining: 8m 59s. Rate: 141.9 symbols/min [2025-09-29T02:16:33.192104] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:33.202302] [DEBUG] [LOCAL ] HASI: Derivative data saved (1820 records). [2025-09-29T02:16:33.210232] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-29T02:16:33.214443] [INFO ] [MAIN ] Derivative Progress: 938/2211 symbols completed. HASI took 1.3s. Estimated remaining: 8m 58s. Rate: 142.0 symbols/min [2025-09-29T02:16:33.220141] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:33.220264] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:33.221232] [INFO ] [MAIN ] HAYW: Generated 1820 derivative records from 49444 primary records. [2025-09-29T02:16:33.221334] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-29T02:16:33.238992] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1820 records). [2025-09-29T02:16:33.239152] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-29T02:16:33.243149] [INFO ] [MAIN ] Derivative Progress: 939/2211 symbols completed. HAYW took 1.3s. Estimated remaining: 8m 57s. Rate: 142.2 symbols/min [2025-09-29T02:16:33.243424] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:33.308710] [DEBUG] [LOCAL ] HBI: Loaded 53769 existing records from primary storage. [2025-09-29T02:16:33.309231] [INFO ] [MAIN ] HBI: Loaded 53769 primary data records. [2025-09-29T02:16:33.468433] [DEBUG] [LOCAL ] HBM: Loaded 53683 existing records from primary storage. [2025-09-29T02:16:33.488260] [INFO ] [MAIN ] HBM: Loaded 53683 primary data records. [2025-09-29T02:16:33.539304] [DEBUG] [LOCAL ] HCA: Loaded 47781 existing records from primary storage. [2025-09-29T02:16:33.575986] [INFO ] [MAIN ] HCA: Loaded 47781 primary data records. [2025-09-29T02:16:34.487559] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:34.489123] [INFO ] [MAIN ] HBI: Generated 1820 derivative records from 53769 primary records. [2025-09-29T02:16:34.489430] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-29T02:16:34.509800] [DEBUG] [LOCAL ] HBI: Derivative data saved (1820 records). [2025-09-29T02:16:34.510447] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-29T02:16:34.514266] [INFO ] [MAIN ] Derivative Progress: 940/2211 symbols completed. HBI took 1.3s. Estimated remaining: 8m 58s. Rate: 141.9 symbols/min [2025-09-29T02:16:34.515555] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:34.535423] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:34.537402] [INFO ] [MAIN ] HBM: Generated 1820 derivative records from 53683 primary records. [2025-09-29T02:16:34.538117] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-29T02:16:34.560294] [DEBUG] [LOCAL ] HBM: Derivative data saved (1820 records). [2025-09-29T02:16:34.560780] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-29T02:16:34.564493] [INFO ] [MAIN ] Derivative Progress: 941/2211 symbols completed. HBM took 1.3s. Estimated remaining: 8m 57s. Rate: 142.0 symbols/min [2025-09-29T02:16:34.564743] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:34.580415] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:34.581458] [INFO ] [MAIN ] HCA: Generated 1820 derivative records from 47781 primary records. [2025-09-29T02:16:34.581671] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-29T02:16:34.620029] [DEBUG] [LOCAL ] HCI: Loaded 14126 existing records from primary storage. [2025-09-29T02:16:34.622578] [INFO ] [MAIN ] HCI: Loaded 14126 primary data records. [2025-09-29T02:16:34.676324] [DEBUG] [LOCAL ] HCA: Derivative data saved (1820 records). [2025-09-29T02:16:34.697028] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-29T02:16:34.701098] [INFO ] [MAIN ] Derivative Progress: 942/2211 symbols completed. HCA took 1.5s. Estimated remaining: 8m 56s. Rate: 142.1 symbols/min [2025-09-29T02:16:34.696793] [DEBUG] [LOCAL ] HCC: Loaded 46057 existing records from primary storage. [2025-09-29T02:16:34.710008] [INFO ] [MAIN ] HCC: Loaded 46057 primary data records. [2025-09-29T02:16:34.709877] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:35.379514] [DEBUG] [LOCAL ] HD: Loaded 54283 existing records from primary storage. [2025-09-29T02:16:35.381639] [INFO ] [MAIN ] HD: Loaded 54283 primary data records. [2025-09-29T02:16:35.533025] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:35.549926] [INFO ] [MAIN ] HCI: Generated 1820 derivative records from 14126 primary records. [2025-09-29T02:16:35.608908] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-29T02:16:35.771179] [DEBUG] [LOCAL ] HCI: Derivative data saved (1820 records). [2025-09-29T02:16:35.771861] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-29T02:16:35.768047] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:35.774400] [INFO ] [MAIN ] Derivative Progress: 943/2211 symbols completed. HCI took 1.2s. Estimated remaining: 8m 56s. Rate: 141.9 symbols/min [2025-09-29T02:16:35.776116] [INFO ] [MAIN ] HCC: Generated 1820 derivative records from 46057 primary records. [2025-09-29T02:16:35.777106] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-29T02:16:35.794925] [DEBUG] [LOCAL ] HCC: Derivative data saved (1820 records). [2025-09-29T02:16:35.795825] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-29T02:16:35.799913] [INFO ] [MAIN ] Derivative Progress: 944/2211 symbols completed. HCC took 1.3s. Estimated remaining: 8m 55s. Rate: 142.0 symbols/min [2025-09-29T02:16:35.818310] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:35.819047] [INFO ] [MAIN ] HD: Generated 1820 derivative records from 54283 primary records. [2025-09-29T02:16:35.819134] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-29T02:16:35.835024] [DEBUG] [LOCAL ] HD: Derivative data saved (1820 records). [2025-09-29T02:16:35.835128] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-29T02:16:35.838312] [INFO ] [MAIN ] Derivative Progress: 945/2211 symbols completed. HD took 1.1s. Estimated remaining: 8m 54s. Rate: 142.1 symbols/min [2025-09-29T02:16:35.838925] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:35.838849] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:35.839065] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:35.889974] [DEBUG] [LOCAL ] HEI: Loaded 32846 existing records from primary storage. [2025-09-29T02:16:35.890424] [INFO ] [MAIN ] HEI: Loaded 32846 primary data records. [2025-09-29T02:16:36.080018] [DEBUG] [LOCAL ] HDB: Loaded 52695 existing records from primary storage. [2025-09-29T02:16:36.102582] [DEBUG] [LOCAL ] HE: Loaded 49870 existing records from primary storage. [2025-09-29T02:16:36.146440] [INFO ] [MAIN ] HDB: Loaded 52695 primary data records. [2025-09-29T02:16:36.274183] [INFO ] [MAIN ] HE: Loaded 49870 primary data records. [2025-09-29T02:16:37.020397] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:37.023185] [INFO ] [MAIN ] HEI: Generated 1820 derivative records from 32846 primary records. [2025-09-29T02:16:37.024221] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-29T02:16:37.046310] [DEBUG] [LOCAL ] HEI: Derivative data saved (1820 records). [2025-09-29T02:16:37.047089] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-29T02:16:37.049584] [INFO ] [MAIN ] Derivative Progress: 946/2211 symbols completed. HEI took 1.2s. Estimated remaining: 8m 55s. Rate: 141.9 symbols/min [2025-09-29T02:16:37.050030] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:37.086258] [DEBUG] [LOCAL ] HEQ: Loaded 6236 existing records from primary storage. [2025-09-29T02:16:37.092098] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:37.092376] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:37.093323] [INFO ] [MAIN ] HDB: Generated 1820 derivative records from 52695 primary records. [2025-09-29T02:16:37.093478] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-29T02:16:37.094123] [INFO ] [MAIN ] HEQ: Loaded 6236 primary data records. [2025-09-29T02:16:37.095253] [INFO ] [MAIN ] HE: Generated 1820 derivative records from 49870 primary records. [2025-09-29T02:16:37.101073] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-29T02:16:37.174486] [DEBUG] [LOCAL ] HDB: Derivative data saved (1820 records). [2025-09-29T02:16:37.240914] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-29T02:16:37.247417] [DEBUG] [LOCAL ] HE: Derivative data saved (1820 records). [2025-09-29T02:16:37.247531] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-29T02:16:37.252135] [INFO ] [MAIN ] Derivative Progress: 947/2211 symbols completed. HDB took 1.4s. Estimated remaining: 8m 54s. Rate: 141.9 symbols/min [2025-09-29T02:16:37.278245] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:37.278349] [INFO ] [MAIN ] Derivative Progress: 948/2211 symbols completed. HE took 1.4s. Estimated remaining: 8m 53s. Rate: 142.1 symbols/min [2025-09-29T02:16:37.297753] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:37.511822] [DEBUG] [LOCAL ] HFRO: Loaded 17798 existing records from primary storage. [2025-09-29T02:16:37.512451] [INFO ] [MAIN ] HFRO: Loaded 17798 primary data records. [2025-09-29T02:16:37.673588] [DEBUG] [LOCAL ] HESM: Loaded 48879 existing records from primary storage. [2025-09-29T02:16:37.739611] [INFO ] [MAIN ] HESM: Loaded 48879 primary data records. [2025-09-29T02:16:37.941710] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:37.989202] [INFO ] [MAIN ] HEQ: Generated 1820 derivative records from 6236 primary records. [2025-09-29T02:16:38.016758] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-29T02:16:38.091487] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1820 records). [2025-09-29T02:16:38.126128] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-29T02:16:38.136568] [INFO ] [MAIN ] Derivative Progress: 949/2211 symbols completed. HEQ took 1.1s. Estimated remaining: 8m 54s. Rate: 141.9 symbols/min [2025-09-29T02:16:38.262094] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:38.288961] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:38.289970] [INFO ] [MAIN ] HFRO: Generated 1820 derivative records from 17798 primary records. [2025-09-29T02:16:38.290268] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-29T02:16:38.310798] [DEBUG] [LOCAL ] HGER: Loaded 13428 existing records from primary storage. [2025-09-29T02:16:38.312144] [INFO ] [MAIN ] HGER: Loaded 13428 primary data records. [2025-09-29T02:16:38.349580] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1820 records). [2025-09-29T02:16:38.355481] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-29T02:16:38.371051] [INFO ] [MAIN ] Derivative Progress: 950/2211 symbols completed. HFRO took 1.1s. Estimated remaining: 8m 53s. Rate: 142.0 symbols/min [2025-09-29T02:16:38.401512] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:38.506048] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:38.543158] [INFO ] [MAIN ] HESM: Generated 1820 derivative records from 48879 primary records. [2025-09-29T02:16:38.543399] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-29T02:16:38.683048] [DEBUG] [LOCAL ] HGLB: Loaded 9836 existing records from primary storage. [2025-09-29T02:16:38.684180] [INFO ] [MAIN ] HGLB: Loaded 9836 primary data records. [2025-09-29T02:16:38.738309] [DEBUG] [LOCAL ] HESM: Derivative data saved (1820 records). [2025-09-29T02:16:38.766173] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-29T02:16:38.792051] [INFO ] [MAIN ] Derivative Progress: 951/2211 symbols completed. HESM took 1.5s. Estimated remaining: 8m 52s. Rate: 142.0 symbols/min [2025-09-29T02:16:38.819840] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:39.107241] [DEBUG] [LOCAL ] HGTY: Loaded 13290 existing records from primary storage. [2025-09-29T02:16:39.126189] [INFO ] [MAIN ] HGTY: Loaded 13290 primary data records. [2025-09-29T02:16:39.221717] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:39.247098] [INFO ] [MAIN ] HGER: Generated 1820 derivative records from 13428 primary records. [2025-09-29T02:16:39.269076] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-29T02:16:39.497737] [DEBUG] [LOCAL ] HGER: Derivative data saved (1820 records). [2025-09-29T02:16:39.508158] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-29T02:16:39.510859] [INFO ] [MAIN ] Derivative Progress: 952/2211 symbols completed. HGER took 1.2s. Estimated remaining: 8m 52s. Rate: 141.9 symbols/min [2025-09-29T02:16:39.511384] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:39.535877] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:39.537597] [INFO ] [MAIN ] HGLB: Generated 1820 derivative records from 9836 primary records. [2025-09-29T02:16:39.538770] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-29T02:16:39.558460] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1820 records). [2025-09-29T02:16:39.559128] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-29T02:16:39.561910] [INFO ] [MAIN ] Derivative Progress: 953/2211 symbols completed. HGLB took 1.2s. Estimated remaining: 8m 51s. Rate: 142.0 symbols/min [2025-09-29T02:16:39.562824] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:39.592743] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:39.593701] [INFO ] [MAIN ] HGTY: Generated 1820 derivative records from 13290 primary records. [2025-09-29T02:16:39.593877] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-29T02:16:39.611911] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1820 records). [2025-09-29T02:16:39.626031] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-29T02:16:39.629076] [INFO ] [MAIN ] Derivative Progress: 954/2211 symbols completed. HGTY took 0.8s. Estimated remaining: 8m 51s. Rate: 142.1 symbols/min [2025-09-29T02:16:39.630266] [DEBUG] [LOCAL ] HGV: Loaded 47426 existing records from primary storage. [2025-09-29T02:16:39.630611] [INFO ] [MAIN ] HGV: Loaded 47426 primary data records. [2025-09-29T02:16:39.630863] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:39.797051] [DEBUG] [LOCAL ] HHH: Loaded 33042 existing records from primary storage. [2025-09-29T02:16:39.807741] [INFO ] [MAIN ] HHH: Loaded 33042 primary data records. [2025-09-29T02:16:40.090987] [DEBUG] [LOCAL ] HI: Loaded 35713 existing records from primary storage. [2025-09-29T02:16:40.115779] [INFO ] [MAIN ] HI: Loaded 35713 primary data records. [2025-09-29T02:16:40.703281] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:40.705275] [INFO ] [MAIN ] HGV: Generated 1820 derivative records from 47426 primary records. [2025-09-29T02:16:40.706086] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-29T02:16:40.734469] [DEBUG] [LOCAL ] HGV: Derivative data saved (1820 records). [2025-09-29T02:16:40.735076] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-29T02:16:40.739601] [INFO ] [MAIN ] Derivative Progress: 955/2211 symbols completed. HGV took 1.2s. Estimated remaining: 8m 51s. Rate: 141.9 symbols/min [2025-09-29T02:16:40.740057] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:40.758900] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:40.760596] [INFO ] [MAIN ] HHH: Generated 1820 derivative records from 33042 primary records. [2025-09-29T02:16:40.761533] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-29T02:16:40.793220] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:40.796064] [INFO ] [MAIN ] HI: Generated 1820 derivative records from 35713 primary records. [2025-09-29T02:16:40.798638] [DEBUG] [LOCAL ] HHH: Derivative data saved (1820 records). [2025-09-29T02:16:40.797989] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-29T02:16:40.799118] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-29T02:16:40.803618] [INFO ] [MAIN ] Derivative Progress: 956/2211 symbols completed. HHH took 1.2s. Estimated remaining: 8m 50s. Rate: 142.0 symbols/min [2025-09-29T02:16:40.803932] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:40.823812] [DEBUG] [LOCAL ] HI: Derivative data saved (1820 records). [2025-09-29T02:16:40.824260] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-29T02:16:40.827704] [INFO ] [MAIN ] Derivative Progress: 957/2211 symbols completed. HI took 1.2s. Estimated remaining: 8m 49s. Rate: 142.2 symbols/min [2025-09-29T02:16:40.827971] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:40.893796] [DEBUG] [LOCAL ] HII: Loaded 35728 existing records from primary storage. [2025-09-29T02:16:40.894398] [INFO ] [MAIN ] HII: Loaded 35728 primary data records. [2025-09-29T02:16:40.901319] [DEBUG] [LOCAL ] HIG: Loaded 51962 existing records from primary storage. [2025-09-29T02:16:40.922234] [INFO ] [MAIN ] HIG: Loaded 51962 primary data records. [2025-09-29T02:16:41.327630] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-29T02:16:41.448503] [INFO ] [MAIN ] HIMS: Loaded 54597 primary data records. [2025-09-29T02:16:42.024000] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:42.024504] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:42.025551] [INFO ] [MAIN ] HIG: Generated 1820 derivative records from 51962 primary records. [2025-09-29T02:16:42.026409] [INFO ] [MAIN ] HII: Generated 1820 derivative records from 35728 primary records. [2025-09-29T02:16:42.026665] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-29T02:16:42.027156] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-29T02:16:42.054839] [DEBUG] [LOCAL ] HIG: Derivative data saved (1820 records). [2025-09-29T02:16:42.062338] [DEBUG] [LOCAL ] HII: Derivative data saved (1820 records). [2025-09-29T02:16:42.062804] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-29T02:16:42.066189] [INFO ] [MAIN ] Derivative Progress: 958/2211 symbols completed. HIG took 1.3s. Estimated remaining: 8m 50s. Rate: 141.9 symbols/min [2025-09-29T02:16:42.066688] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-29T02:16:42.069543] [INFO ] [MAIN ] Derivative Progress: 959/2211 symbols completed. HII took 1.3s. Estimated remaining: 8m 49s. Rate: 142.0 symbols/min [2025-09-29T02:16:42.086607] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:42.087595] [INFO ] [MAIN ] HIMS: Generated 1820 derivative records from 54597 primary records. [2025-09-29T02:16:42.087770] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-29T02:16:42.104249] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1820 records). [2025-09-29T02:16:42.104412] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-29T02:16:42.107688] [INFO ] [MAIN ] Derivative Progress: 960/2211 symbols completed. HIMS took 1.3s. Estimated remaining: 8m 48s. Rate: 142.2 symbols/min [2025-09-29T02:16:42.108158] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:42.108343] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:42.108207] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:42.146574] [DEBUG] [LOCAL ] HIO: Loaded 24107 existing records from primary storage. [2025-09-29T02:16:42.146866] [INFO ] [MAIN ] HIO: Loaded 24107 primary data records. [2025-09-29T02:16:42.257340] [DEBUG] [LOCAL ] HIPO: Loaded 22774 existing records from primary storage. [2025-09-29T02:16:42.278618] [INFO ] [MAIN ] HIPO: Loaded 22774 primary data records. [2025-09-29T02:16:42.379251] [DEBUG] [LOCAL ] HIW: Loaded 45329 existing records from primary storage. [2025-09-29T02:16:42.495103] [INFO ] [MAIN ] HIW: Loaded 45329 primary data records. [2025-09-29T02:16:43.370687] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:43.372998] [INFO ] [MAIN ] HIO: Generated 1820 derivative records from 24107 primary records. [2025-09-29T02:16:43.373955] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-29T02:16:43.388607] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:43.401446] [INFO ] [MAIN ] HIPO: Generated 1820 derivative records from 22774 primary records. [2025-09-29T02:16:43.405394] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-29T02:16:43.407232] [DEBUG] [LOCAL ] HIO: Derivative data saved (1820 records). [2025-09-29T02:16:43.407599] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-29T02:16:43.412029] [INFO ] [MAIN ] Derivative Progress: 961/2211 symbols completed. HIO took 1.3s. Estimated remaining: 8m 49s. Rate: 141.9 symbols/min [2025-09-29T02:16:43.412625] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:43.431169] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1820 records). [2025-09-29T02:16:43.431614] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-29T02:16:43.435836] [INFO ] [MAIN ] Derivative Progress: 962/2211 symbols completed. HIPO took 1.3s. Estimated remaining: 8m 48s. Rate: 142.0 symbols/min [2025-09-29T02:16:43.436384] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:43.460887] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:43.463106] [INFO ] [MAIN ] HIW: Generated 1820 derivative records from 45329 primary records. [2025-09-29T02:16:43.463319] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-29T02:16:43.490153] [DEBUG] [LOCAL ] HIW: Derivative data saved (1820 records). [2025-09-29T02:16:43.490327] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-29T02:16:43.494196] [INFO ] [MAIN ] Derivative Progress: 963/2211 symbols completed. HIW took 1.4s. Estimated remaining: 8m 47s. Rate: 142.1 symbols/min [2025-09-29T02:16:43.494441] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:43.513061] [DEBUG] [LOCAL ] HIX: Loaded 20714 existing records from primary storage. [2025-09-29T02:16:43.513677] [DEBUG] [LOCAL ] HKD: Loaded 18654 existing records from primary storage. [2025-09-29T02:16:43.514060] [INFO ] [MAIN ] HIX: Loaded 20714 primary data records. [2025-09-29T02:16:43.514281] [INFO ] [MAIN ] HKD: Loaded 18654 primary data records. [2025-09-29T02:16:44.086268] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-09-29T02:16:44.093513] [INFO ] [MAIN ] HL: Loaded 54451 primary data records. [2025-09-29T02:16:44.610392] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:44.613596] [INFO ] [MAIN ] HIX: Generated 1820 derivative records from 20714 primary records. [2025-09-29T02:16:44.613887] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-29T02:16:44.643052] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:44.646740] [DEBUG] [LOCAL ] HIX: Derivative data saved (1820 records). [2025-09-29T02:16:44.647811] [INFO ] [MAIN ] HKD: Generated 1820 derivative records from 18654 primary records. [2025-09-29T02:16:44.646950] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-29T02:16:44.651767] [INFO ] [MAIN ] Derivative Progress: 964/2211 symbols completed. HIX took 1.2s. Estimated remaining: 8m 47s. Rate: 141.9 symbols/min [2025-09-29T02:16:44.653266] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:44.653112] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-29T02:16:44.672543] [DEBUG] [LOCAL ] HKD: Derivative data saved (1820 records). [2025-09-29T02:16:44.673722] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-29T02:16:44.677585] [INFO ] [MAIN ] Derivative Progress: 965/2211 symbols completed. HKD took 1.2s. Estimated remaining: 8m 46s. Rate: 142.0 symbols/min [2025-09-29T02:16:44.678109] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:44.698314] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:44.699198] [INFO ] [MAIN ] HL: Generated 1820 derivative records from 54451 primary records. [2025-09-29T02:16:44.699475] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-29T02:16:44.718602] [DEBUG] [LOCAL ] HL: Derivative data saved (1820 records). [2025-09-29T02:16:44.718828] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-29T02:16:44.723560] [INFO ] [MAIN ] Derivative Progress: 966/2211 symbols completed. HL took 1.2s. Estimated remaining: 8m 46s. Rate: 142.1 symbols/min [2025-09-29T02:16:44.736272] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:44.769890] [DEBUG] [LOCAL ] HLF: Loaded 49357 existing records from primary storage. [2025-09-29T02:16:44.770443] [INFO ] [MAIN ] HLF: Loaded 49357 primary data records. [2025-09-29T02:16:44.917042] [DEBUG] [LOCAL ] HLI: Loaded 31573 existing records from primary storage. [2025-09-29T02:16:44.918435] [INFO ] [MAIN ] HLI: Loaded 31573 primary data records. [2025-09-29T02:16:44.918231] [DEBUG] [LOCAL ] HLIO: Loaded 28490 existing records from primary storage. [2025-09-29T02:16:44.979932] [INFO ] [MAIN ] HLIO: Loaded 28490 primary data records. [2025-09-29T02:16:45.953780] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:45.955074] [INFO ] [MAIN ] HLF: Generated 1820 derivative records from 49357 primary records. [2025-09-29T02:16:45.956949] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-29T02:16:45.984922] [DEBUG] [LOCAL ] HLF: Derivative data saved (1820 records). [2025-09-29T02:16:45.985194] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-29T02:16:45.988955] [INFO ] [MAIN ] Derivative Progress: 967/2211 symbols completed. HLF took 1.3s. Estimated remaining: 8m 46s. Rate: 141.8 symbols/min [2025-09-29T02:16:45.990078] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:46.039393] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:46.042493] [INFO ] [MAIN ] HLIO: Generated 1820 derivative records from 28490 primary records. [2025-09-29T02:16:46.043290] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-29T02:16:46.043854] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:46.046364] [INFO ] [MAIN ] HLI: Generated 1820 derivative records from 31573 primary records. [2025-09-29T02:16:46.056984] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-29T02:16:46.078317] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1820 records). [2025-09-29T02:16:46.091735] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-29T02:16:46.104711] [INFO ] [MAIN ] Derivative Progress: 968/2211 symbols completed. HLIO took 1.4s. Estimated remaining: 8m 45s. Rate: 141.9 symbols/min [2025-09-29T02:16:46.110789] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:46.123147] [DEBUG] [LOCAL ] HLI: Derivative data saved (1820 records). [2025-09-29T02:16:46.125081] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-29T02:16:46.124977] [DEBUG] [LOCAL ] HLLY: Loaded 33911 existing records from primary storage. [2025-09-29T02:16:46.130325] [INFO ] [MAIN ] Derivative Progress: 969/2211 symbols completed. HLI took 1.5s. Estimated remaining: 8m 44s. Rate: 142.1 symbols/min [2025-09-29T02:16:46.130822] [INFO ] [MAIN ] HLLY: Loaded 33911 primary data records. [2025-09-29T02:16:46.130980] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:46.481528] [DEBUG] [LOCAL ] HLN: Loaded 53861 existing records from primary storage. [2025-09-29T02:16:46.557724] [DEBUG] [LOCAL ] HLT: Loaded 51450 existing records from primary storage. [2025-09-29T02:16:46.551951] [INFO ] [MAIN ] HLN: Loaded 53861 primary data records. [2025-09-29T02:16:46.749585] [INFO ] [MAIN ] HLT: Loaded 51450 primary data records. [2025-09-29T02:16:47.565841] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:47.568907] [INFO ] [MAIN ] HLLY: Generated 1820 derivative records from 33911 primary records. [2025-09-29T02:16:47.569529] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-29T02:16:47.591472] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1820 records). [2025-09-29T02:16:47.592591] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-29T02:16:47.595477] [INFO ] [MAIN ] Derivative Progress: 970/2211 symbols completed. HLLY took 1.6s. Estimated remaining: 8m 45s. Rate: 141.7 symbols/min [2025-09-29T02:16:47.596067] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:47.633978] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:47.635180] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:47.635965] [INFO ] [MAIN ] HLN: Generated 1820 derivative records from 53861 primary records. [2025-09-29T02:16:47.636772] [INFO ] [MAIN ] HLT: Generated 1820 derivative records from 51450 primary records. [2025-09-29T02:16:47.637077] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-29T02:16:47.636962] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-29T02:16:47.669614] [DEBUG] [LOCAL ] HLT: Derivative data saved (1820 records). [2025-09-29T02:16:47.670967] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-29T02:16:47.678137] [INFO ] [MAIN ] Derivative Progress: 971/2211 symbols completed. HLT took 1.5s. Estimated remaining: 8m 45s. Rate: 141.8 symbols/min [2025-09-29T02:16:47.678852] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:47.680575] [DEBUG] [LOCAL ] HLN: Derivative data saved (1820 records). [2025-09-29T02:16:47.692986] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-29T02:16:47.696779] [INFO ] [MAIN ] Derivative Progress: 972/2211 symbols completed. HLN took 1.6s. Estimated remaining: 8m 44s. Rate: 142.0 symbols/min [2025-09-29T02:16:47.697081] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:47.723687] [DEBUG] [LOCAL ] HLX: Loaded 48650 existing records from primary storage. [2025-09-29T02:16:47.724122] [INFO ] [MAIN ] HLX: Loaded 48650 primary data records. [2025-09-29T02:16:47.873629] [DEBUG] [LOCAL ] HMN: Loaded 23671 existing records from primary storage. [2025-09-29T02:16:47.889530] [INFO ] [MAIN ] HMN: Loaded 23671 primary data records. [2025-09-29T02:16:48.183936] [DEBUG] [LOCAL ] HMC: Loaded 47500 existing records from primary storage. [2025-09-29T02:16:48.221056] [INFO ] [MAIN ] HMC: Loaded 47500 primary data records. [2025-09-29T02:16:48.840307] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:48.842567] [INFO ] [MAIN ] HLX: Generated 1820 derivative records from 48650 primary records. [2025-09-29T02:16:48.842776] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-29T02:16:48.864195] [DEBUG] [LOCAL ] HLX: Derivative data saved (1820 records). [2025-09-29T02:16:48.864952] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-29T02:16:48.868829] [INFO ] [MAIN ] Derivative Progress: 973/2211 symbols completed. HLX took 1.3s. Estimated remaining: 8m 44s. Rate: 141.7 symbols/min [2025-09-29T02:16:48.886460] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:48.887497] [INFO ] [MAIN ] HMN: Generated 1820 derivative records from 23671 primary records. [2025-09-29T02:16:48.887756] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-29T02:16:48.907564] [DEBUG] [LOCAL ] HMN: Derivative data saved (1820 records). [2025-09-29T02:16:48.907792] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-29T02:16:48.911508] [INFO ] [MAIN ] Derivative Progress: 974/2211 symbols completed. HMN took 1.2s. Estimated remaining: 8m 43s. Rate: 141.9 symbols/min [2025-09-29T02:16:48.924896] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:48.925610] [INFO ] [MAIN ] HMC: Generated 1820 derivative records from 47500 primary records. [2025-09-29T02:16:48.925714] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-29T02:16:48.941960] [DEBUG] [LOCAL ] HMC: Derivative data saved (1820 records). [2025-09-29T02:16:48.942111] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-29T02:16:48.945216] [INFO ] [MAIN ] Derivative Progress: 975/2211 symbols completed. HMC took 1.3s. Estimated remaining: 8m 42s. Rate: 142.0 symbols/min [2025-09-29T02:16:48.945857] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:48.946100] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:48.945985] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:48.986094] [DEBUG] [LOCAL ] HNI: Loaded 29386 existing records from primary storage. [2025-09-29T02:16:48.986342] [INFO ] [MAIN ] HNI: Loaded 29386 primary data records. [2025-09-29T02:16:49.165283] [DEBUG] [LOCAL ] HOG: Loaded 51958 existing records from primary storage. [2025-09-29T02:16:49.199934] [INFO ] [MAIN ] HOG: Loaded 51958 primary data records. [2025-09-29T02:16:49.424163] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-09-29T02:16:49.457102] [INFO ] [MAIN ] HMY: Loaded 53914 primary data records. [2025-09-29T02:16:50.112716] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:50.113625] [INFO ] [MAIN ] HNI: Generated 1820 derivative records from 29386 primary records. [2025-09-29T02:16:50.114227] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-29T02:16:50.134542] [DEBUG] [LOCAL ] HNI: Derivative data saved (1820 records). [2025-09-29T02:16:50.136370] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-29T02:16:50.140593] [INFO ] [MAIN ] Derivative Progress: 976/2211 symbols completed. HNI took 1.2s. Estimated remaining: 8m 43s. Rate: 141.7 symbols/min [2025-09-29T02:16:50.141199] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:50.161508] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:50.163062] [INFO ] [MAIN ] HOG: Generated 1820 derivative records from 51958 primary records. [2025-09-29T02:16:50.164177] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-29T02:16:50.186185] [DEBUG] [LOCAL ] HOG: Derivative data saved (1820 records). [2025-09-29T02:16:50.195062] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-29T02:16:50.203155] [INFO ] [MAIN ] Derivative Progress: 977/2211 symbols completed. HOG took 1.3s. Estimated remaining: 8m 42s. Rate: 141.8 symbols/min [2025-09-29T02:16:50.204435] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:50.204552] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:50.206600] [INFO ] [MAIN ] HMY: Generated 1820 derivative records from 53914 primary records. [2025-09-29T02:16:50.206782] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-29T02:16:50.234860] [DEBUG] [LOCAL ] HMY: Derivative data saved (1820 records). [2025-09-29T02:16:50.235203] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-29T02:16:50.239532] [INFO ] [MAIN ] Derivative Progress: 978/2211 symbols completed. HMY took 1.3s. Estimated remaining: 8m 41s. Rate: 142.0 symbols/min [2025-09-29T02:16:50.239908] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:50.263006] [DEBUG] [LOCAL ] HOMB: Loaded 44272 existing records from primary storage. [2025-09-29T02:16:50.267561] [INFO ] [MAIN ] HOMB: Loaded 44272 primary data records. [2025-09-29T02:16:50.373496] [DEBUG] [LOCAL ] HOV: Loaded 13975 existing records from primary storage. [2025-09-29T02:16:50.402426] [INFO ] [MAIN ] HOV: Loaded 13975 primary data records. [2025-09-29T02:16:50.469722] [DEBUG] [LOCAL ] HOUS: Loaded 44903 existing records from primary storage. [2025-09-29T02:16:50.526033] [INFO ] [MAIN ] HOUS: Loaded 44903 primary data records. [2025-09-29T02:16:51.375962] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:51.389448] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:51.390453] [INFO ] [MAIN ] HOMB: Generated 1820 derivative records from 44272 primary records. [2025-09-29T02:16:51.392683] [INFO ] [MAIN ] HOV: Generated 1820 derivative records from 13975 primary records. [2025-09-29T02:16:51.391843] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-29T02:16:51.392805] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-29T02:16:51.426750] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1820 records). [2025-09-29T02:16:51.426842] [DEBUG] [LOCAL ] HOV: Derivative data saved (1820 records). [2025-09-29T02:16:51.427166] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-29T02:16:51.431320] [INFO ] [MAIN ] Derivative Progress: 979/2211 symbols completed. HOMB took 1.3s. Estimated remaining: 8m 42s. Rate: 141.7 symbols/min [2025-09-29T02:16:51.427336] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-29T02:16:51.434717] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:51.434781] [INFO ] [MAIN ] Derivative Progress: 980/2211 symbols completed. HOV took 1.2s. Estimated remaining: 8m 41s. Rate: 141.9 symbols/min [2025-09-29T02:16:51.435342] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:51.453920] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:51.455099] [INFO ] [MAIN ] HOUS: Generated 1820 derivative records from 44903 primary records. [2025-09-29T02:16:51.455332] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-29T02:16:51.478216] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1820 records). [2025-09-29T02:16:51.478400] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-29T02:16:51.482291] [INFO ] [MAIN ] Derivative Progress: 981/2211 symbols completed. HOUS took 1.3s. Estimated remaining: 8m 40s. Rate: 142.0 symbols/min [2025-09-29T02:16:51.482707] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:51.510639] [DEBUG] [LOCAL ] HPF: Loaded 7388 existing records from primary storage. [2025-09-29T02:16:51.510961] [INFO ] [MAIN ] HPF: Loaded 7388 primary data records. [2025-09-29T02:16:51.692624] [DEBUG] [LOCAL ] HP: Loaded 52313 existing records from primary storage. [2025-09-29T02:16:51.703467] [INFO ] [MAIN ] HP: Loaded 52313 primary data records. [2025-09-29T02:16:51.715198] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-29T02:16:51.785394] [INFO ] [MAIN ] HPE: Loaded 54477 primary data records. [2025-09-29T02:16:52.666093] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:52.668373] [INFO ] [MAIN ] HPF: Generated 1820 derivative records from 7388 primary records. [2025-09-29T02:16:52.668630] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-29T02:16:52.687451] [DEBUG] [LOCAL ] HPF: Derivative data saved (1820 records). [2025-09-29T02:16:52.688348] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-29T02:16:52.690546] [INFO ] [MAIN ] Derivative Progress: 982/2211 symbols completed. HPF took 1.2s. Estimated remaining: 8m 40s. Rate: 141.7 symbols/min [2025-09-29T02:16:52.691162] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:52.709326] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:52.710810] [INFO ] [MAIN ] HP: Generated 1820 derivative records from 52313 primary records. [2025-09-29T02:16:52.711169] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-29T02:16:52.736873] [DEBUG] [LOCAL ] HPI: Loaded 10339 existing records from primary storage. [2025-09-29T02:16:52.752830] [INFO ] [MAIN ] HPI: Loaded 10339 primary data records. [2025-09-29T02:16:52.755153] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:52.756116] [INFO ] [MAIN ] HPE: Generated 1820 derivative records from 54477 primary records. [2025-09-29T02:16:52.761659] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-29T02:16:52.768971] [DEBUG] [LOCAL ] HP: Derivative data saved (1820 records). [2025-09-29T02:16:52.769085] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-29T02:16:52.788954] [INFO ] [MAIN ] Derivative Progress: 983/2211 symbols completed. HP took 1.4s. Estimated remaining: 8m 39s. Rate: 141.8 symbols/min [2025-09-29T02:16:52.818170] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:52.897672] [DEBUG] [LOCAL ] HPE: Derivative data saved (1820 records). [2025-09-29T02:16:52.951211] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-29T02:16:52.991483] [INFO ] [MAIN ] Derivative Progress: 984/2211 symbols completed. HPE took 1.6s. Estimated remaining: 8m 39s. Rate: 141.9 symbols/min [2025-09-29T02:16:53.114840] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:53.159275] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-09-29T02:16:53.159673] [INFO ] [MAIN ] HPP: Loaded 51595 primary data records. [2025-09-29T02:16:53.359602] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:53.509489] [INFO ] [MAIN ] HPI: Generated 1820 derivative records from 10339 primary records. [2025-09-29T02:16:53.521601] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-29T02:16:53.555685] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-29T02:16:53.556602] [INFO ] [MAIN ] HPQ: Loaded 54448 primary data records. [2025-09-29T02:16:53.603609] [DEBUG] [LOCAL ] HPI: Derivative data saved (1820 records). [2025-09-29T02:16:53.618675] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-29T02:16:53.681859] [INFO ] [MAIN ] Derivative Progress: 985/2211 symbols completed. HPI took 1.0s. Estimated remaining: 8m 39s. Rate: 141.8 symbols/min [2025-09-29T02:16:53.687010] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:53.905127] [DEBUG] [LOCAL ] HPS: Loaded 10277 existing records from primary storage. [2025-09-29T02:16:53.916394] [INFO ] [MAIN ] HPS: Loaded 10277 primary data records. [2025-09-29T02:16:54.009100] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:54.035255] [INFO ] [MAIN ] HPP: Generated 1820 derivative records from 51595 primary records. [2025-09-29T02:16:54.055922] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-29T02:16:54.287199] [DEBUG] [LOCAL ] HPP: Derivative data saved (1820 records). [2025-09-29T02:16:54.289003] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-29T02:16:54.292307] [INFO ] [MAIN ] Derivative Progress: 986/2211 symbols completed. HPP took 1.5s. Estimated remaining: 8m 39s. Rate: 141.8 symbols/min [2025-09-29T02:16:54.293038] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:54.314437] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:54.315327] [INFO ] [MAIN ] HPQ: Generated 1820 derivative records from 54448 primary records. [2025-09-29T02:16:54.315527] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-29T02:16:54.342688] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1820 records). [2025-09-29T02:16:54.343147] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-29T02:16:54.346037] [INFO ] [MAIN ] Derivative Progress: 987/2211 symbols completed. HPQ took 1.2s. Estimated remaining: 8m 38s. Rate: 141.9 symbols/min [2025-09-29T02:16:54.346738] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:54.375028] [DEBUG] [LOCAL ] HQH: Loaded 25387 existing records from primary storage. [2025-09-29T02:16:54.375463] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:54.375728] [INFO ] [MAIN ] HQH: Loaded 25387 primary data records. [2025-09-29T02:16:54.376417] [INFO ] [MAIN ] HPS: Generated 1820 derivative records from 10277 primary records. [2025-09-29T02:16:54.376699] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-29T02:16:54.520827] [DEBUG] [LOCAL ] HQL: Loaded 16206 existing records from primary storage. [2025-09-29T02:16:54.521444] [DEBUG] [LOCAL ] HPS: Derivative data saved (1820 records). [2025-09-29T02:16:54.526849] [INFO ] [MAIN ] HQL: Loaded 16206 primary data records. [2025-09-29T02:16:54.526975] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-29T02:16:54.540695] [INFO ] [MAIN ] Derivative Progress: 988/2211 symbols completed. HPS took 0.9s. Estimated remaining: 8m 37s. Rate: 142.0 symbols/min [2025-09-29T02:16:55.143852] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:55.144662] [INFO ] [MAIN ] HQH: Generated 1820 derivative records from 25387 primary records. [2025-09-29T02:16:55.144901] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-29T02:16:55.162693] [DEBUG] [LOCAL ] HQH: Derivative data saved (1820 records). [2025-09-29T02:16:55.162879] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-29T02:16:55.165465] [INFO ] [MAIN ] Derivative Progress: 989/2211 symbols completed. HQH took 0.9s. Estimated remaining: 8m 37s. Rate: 141.9 symbols/min [2025-09-29T02:16:55.182158] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:55.182980] [INFO ] [MAIN ] HQL: Generated 1820 derivative records from 16206 primary records. [2025-09-29T02:16:55.183087] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-29T02:16:55.199183] [DEBUG] [LOCAL ] HQL: Derivative data saved (1820 records). [2025-09-29T02:16:55.199325] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-29T02:16:55.202195] [INFO ] [MAIN ] Derivative Progress: 990/2211 symbols completed. HQL took 0.9s. Estimated remaining: 8m 36s. Rate: 142.0 symbols/min [2025-09-29T02:16:55.202632] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:55.202748] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:55.202890] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:55.286536] [DEBUG] [LOCAL ] HRI: Loaded 33507 existing records from primary storage. [2025-09-29T02:16:55.287078] [INFO ] [MAIN ] HRI: Loaded 33507 primary data records. [2025-09-29T02:16:55.455323] [DEBUG] [LOCAL ] HR: Loaded 52716 existing records from primary storage. [2025-09-29T02:16:55.460839] [INFO ] [MAIN ] HR: Loaded 52716 primary data records. [2025-09-29T02:16:55.491591] [DEBUG] [LOCAL ] HRB: Loaded 49275 existing records from primary storage. [2025-09-29T02:16:55.585821] [INFO ] [MAIN ] HRB: Loaded 49275 primary data records. [2025-09-29T02:16:56.403797] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:56.405151] [INFO ] [MAIN ] HRI: Generated 1820 derivative records from 33507 primary records. [2025-09-29T02:16:56.405404] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-29T02:16:56.424077] [DEBUG] [LOCAL ] HRI: Derivative data saved (1820 records). [2025-09-29T02:16:56.424924] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-29T02:16:56.427800] [INFO ] [MAIN ] Derivative Progress: 991/2211 symbols completed. HRI took 1.2s. Estimated remaining: 8m 36s. Rate: 141.7 symbols/min [2025-09-29T02:16:56.428241] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:56.458881] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:56.464437] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:56.466167] [INFO ] [MAIN ] HRB: Generated 1820 derivative records from 49275 primary records. [2025-09-29T02:16:56.467069] [INFO ] [MAIN ] HR: Generated 1820 derivative records from 52716 primary records. [2025-09-29T02:16:56.467160] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-29T02:16:56.467981] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-29T02:16:56.503587] [DEBUG] [LOCAL ] HRB: Derivative data saved (1820 records). [2025-09-29T02:16:56.503390] [DEBUG] [LOCAL ] HR: Derivative data saved (1820 records). [2025-09-29T02:16:56.503822] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-29T02:16:56.507683] [INFO ] [MAIN ] Derivative Progress: 992/2211 symbols completed. HRB took 1.3s. Estimated remaining: 8m 36s. Rate: 141.9 symbols/min [2025-09-29T02:16:56.507960] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:56.503989] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-29T02:16:56.510978] [INFO ] [MAIN ] Derivative Progress: 993/2211 symbols completed. HR took 1.3s. Estimated remaining: 8m 35s. Rate: 142.0 symbols/min [2025-09-29T02:16:56.511484] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:56.570796] [DEBUG] [LOCAL ] HRL: Loaded 53855 existing records from primary storage. [2025-09-29T02:16:56.571332] [INFO ] [MAIN ] HRL: Loaded 53855 primary data records. [2025-09-29T02:16:56.637789] [DEBUG] [LOCAL ] HRTG: Loaded 33658 existing records from primary storage. [2025-09-29T02:16:56.662183] [INFO ] [MAIN ] HRTG: Loaded 33658 primary data records. [2025-09-29T02:16:57.110305] [DEBUG] [LOCAL ] HSBC: Loaded 51868 existing records from primary storage. [2025-09-29T02:16:57.147984] [INFO ] [MAIN ] HSBC: Loaded 51868 primary data records. [2025-09-29T02:16:57.700293] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:57.701977] [INFO ] [MAIN ] HRL: Generated 1820 derivative records from 53855 primary records. [2025-09-29T02:16:57.705476] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-29T02:16:57.727612] [DEBUG] [LOCAL ] HRL: Derivative data saved (1820 records). [2025-09-29T02:16:57.730866] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-29T02:16:57.734059] [INFO ] [MAIN ] Derivative Progress: 994/2211 symbols completed. HRL took 1.3s. Estimated remaining: 8m 35s. Rate: 141.7 symbols/min [2025-09-29T02:16:57.735601] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:57.750486] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:57.752388] [INFO ] [MAIN ] HRTG: Generated 1820 derivative records from 33658 primary records. [2025-09-29T02:16:57.752867] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-29T02:16:57.778233] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1820 records). [2025-09-29T02:16:57.778791] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-29T02:16:57.781994] [INFO ] [MAIN ] Derivative Progress: 995/2211 symbols completed. HRTG took 1.3s. Estimated remaining: 8m 34s. Rate: 141.9 symbols/min [2025-09-29T02:16:57.782330] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:57.791166] [DEBUG] [LOCAL ] HSHP: Loaded 15773 existing records from primary storage. [2025-09-29T02:16:57.791579] [INFO ] [MAIN ] HSHP: Loaded 15773 primary data records. [2025-09-29T02:16:57.816804] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:57.863911] [INFO ] [MAIN ] HSBC: Generated 1820 derivative records from 51868 primary records. [2025-09-29T02:16:57.895842] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-29T02:16:58.181762] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1820 records). [2025-09-29T02:16:58.181965] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-29T02:16:58.185872] [INFO ] [MAIN ] Derivative Progress: 996/2211 symbols completed. HSBC took 1.7s. Estimated remaining: 8m 34s. Rate: 141.9 symbols/min [2025-09-29T02:16:58.187044] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:58.212008] [DEBUG] [LOCAL ] HSY: Loaded 51161 existing records from primary storage. [2025-09-29T02:16:58.212964] [INFO ] [MAIN ] HSY: Loaded 51161 primary data records. [2025-09-29T02:16:58.329240] [DEBUG] [LOCAL ] HTD: Loaded 13754 existing records from primary storage. [2025-09-29T02:16:58.395773] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:58.412753] [INFO ] [MAIN ] HTD: Loaded 13754 primary data records. [2025-09-29T02:16:58.450077] [INFO ] [MAIN ] HSHP: Generated 1820 derivative records from 15773 primary records. [2025-09-29T02:16:58.583117] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-29T02:16:58.728154] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1820 records). [2025-09-29T02:16:58.797250] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-29T02:16:58.922090] [INFO ] [MAIN ] Derivative Progress: 997/2211 symbols completed. HSHP took 1.2s. Estimated remaining: 8m 34s. Rate: 141.8 symbols/min [2025-09-29T02:16:58.938604] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:58.968893] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:58.969943] [INFO ] [MAIN ] HSY: Generated 1820 derivative records from 51161 primary records. [2025-09-29T02:16:58.970071] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-29T02:16:58.993622] [DEBUG] [LOCAL ] HSY: Derivative data saved (1820 records). [2025-09-29T02:16:58.994211] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-29T02:16:58.998162] [INFO ] [MAIN ] Derivative Progress: 998/2211 symbols completed. HSY took 1.2s. Estimated remaining: 8m 33s. Rate: 141.9 symbols/min [2025-09-29T02:16:58.999759] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:59.029198] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:59.030117] [INFO ] [MAIN ] HTD: Generated 1820 derivative records from 13754 primary records. [2025-09-29T02:16:59.030263] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-29T02:16:59.071393] [DEBUG] [LOCAL ] HTD: Derivative data saved (1820 records). [2025-09-29T02:16:59.071806] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-29T02:16:59.072868] [DEBUG] [LOCAL ] HTGC: Loaded 48222 existing records from primary storage. [2025-09-29T02:16:59.076253] [INFO ] [MAIN ] Derivative Progress: 999/2211 symbols completed. HTD took 0.9s. Estimated remaining: 8m 32s. Rate: 142.0 symbols/min [2025-09-29T02:16:59.076580] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:59.076661] [INFO ] [MAIN ] HTGC: Loaded 48222 primary data records. [2025-09-29T02:16:59.177686] [DEBUG] [LOCAL ] HTH: Loaded 32696 existing records from primary storage. [2025-09-29T02:16:59.207852] [INFO ] [MAIN ] HTH: Loaded 32696 primary data records. [2025-09-29T02:16:59.636244] [DEBUG] [LOCAL ] HUBB: Loaded 37650 existing records from primary storage. [2025-09-29T02:16:59.676625] [INFO ] [MAIN ] HUBB: Loaded 37650 primary data records. [2025-09-29T02:17:00.224391] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:00.225304] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:00.227178] [INFO ] [MAIN ] HTH: Generated 1820 derivative records from 32696 primary records. [2025-09-29T02:17:00.228069] [INFO ] [MAIN ] HTGC: Generated 1820 derivative records from 48222 primary records. [2025-09-29T02:17:00.228257] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-29T02:17:00.228822] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-29T02:17:00.263586] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1820 records). [2025-09-29T02:17:00.264921] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-29T02:17:00.268557] [INFO ] [MAIN ] Derivative Progress: 1000/2211 symbols completed. HTGC took 1.3s. Estimated remaining: 8m 33s. Rate: 141.7 symbols/min [2025-09-29T02:17:00.270297] [DEBUG] [LOCAL ] HTH: Derivative data saved (1820 records). [2025-09-29T02:17:00.270482] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:00.271318] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-29T02:17:00.277682] [INFO ] [MAIN ] Derivative Progress: 1001/2211 symbols completed. HTH took 1.3s. Estimated remaining: 8m 32s. Rate: 141.9 symbols/min [2025-09-29T02:17:00.278493] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:00.298467] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:00.299969] [INFO ] [MAIN ] HUBB: Generated 1820 derivative records from 37650 primary records. [2025-09-29T02:17:00.300148] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-29T02:17:00.335881] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1820 records). [2025-09-29T02:17:00.336086] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-29T02:17:00.341170] [INFO ] [MAIN ] Derivative Progress: 1002/2211 symbols completed. HUBB took 1.3s. Estimated remaining: 8m 31s. Rate: 142.0 symbols/min [2025-09-29T02:17:00.341775] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:00.361172] [DEBUG] [LOCAL ] HUBS: Loaded 39953 existing records from primary storage. [2025-09-29T02:17:00.374584] [INFO ] [MAIN ] HUBS: Loaded 39953 primary data records. [2025-09-29T02:17:00.516110] [DEBUG] [LOCAL ] HUM: Loaded 49568 existing records from primary storage. [2025-09-29T02:17:00.516461] [INFO ] [MAIN ] HUM: Loaded 49568 primary data records. [2025-09-29T02:17:00.991777] [DEBUG] [LOCAL ] HUN: Loaded 53976 existing records from primary storage. [2025-09-29T02:17:00.992308] [INFO ] [MAIN ] HUN: Loaded 53976 primary data records. [2025-09-29T02:17:01.572155] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:01.576129] [INFO ] [MAIN ] HUBS: Generated 1820 derivative records from 39953 primary records. [2025-09-29T02:17:01.576593] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-29T02:17:01.599091] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1820 records). [2025-09-29T02:17:01.617552] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-29T02:17:01.622440] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:01.621544] [INFO ] [MAIN ] Derivative Progress: 1003/2211 symbols completed. HUBS took 1.4s. Estimated remaining: 8m 31s. Rate: 141.7 symbols/min [2025-09-29T02:17:01.623452] [INFO ] [MAIN ] HUM: Generated 1820 derivative records from 49568 primary records. [2025-09-29T02:17:01.623572] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-29T02:17:01.644300] [DEBUG] [LOCAL ] HUM: Derivative data saved (1820 records). [2025-09-29T02:17:01.644766] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-29T02:17:01.648107] [INFO ] [MAIN ] Derivative Progress: 1004/2211 symbols completed. HUM took 1.4s. Estimated remaining: 8m 31s. Rate: 141.8 symbols/min [2025-09-29T02:17:01.668278] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:01.669048] [INFO ] [MAIN ] HUN: Generated 1820 derivative records from 53976 primary records. [2025-09-29T02:17:01.669133] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-29T02:17:01.685536] [DEBUG] [LOCAL ] HUN: Derivative data saved (1820 records). [2025-09-29T02:17:01.685718] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-29T02:17:01.689294] [INFO ] [MAIN ] Derivative Progress: 1005/2211 symbols completed. HUN took 1.3s. Estimated remaining: 8m 30s. Rate: 142.0 symbols/min [2025-09-29T02:17:01.690119] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:01.689971] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:01.690219] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:01.718716] [DEBUG] [LOCAL ] HVT: Loaded 16133 existing records from primary storage. [2025-09-29T02:17:01.718891] [INFO ] [MAIN ] HVT: Loaded 16133 primary data records. [2025-09-29T02:17:01.999747] [DEBUG] [LOCAL ] HWM: Loaded 53767 existing records from primary storage. [2025-09-29T02:17:02.164467] [DEBUG] [LOCAL ] HUYA: Loaded 44956 existing records from primary storage. [2025-09-29T02:17:02.164906] [INFO ] [MAIN ] HUYA: Loaded 44956 primary data records. [2025-09-29T02:17:02.162586] [INFO ] [MAIN ] HWM: Loaded 53767 primary data records. [2025-09-29T02:17:02.922183] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:02.924046] [INFO ] [MAIN ] HVT: Generated 1820 derivative records from 16133 primary records. [2025-09-29T02:17:02.925305] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-29T02:17:02.947268] [DEBUG] [LOCAL ] HVT: Derivative data saved (1820 records). [2025-09-29T02:17:02.948262] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-29T02:17:02.952123] [INFO ] [MAIN ] Derivative Progress: 1006/2211 symbols completed. HVT took 1.3s. Estimated remaining: 8m 30s. Rate: 141.7 symbols/min [2025-09-29T02:17:02.952881] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:02.982629] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:02.988435] [INFO ] [MAIN ] HUYA: Generated 1820 derivative records from 44956 primary records. [2025-09-29T02:17:02.989065] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-29T02:17:02.988810] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:02.989955] [INFO ] [MAIN ] HWM: Generated 1820 derivative records from 53767 primary records. [2025-09-29T02:17:02.991107] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-29T02:17:03.017415] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1820 records). [2025-09-29T02:17:03.021365] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-29T02:17:03.025912] [INFO ] [MAIN ] Derivative Progress: 1007/2211 symbols completed. HUYA took 1.3s. Estimated remaining: 8m 29s. Rate: 141.8 symbols/min [2025-09-29T02:17:03.027858] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:03.042436] [DEBUG] [LOCAL ] HWM: Derivative data saved (1820 records). [2025-09-29T02:17:03.042600] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-29T02:17:03.046301] [INFO ] [MAIN ] Derivative Progress: 1008/2211 symbols completed. HWM took 1.4s. Estimated remaining: 8m 29s. Rate: 141.9 symbols/min [2025-09-29T02:17:03.046741] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:03.074827] [DEBUG] [LOCAL ] HXL: Loaded 46661 existing records from primary storage. [2025-09-29T02:17:03.075096] [INFO ] [MAIN ] HXL: Loaded 46661 primary data records. [2025-09-29T02:17:03.118385] [DEBUG] [LOCAL ] HY: Loaded 10192 existing records from primary storage. [2025-09-29T02:17:03.153305] [DEBUG] [LOCAL ] HYI: Loaded 9254 existing records from primary storage. [2025-09-29T02:17:03.136145] [INFO ] [MAIN ] HY: Loaded 10192 primary data records. [2025-09-29T02:17:03.171076] [INFO ] [MAIN ] HYI: Loaded 9254 primary data records. [2025-09-29T02:17:04.169394] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:04.176300] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:04.177999] [INFO ] [MAIN ] HXL: Generated 1820 derivative records from 46661 primary records. [2025-09-29T02:17:04.179058] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-29T02:17:04.178905] [INFO ] [MAIN ] HY: Generated 1820 derivative records from 10192 primary records. [2025-09-29T02:17:04.196982] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-29T02:17:04.208180] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:04.209993] [INFO ] [MAIN ] HYI: Generated 1820 derivative records from 9254 primary records. [2025-09-29T02:17:04.211412] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-29T02:17:04.211314] [DEBUG] [LOCAL ] HXL: Derivative data saved (1820 records). [2025-09-29T02:17:04.212265] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-29T02:17:04.215186] [INFO ] [MAIN ] Derivative Progress: 1009/2211 symbols completed. HXL took 1.3s. Estimated remaining: 8m 29s. Rate: 141.7 symbols/min [2025-09-29T02:17:04.231048] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:04.247347] [DEBUG] [LOCAL ] HY: Derivative data saved (1820 records). [2025-09-29T02:17:04.247715] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-29T02:17:04.250297] [INFO ] [MAIN ] Derivative Progress: 1010/2211 symbols completed. HY took 1.2s. Estimated remaining: 8m 28s. Rate: 141.8 symbols/min [2025-09-29T02:17:04.250524] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:04.247422] [DEBUG] [LOCAL ] HYI: Derivative data saved (1820 records). [2025-09-29T02:17:04.250900] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-29T02:17:04.253905] [INFO ] [MAIN ] Derivative Progress: 1011/2211 symbols completed. HYI took 1.2s. Estimated remaining: 8m 27s. Rate: 142.0 symbols/min [2025-09-29T02:17:04.254122] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:04.262715] [DEBUG] [LOCAL ] HYTR: Loaded 3208 existing records from primary storage. [2025-09-29T02:17:04.262921] [INFO ] [MAIN ] HYTR: Loaded 3208 primary data records. [2025-09-29T02:17:04.452113] [DEBUG] [LOCAL ] HZO: Loaded 29733 existing records from primary storage. [2025-09-29T02:17:04.486722] [DEBUG] [LOCAL ] HYT: Loaded 33853 existing records from primary storage. [2025-09-29T02:17:04.486963] [INFO ] [MAIN ] HZO: Loaded 29733 primary data records. [2025-09-29T02:17:04.493935] [INFO ] [MAIN ] HYT: Loaded 33853 primary data records. [2025-09-29T02:17:05.369151] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7801 incomplete bins [2025-09-29T02:17:05.371008] [INFO ] [MAIN ] HYTR: Generated 1813 derivative records from 3208 primary records. [2025-09-29T02:17:05.372018] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-29T02:17:05.389913] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1813 records). [2025-09-29T02:17:05.390707] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-29T02:17:05.393600] [INFO ] [MAIN ] Derivative Progress: 1012/2211 symbols completed. HYTR took 1.1s. Estimated remaining: 8m 28s. Rate: 141.7 symbols/min [2025-09-29T02:17:05.394351] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:05.408475] [DEBUG] [LOCAL ] IAE: Loaded 6104 existing records from primary storage. [2025-09-29T02:17:05.434759] [INFO ] [MAIN ] IAE: Loaded 6104 primary data records. [2025-09-29T02:17:05.435518] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:05.447440] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:05.474260] [INFO ] [MAIN ] HYT: Generated 1820 derivative records from 33853 primary records. [2025-09-29T02:17:05.483398] [INFO ] [MAIN ] HZO: Generated 1820 derivative records from 29733 primary records. [2025-09-29T02:17:05.548012] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-29T02:17:05.518758] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-29T02:17:05.794220] [DEBUG] [LOCAL ] HYT: Derivative data saved (1820 records). [2025-09-29T02:17:05.794324] [DEBUG] [LOCAL ] HZO: Derivative data saved (1820 records). [2025-09-29T02:17:05.794788] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-29T02:17:05.794719] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-29T02:17:05.797842] [INFO ] [MAIN ] Derivative Progress: 1013/2211 symbols completed. HYT took 1.6s. Estimated remaining: 8m 27s. Rate: 141.7 symbols/min [2025-09-29T02:17:05.801043] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:05.801150] [INFO ] [MAIN ] Derivative Progress: 1014/2211 symbols completed. HZO took 1.5s. Estimated remaining: 8m 26s. Rate: 141.9 symbols/min [2025-09-29T02:17:05.802327] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:05.834704] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:05.835746] [INFO ] [MAIN ] IAE: Generated 1820 derivative records from 6104 primary records. [2025-09-29T02:17:05.835911] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-29T02:17:05.854514] [DEBUG] [LOCAL ] IAE: Derivative data saved (1820 records). [2025-09-29T02:17:05.854727] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-29T02:17:05.857488] [INFO ] [MAIN ] Derivative Progress: 1015/2211 symbols completed. IAE took 0.5s. Estimated remaining: 8m 25s. Rate: 142.0 symbols/min [2025-09-29T02:17:05.857907] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:05.937412] [DEBUG] [LOCAL ] IBM: Loaded 54416 existing records from primary storage. [2025-09-29T02:17:05.939301] [INFO ] [MAIN ] IBM: Loaded 54416 primary data records. [2025-09-29T02:17:05.953347] [DEBUG] [LOCAL ] IAG: Loaded 54225 existing records from primary storage. [2025-09-29T02:17:05.982087] [INFO ] [MAIN ] IAG: Loaded 54225 primary data records. [2025-09-29T02:17:06.305173] [DEBUG] [LOCAL ] IBN: Loaded 53654 existing records from primary storage. [2025-09-29T02:17:06.315672] [INFO ] [MAIN ] IBN: Loaded 53654 primary data records. [2025-09-29T02:17:07.046080] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.049178] [INFO ] [MAIN ] IBM: Generated 1820 derivative records from 54416 primary records. [2025-09-29T02:17:07.049458] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-29T02:17:07.083008] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.081989] [DEBUG] [LOCAL ] IBM: Derivative data saved (1820 records). [2025-09-29T02:17:07.083904] [INFO ] [MAIN ] IAG: Generated 1820 derivative records from 54225 primary records. [2025-09-29T02:17:07.084048] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-29T02:17:07.087181] [INFO ] [MAIN ] Derivative Progress: 1016/2211 symbols completed. IBM took 1.3s. Estimated remaining: 8m 26s. Rate: 141.7 symbols/min [2025-09-29T02:17:07.087371] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:07.087494] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-29T02:17:07.111063] [DEBUG] [LOCAL ] IAG: Derivative data saved (1820 records). [2025-09-29T02:17:07.111710] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-29T02:17:07.116088] [INFO ] [MAIN ] Derivative Progress: 1017/2211 symbols completed. IAG took 1.3s. Estimated remaining: 8m 25s. Rate: 141.8 symbols/min [2025-09-29T02:17:07.122330] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:07.138273] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.139804] [INFO ] [MAIN ] IBN: Generated 1820 derivative records from 53654 primary records. [2025-09-29T02:17:07.140194] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-29T02:17:07.172158] [DEBUG] [LOCAL ] IBN: Derivative data saved (1820 records). [2025-09-29T02:17:07.172341] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-29T02:17:07.176735] [INFO ] [MAIN ] Derivative Progress: 1018/2211 symbols completed. IBN took 1.3s. Estimated remaining: 8m 24s. Rate: 142.0 symbols/min [2025-09-29T02:17:07.190991] [DEBUG] [LOCAL ] IBP: Loaded 29584 existing records from primary storage. [2025-09-29T02:17:07.192195] [INFO ] [MAIN ] IBP: Loaded 29584 primary data records. [2025-09-29T02:17:07.370940] [DEBUG] [LOCAL ] IBTA: Loaded 38445 existing records from primary storage. [2025-09-29T02:17:07.406157] [INFO ] [MAIN ] IBTA: Loaded 38445 primary data records. [2025-09-29T02:17:07.911177] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.912155] [INFO ] [MAIN ] IBP: Generated 1820 derivative records from 29584 primary records. [2025-09-29T02:17:07.912255] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-29T02:17:07.931857] [DEBUG] [LOCAL ] IBP: Derivative data saved (1820 records). [2025-09-29T02:17:07.932079] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-29T02:17:07.934898] [INFO ] [MAIN ] Derivative Progress: 1019/2211 symbols completed. IBP took 0.8s. Estimated remaining: 8m 24s. Rate: 141.9 symbols/min [2025-09-29T02:17:07.953011] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.953821] [INFO ] [MAIN ] IBTA: Generated 1820 derivative records from 38445 primary records. [2025-09-29T02:17:07.953909] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-29T02:17:07.970675] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1820 records). [2025-09-29T02:17:07.970806] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-29T02:17:07.973865] [INFO ] [MAIN ] Derivative Progress: 1020/2211 symbols completed. IBTA took 0.9s. Estimated remaining: 8m 23s. Rate: 142.0 symbols/min [2025-09-29T02:17:07.974456] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:07.974582] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:07.974715] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:08.029226] [DEBUG] [LOCAL ] ICL: Loaded 39135 existing records from primary storage. [2025-09-29T02:17:08.040667] [INFO ] [MAIN ] ICL: Loaded 39135 primary data records. [2025-09-29T02:17:08.091639] [DEBUG] [LOCAL ] IDA: Loaded 32398 existing records from primary storage. [2025-09-29T02:17:08.108766] [INFO ] [MAIN ] IDA: Loaded 32398 primary data records. [2025-09-29T02:17:08.303109] [DEBUG] [LOCAL ] ICE: Loaded 53800 existing records from primary storage. [2025-09-29T02:17:08.309001] [INFO ] [MAIN ] ICE: Loaded 53800 primary data records. [2025-09-29T02:17:09.228478] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:09.230247] [INFO ] [MAIN ] ICL: Generated 1820 derivative records from 39135 primary records. [2025-09-29T02:17:09.243450] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-29T02:17:09.244012] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:09.246389] [INFO ] [MAIN ] IDA: Generated 1820 derivative records from 32398 primary records. [2025-09-29T02:17:09.256382] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-29T02:17:09.274721] [DEBUG] [LOCAL ] ICL: Derivative data saved (1820 records). [2025-09-29T02:17:09.279190] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-29T02:17:09.285673] [INFO ] [MAIN ] Derivative Progress: 1021/2211 symbols completed. ICL took 1.3s. Estimated remaining: 8m 24s. Rate: 141.7 symbols/min [2025-09-29T02:17:09.286346] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:09.288430] [DEBUG] [LOCAL ] IDA: Derivative data saved (1820 records). [2025-09-29T02:17:09.296235] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-29T02:17:09.301815] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:09.306026] [INFO ] [MAIN ] Derivative Progress: 1022/2211 symbols completed. IDA took 1.3s. Estimated remaining: 8m 23s. Rate: 141.8 symbols/min [2025-09-29T02:17:09.307328] [INFO ] [MAIN ] ICE: Generated 1820 derivative records from 53800 primary records. [2025-09-29T02:17:09.307527] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:09.307750] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-29T02:17:09.331590] [DEBUG] [LOCAL ] IDE: Loaded 8755 existing records from primary storage. [2025-09-29T02:17:09.332421] [INFO ] [MAIN ] IDE: Loaded 8755 primary data records. [2025-09-29T02:17:09.332832] [DEBUG] [LOCAL ] ICE: Derivative data saved (1820 records). [2025-09-29T02:17:09.351371] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-29T02:17:09.397832] [INFO ] [MAIN ] Derivative Progress: 1023/2211 symbols completed. ICE took 1.4s. Estimated remaining: 8m 22s. Rate: 141.9 symbols/min [2025-09-29T02:17:09.437386] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:09.460423] [DEBUG] [LOCAL ] IDT: Loaded 17885 existing records from primary storage. [2025-09-29T02:17:09.479496] [INFO ] [MAIN ] IDT: Loaded 17885 primary data records. [2025-09-29T02:17:10.088849] [DEBUG] [LOCAL ] IEX: Loaded 38978 existing records from primary storage. [2025-09-29T02:17:10.091232] [INFO ] [MAIN ] IEX: Loaded 38978 primary data records. [2025-09-29T02:17:10.347842] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:10.348766] [INFO ] [MAIN ] IDE: Generated 1820 derivative records from 8755 primary records. [2025-09-29T02:17:10.515961] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-29T02:17:10.535978] [DEBUG] [LOCAL ] IDE: Derivative data saved (1820 records). [2025-09-29T02:17:10.539773] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-29T02:17:10.542525] [INFO ] [MAIN ] Derivative Progress: 1024/2211 symbols completed. IDE took 1.3s. Estimated remaining: 8m 23s. Rate: 141.7 symbols/min [2025-09-29T02:17:10.543360] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:10.558026] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:10.560159] [INFO ] [MAIN ] IDT: Generated 1820 derivative records from 17885 primary records. [2025-09-29T02:17:10.560367] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-29T02:17:10.581327] [DEBUG] [LOCAL ] IDT: Derivative data saved (1820 records). [2025-09-29T02:17:10.581748] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-29T02:17:10.584744] [INFO ] [MAIN ] Derivative Progress: 1025/2211 symbols completed. IDT took 1.3s. Estimated remaining: 8m 22s. Rate: 141.8 symbols/min [2025-09-29T02:17:10.585225] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:10.603175] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:10.604533] [INFO ] [MAIN ] IEX: Generated 1820 derivative records from 38978 primary records. [2025-09-29T02:17:10.604828] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-29T02:17:10.627268] [DEBUG] [LOCAL ] IEX: Derivative data saved (1820 records). [2025-09-29T02:17:10.627630] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-29T02:17:10.645354] [INFO ] [MAIN ] Derivative Progress: 1026/2211 symbols completed. IEX took 1.2s. Estimated remaining: 8m 21s. Rate: 141.9 symbols/min [2025-09-29T02:17:10.645839] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:10.654158] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-09-29T02:17:10.654309] [INFO ] [MAIN ] IFN: Loaded 18475 primary data records. [2025-09-29T02:17:10.804568] [DEBUG] [LOCAL ] IFF: Loaded 51727 existing records from primary storage. [2025-09-29T02:17:10.836938] [INFO ] [MAIN ] IFF: Loaded 51727 primary data records. [2025-09-29T02:17:10.956336] [DEBUG] [LOCAL ] IFS: Loaded 23359 existing records from primary storage. [2025-09-29T02:17:11.115032] [INFO ] [MAIN ] IFS: Loaded 23359 primary data records. [2025-09-29T02:17:11.757399] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:11.758859] [INFO ] [MAIN ] IFN: Generated 1820 derivative records from 18475 primary records. [2025-09-29T02:17:11.759065] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-29T02:17:11.783196] [DEBUG] [LOCAL ] IFN: Derivative data saved (1820 records). [2025-09-29T02:17:11.784211] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-29T02:17:11.786553] [INFO ] [MAIN ] Derivative Progress: 1027/2211 symbols completed. IFN took 1.2s. Estimated remaining: 8m 21s. Rate: 141.7 symbols/min [2025-09-29T02:17:11.787044] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:11.804592] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:11.819321] [INFO ] [MAIN ] IFF: Generated 1820 derivative records from 51727 primary records. [2025-09-29T02:17:11.819848] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:11.820964] [INFO ] [MAIN ] IFS: Generated 1820 derivative records from 23359 primary records. [2025-09-29T02:17:11.821280] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-29T02:17:11.821200] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-29T02:17:11.860142] [DEBUG] [LOCAL ] IGA: Loaded 9779 existing records from primary storage. [2025-09-29T02:17:11.861864] [INFO ] [MAIN ] IGA: Loaded 9779 primary data records. [2025-09-29T02:17:11.862626] [DEBUG] [LOCAL ] IFS: Derivative data saved (1820 records). [2025-09-29T02:17:11.882202] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-29T02:17:11.917636] [DEBUG] [LOCAL ] IFF: Derivative data saved (1820 records). [2025-09-29T02:17:11.920805] [INFO ] [MAIN ] Derivative Progress: 1028/2211 symbols completed. IFS took 1.3s. Estimated remaining: 8m 21s. Rate: 141.8 symbols/min [2025-09-29T02:17:11.926333] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-29T02:17:11.926521] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:11.939153] [INFO ] [MAIN ] Derivative Progress: 1029/2211 symbols completed. IFF took 1.4s. Estimated remaining: 8m 20s. Rate: 141.9 symbols/min [2025-09-29T02:17:11.978432] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:12.095369] [DEBUG] [LOCAL ] IGI: Loaded 3756 existing records from primary storage. [2025-09-29T02:17:12.211096] [INFO ] [MAIN ] IGI: Loaded 3756 primary data records. [2025-09-29T02:17:12.261768] [DEBUG] [LOCAL ] IGD: Loaded 19170 existing records from primary storage. [2025-09-29T02:17:12.310370] [INFO ] [MAIN ] IGD: Loaded 19170 primary data records. [2025-09-29T02:17:13.039533] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:13.042407] [INFO ] [MAIN ] IGA: Generated 1820 derivative records from 9779 primary records. [2025-09-29T02:17:13.042546] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-29T02:17:13.061570] [DEBUG] [LOCAL ] IGA: Derivative data saved (1820 records). [2025-09-29T02:17:13.062849] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-29T02:17:13.065138] [INFO ] [MAIN ] Derivative Progress: 1030/2211 symbols completed. IGA took 1.3s. Estimated remaining: 8m 20s. Rate: 141.7 symbols/min [2025-09-29T02:17:13.068215] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:13.083830] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:13.085075] [INFO ] [MAIN ] IGI: Generated 1820 derivative records from 3756 primary records. [2025-09-29T02:17:13.085573] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-29T02:17:13.102292] [DEBUG] [LOCAL ] IGI: Derivative data saved (1820 records). [2025-09-29T02:17:13.103503] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-29T02:17:13.107342] [INFO ] [MAIN ] Derivative Progress: 1031/2211 symbols completed. IGI took 1.1s. Estimated remaining: 8m 19s. Rate: 141.8 symbols/min [2025-09-29T02:17:13.107662] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:13.131106] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:13.132111] [INFO ] [MAIN ] IGD: Generated 1820 derivative records from 19170 primary records. [2025-09-29T02:17:13.133333] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-29T02:17:13.146563] [DEBUG] [LOCAL ] IH: Loaded 3450 existing records from primary storage. [2025-09-29T02:17:13.160764] [INFO ] [MAIN ] IH: Loaded 3450 primary data records. [2025-09-29T02:17:13.162437] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-09-29T02:17:13.164179] [INFO ] [MAIN ] IGR: Loaded 30882 primary data records. [2025-09-29T02:17:13.164928] [DEBUG] [LOCAL ] IGD: Derivative data saved (1820 records). [2025-09-29T02:17:13.271409] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-29T02:17:13.339486] [INFO ] [MAIN ] Derivative Progress: 1032/2211 symbols completed. IGD took 1.4s. Estimated remaining: 8m 19s. Rate: 141.9 symbols/min [2025-09-29T02:17:13.411509] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:13.854576] [DEBUG] [LOCAL ] IHD: Loaded 7225 existing records from primary storage. [2025-09-29T02:17:13.854775] [INFO ] [MAIN ] IHD: Loaded 7225 primary data records. [2025-09-29T02:17:14.227783] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:14.229176] [INFO ] [MAIN ] IGR: Generated 1820 derivative records from 30882 primary records. [2025-09-29T02:17:14.228081] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:14.230306] [INFO ] [MAIN ] IH: Generated 1820 derivative records from 3450 primary records. [2025-09-29T02:17:14.230408] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-29T02:17:14.230567] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-29T02:17:14.265464] [DEBUG] [LOCAL ] IGR: Derivative data saved (1820 records). [2025-09-29T02:17:14.265621] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-29T02:17:14.269178] [INFO ] [MAIN ] Derivative Progress: 1033/2211 symbols completed. IGR took 1.2s. Estimated remaining: 8m 19s. Rate: 141.7 symbols/min [2025-09-29T02:17:14.263156] [DEBUG] [LOCAL ] IH: Derivative data saved (1820 records). [2025-09-29T02:17:14.269808] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-29T02:17:14.272589] [INFO ] [MAIN ] Derivative Progress: 1034/2211 symbols completed. IH took 1.2s. Estimated remaining: 8m 18s. Rate: 141.9 symbols/min [2025-09-29T02:17:14.292194] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:14.293042] [INFO ] [MAIN ] IHD: Generated 1820 derivative records from 7225 primary records. [2025-09-29T02:17:14.293139] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-29T02:17:14.309620] [DEBUG] [LOCAL ] IHD: Derivative data saved (1820 records). [2025-09-29T02:17:14.309812] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-29T02:17:14.312993] [INFO ] [MAIN ] Derivative Progress: 1035/2211 symbols completed. IHD took 0.9s. Estimated remaining: 8m 17s. Rate: 142.0 symbols/min [2025-09-29T02:17:14.313775] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:14.313674] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:14.313862] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:14.324806] [DEBUG] [LOCAL ] IIF: Loaded 5787 existing records from primary storage. [2025-09-29T02:17:14.325258] [INFO ] [MAIN ] IIF: Loaded 5787 primary data records. [2025-09-29T02:17:14.527765] [DEBUG] [LOCAL ] IHG: Loaded 24977 existing records from primary storage. [2025-09-29T02:17:14.686604] [INFO ] [MAIN ] IHG: Loaded 24977 primary data records. [2025-09-29T02:17:14.708670] [DEBUG] [LOCAL ] IHS: Loaded 39400 existing records from primary storage. [2025-09-29T02:17:14.757730] [INFO ] [MAIN ] IHS: Loaded 39400 primary data records. [2025-09-29T02:17:15.449745] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:15.452887] [INFO ] [MAIN ] IIF: Generated 1820 derivative records from 5787 primary records. [2025-09-29T02:17:15.453048] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-29T02:17:15.474476] [DEBUG] [LOCAL ] IIF: Derivative data saved (1820 records). [2025-09-29T02:17:15.476136] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-29T02:17:15.478866] [INFO ] [MAIN ] Derivative Progress: 1036/2211 symbols completed. IIF took 1.2s. Estimated remaining: 8m 17s. Rate: 141.7 symbols/min [2025-09-29T02:17:15.479242] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:15.500771] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:15.509853] [INFO ] [MAIN ] IHG: Generated 1820 derivative records from 24977 primary records. [2025-09-29T02:17:15.510387] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-29T02:17:15.531735] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:15.542753] [INFO ] [MAIN ] IHS: Generated 1820 derivative records from 39400 primary records. [2025-09-29T02:17:15.532883] [DEBUG] [LOCAL ] IIIN: Loaded 16828 existing records from primary storage. [2025-09-29T02:17:15.547075] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-29T02:17:15.550680] [INFO ] [MAIN ] IIIN: Loaded 16828 primary data records. [2025-09-29T02:17:15.554450] [DEBUG] [LOCAL ] IHG: Derivative data saved (1820 records). [2025-09-29T02:17:15.570051] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-29T02:17:15.603417] [INFO ] [MAIN ] Derivative Progress: 1037/2211 symbols completed. IHG took 1.3s. Estimated remaining: 8m 17s. Rate: 141.8 symbols/min [2025-09-29T02:17:15.641719] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:15.649738] [DEBUG] [LOCAL ] IHS: Derivative data saved (1820 records). [2025-09-29T02:17:15.676124] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-29T02:17:15.700968] [INFO ] [MAIN ] Derivative Progress: 1038/2211 symbols completed. IHS took 1.4s. Estimated remaining: 8m 16s. Rate: 141.9 symbols/min [2025-09-29T02:17:15.707055] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:15.935259] [DEBUG] [LOCAL ] IIM: Loaded 16102 existing records from primary storage. [2025-09-29T02:17:15.935442] [INFO ] [MAIN ] IIM: Loaded 16102 primary data records. [2025-09-29T02:17:16.092040] [DEBUG] [LOCAL ] IIPR: Loaded 30052 existing records from primary storage. [2025-09-29T02:17:16.106751] [INFO ] [MAIN ] IIPR: Loaded 30052 primary data records. [2025-09-29T02:17:16.554986] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:16.695841] [INFO ] [MAIN ] IIIN: Generated 1820 derivative records from 16828 primary records. [2025-09-29T02:17:16.701512] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-29T02:17:16.736531] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1820 records). [2025-09-29T02:17:16.737959] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-29T02:17:16.742736] [INFO ] [MAIN ] Derivative Progress: 1039/2211 symbols completed. IIIN took 1.3s. Estimated remaining: 8m 16s. Rate: 141.7 symbols/min [2025-09-29T02:17:16.742996] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:16.765461] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:16.767841] [INFO ] [MAIN ] IIM: Generated 1820 derivative records from 16102 primary records. [2025-09-29T02:17:16.768190] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-29T02:17:16.790920] [DEBUG] [LOCAL ] IIM: Derivative data saved (1820 records). [2025-09-29T02:17:16.805422] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-29T02:17:16.805308] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:16.808917] [INFO ] [MAIN ] Derivative Progress: 1040/2211 symbols completed. IIM took 1.2s. Estimated remaining: 8m 15s. Rate: 141.9 symbols/min [2025-09-29T02:17:16.810304] [INFO ] [MAIN ] IIPR: Generated 1820 derivative records from 30052 primary records. [2025-09-29T02:17:16.821159] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-29T02:17:16.820550] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:16.852991] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1820 records). [2025-09-29T02:17:16.853294] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-29T02:17:16.856436] [INFO ] [MAIN ] Derivative Progress: 1041/2211 symbols completed. IIPR took 1.1s. Estimated remaining: 8m 14s. Rate: 142.0 symbols/min [2025-09-29T02:17:16.856921] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:16.858774] [DEBUG] [LOCAL ] IMAX: Loaded 43382 existing records from primary storage. [2025-09-29T02:17:16.859243] [INFO ] [MAIN ] IMAX: Loaded 43382 primary data records. [2025-09-29T02:17:17.267924] [DEBUG] [LOCAL ] INFA: Loaded 50602 existing records from primary storage. [2025-09-29T02:17:17.269330] [INFO ] [MAIN ] INFA: Loaded 50602 primary data records. [2025-09-29T02:17:17.402966] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-29T02:17:17.409279] [INFO ] [MAIN ] INFY: Loaded 54378 primary data records. [2025-09-29T02:17:17.968867] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:17.969813] [INFO ] [MAIN ] IMAX: Generated 1820 derivative records from 43382 primary records. [2025-09-29T02:17:17.971261] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-29T02:17:17.994870] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1820 records). [2025-09-29T02:17:17.997979] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-29T02:17:18.001703] [INFO ] [MAIN ] Derivative Progress: 1042/2211 symbols completed. IMAX took 1.3s. Estimated remaining: 8m 15s. Rate: 141.7 symbols/min [2025-09-29T02:17:18.002091] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:18.017946] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:18.019429] [INFO ] [MAIN ] INFA: Generated 1820 derivative records from 50602 primary records. [2025-09-29T02:17:18.019824] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-29T02:17:18.039969] [DEBUG] [LOCAL ] INFA: Derivative data saved (1820 records). [2025-09-29T02:17:18.040787] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-29T02:17:18.045034] [INFO ] [MAIN ] Derivative Progress: 1043/2211 symbols completed. INFA took 1.2s. Estimated remaining: 8m 14s. Rate: 141.9 symbols/min [2025-09-29T02:17:18.046737] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:18.063897] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:18.065311] [INFO ] [MAIN ] INFY: Generated 1820 derivative records from 54378 primary records. [2025-09-29T02:17:18.065662] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-29T02:17:18.083556] [DEBUG] [LOCAL ] INFY: Derivative data saved (1820 records). [2025-09-29T02:17:18.083825] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-29T02:17:18.087093] [INFO ] [MAIN ] Derivative Progress: 1044/2211 symbols completed. INFY took 1.2s. Estimated remaining: 8m 13s. Rate: 142.0 symbols/min [2025-09-29T02:17:18.102018] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:18.143232] [DEBUG] [LOCAL ] INGM: Loaded 29224 existing records from primary storage. [2025-09-29T02:17:18.143587] [INFO ] [MAIN ] INGM: Loaded 29224 primary data records. [2025-09-29T02:17:18.170448] [DEBUG] [LOCAL ] ING: Loaded 51537 existing records from primary storage. [2025-09-29T02:17:18.202801] [INFO ] [MAIN ] ING: Loaded 51537 primary data records. [2025-09-29T02:17:18.426977] [DEBUG] [LOCAL ] INGR: Loaded 33913 existing records from primary storage. [2025-09-29T02:17:18.482954] [INFO ] [MAIN ] INGR: Loaded 33913 primary data records. [2025-09-29T02:17:19.302362] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:19.309206] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:19.310235] [INFO ] [MAIN ] INGM: Generated 1820 derivative records from 29224 primary records. [2025-09-29T02:17:19.311609] [INFO ] [MAIN ] ING: Generated 1820 derivative records from 51537 primary records. [2025-09-29T02:17:19.311857] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-29T02:17:19.312279] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-29T02:17:19.340848] [DEBUG] [LOCAL ] INGM: Derivative data saved (1820 records). [2025-09-29T02:17:19.344050] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-29T02:17:19.351819] [INFO ] [MAIN ] Derivative Progress: 1045/2211 symbols completed. INGM took 1.3s. Estimated remaining: 8m 14s. Rate: 141.7 symbols/min [2025-09-29T02:17:19.354620] [DEBUG] [LOCAL ] ING: Derivative data saved (1820 records). [2025-09-29T02:17:19.354958] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-29T02:17:19.359743] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:19.361235] [INFO ] [MAIN ] Derivative Progress: 1046/2211 symbols completed. ING took 1.4s. Estimated remaining: 8m 13s. Rate: 141.9 symbols/min [2025-09-29T02:17:19.363684] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:19.379925] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:19.380977] [INFO ] [MAIN ] INGR: Generated 1820 derivative records from 33913 primary records. [2025-09-29T02:17:19.381220] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-29T02:17:19.399453] [DEBUG] [LOCAL ] INGR: Derivative data saved (1820 records). [2025-09-29T02:17:19.399809] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-29T02:17:19.403128] [INFO ] [MAIN ] Derivative Progress: 1047/2211 symbols completed. INGR took 1.3s. Estimated remaining: 8m 12s. Rate: 142.0 symbols/min [2025-09-29T02:17:19.403562] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:19.450301] [DEBUG] [LOCAL ] INSP: Loaded 37492 existing records from primary storage. [2025-09-29T02:17:19.451363] [INFO ] [MAIN ] INSP: Loaded 37492 primary data records. [2025-09-29T02:17:19.573452] [DEBUG] [LOCAL ] INN: Loaded 42433 existing records from primary storage. [2025-09-29T02:17:19.596810] [INFO ] [MAIN ] INN: Loaded 42433 primary data records. [2025-09-29T02:17:19.656531] [DEBUG] [LOCAL ] INSW: Loaded 40831 existing records from primary storage. [2025-09-29T02:17:19.726516] [INFO ] [MAIN ] INSW: Loaded 40831 primary data records. [2025-09-29T02:17:20.525518] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:20.526793] [INFO ] [MAIN ] INSP: Generated 1820 derivative records from 37492 primary records. [2025-09-29T02:17:20.527960] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-29T02:17:20.548605] [DEBUG] [LOCAL ] INSP: Derivative data saved (1820 records). [2025-09-29T02:17:20.548826] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-29T02:17:20.551408] [INFO ] [MAIN ] Derivative Progress: 1048/2211 symbols completed. INSP took 1.2s. Estimated remaining: 8m 12s. Rate: 141.7 symbols/min [2025-09-29T02:17:20.565149] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:20.566021] [INFO ] [MAIN ] INN: Generated 1820 derivative records from 42433 primary records. [2025-09-29T02:17:20.566308] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-29T02:17:20.584551] [DEBUG] [LOCAL ] INN: Derivative data saved (1820 records). [2025-09-29T02:17:20.597179] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:20.597337] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-29T02:17:20.598087] [INFO ] [MAIN ] INSW: Generated 1820 derivative records from 40831 primary records. [2025-09-29T02:17:20.598180] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-29T02:17:20.602385] [INFO ] [MAIN ] Derivative Progress: 1049/2211 symbols completed. INN took 1.2s. Estimated remaining: 8m 11s. Rate: 141.9 symbols/min [2025-09-29T02:17:20.622088] [DEBUG] [LOCAL ] INSW: Derivative data saved (1820 records). [2025-09-29T02:17:20.622230] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-29T02:17:20.625922] [INFO ] [MAIN ] Derivative Progress: 1050/2211 symbols completed. INSW took 1.2s. Estimated remaining: 8m 11s. Rate: 142.0 symbols/min [2025-09-29T02:17:20.626557] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:20.626607] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:20.626680] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:20.666383] [DEBUG] [LOCAL ] INVX: Loaded 29366 existing records from primary storage. [2025-09-29T02:17:20.666581] [INFO ] [MAIN ] INVX: Loaded 29366 primary data records. [2025-09-29T02:17:20.844819] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-29T02:17:20.869699] [INFO ] [MAIN ] IONQ: Loaded 54568 primary data records. [2025-09-29T02:17:20.931617] [DEBUG] [LOCAL ] INVH: Loaded 53918 existing records from primary storage. [2025-09-29T02:17:21.078764] [INFO ] [MAIN ] INVH: Loaded 53918 primary data records. [2025-09-29T02:17:21.810471] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:21.811976] [INFO ] [MAIN ] INVX: Generated 1820 derivative records from 29366 primary records. [2025-09-29T02:17:21.814081] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-29T02:17:21.836020] [DEBUG] [LOCAL ] INVX: Derivative data saved (1820 records). [2025-09-29T02:17:21.836348] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-29T02:17:21.839714] [INFO ] [MAIN ] Derivative Progress: 1051/2211 symbols completed. INVX took 1.2s. Estimated remaining: 8m 11s. Rate: 141.7 symbols/min [2025-09-29T02:17:21.840731] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:21.865128] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:21.866428] [INFO ] [MAIN ] IONQ: Generated 1820 derivative records from 54568 primary records. [2025-09-29T02:17:21.866693] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-29T02:17:21.886211] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1820 records). [2025-09-29T02:17:21.890249] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-29T02:17:21.894399] [INFO ] [MAIN ] Derivative Progress: 1052/2211 symbols completed. IONQ took 1.3s. Estimated remaining: 8m 10s. Rate: 141.9 symbols/min [2025-09-29T02:17:21.894898] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:21.910342] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:21.911290] [INFO ] [MAIN ] INVH: Generated 1820 derivative records from 53918 primary records. [2025-09-29T02:17:21.911515] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-29T02:17:21.949134] [DEBUG] [LOCAL ] INVH: Derivative data saved (1820 records). [2025-09-29T02:17:21.949565] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-29T02:17:21.953720] [INFO ] [MAIN ] Derivative Progress: 1053/2211 symbols completed. INVH took 1.3s. Estimated remaining: 8m 9s. Rate: 142.0 symbols/min [2025-09-29T02:17:21.954060] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:21.977256] [DEBUG] [LOCAL ] IOT: Loaded 54249 existing records from primary storage. [2025-09-29T02:17:21.977566] [INFO ] [MAIN ] IOT: Loaded 54249 primary data records. [2025-09-29T02:17:22.155744] [DEBUG] [LOCAL ] IP: Loaded 54093 existing records from primary storage. [2025-09-29T02:17:22.234978] [INFO ] [MAIN ] IP: Loaded 54093 primary data records. [2025-09-29T02:17:22.499088] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-09-29T02:17:22.505511] [INFO ] [MAIN ] IPG: Loaded 54110 primary data records. [2025-09-29T02:17:23.073927] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:23.074947] [INFO ] [MAIN ] IOT: Generated 1820 derivative records from 54249 primary records. [2025-09-29T02:17:23.075583] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-29T02:17:23.096481] [DEBUG] [LOCAL ] IOT: Derivative data saved (1820 records). [2025-09-29T02:17:23.098161] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-29T02:17:23.102230] [INFO ] [MAIN ] Derivative Progress: 1054/2211 symbols completed. IOT took 1.3s. Estimated remaining: 8m 10s. Rate: 141.7 symbols/min [2025-09-29T02:17:23.102585] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:23.122545] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:23.124150] [INFO ] [MAIN ] IP: Generated 1820 derivative records from 54093 primary records. [2025-09-29T02:17:23.124472] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-29T02:17:23.148245] [DEBUG] [LOCAL ] IP: Derivative data saved (1820 records). [2025-09-29T02:17:23.157064] [DEBUG] [LOCAL ] IPI: Loaded 21704 existing records from primary storage. [2025-09-29T02:17:23.159266] [INFO ] [MAIN ] IPI: Loaded 21704 primary data records. [2025-09-29T02:17:23.157154] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-29T02:17:23.175203] [INFO ] [MAIN ] Derivative Progress: 1055/2211 symbols completed. IP took 1.3s. Estimated remaining: 8m 9s. Rate: 141.9 symbols/min [2025-09-29T02:17:23.199348] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:23.217803] [INFO ] [MAIN ] IPG: Generated 1820 derivative records from 54110 primary records. [2025-09-29T02:17:23.211581] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:23.218036] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-29T02:17:23.309960] [DEBUG] [LOCAL ] IPG: Derivative data saved (1820 records). [2025-09-29T02:17:23.320957] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-29T02:17:23.323859] [INFO ] [MAIN ] Derivative Progress: 1056/2211 symbols completed. IPG took 1.4s. Estimated remaining: 8m 8s. Rate: 141.9 symbols/min [2025-09-29T02:17:23.368900] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:23.397776] [DEBUG] [LOCAL ] IQI: Loaded 18161 existing records from primary storage. [2025-09-29T02:17:23.399207] [INFO ] [MAIN ] IQI: Loaded 18161 primary data records. [2025-09-29T02:17:23.993379] [DEBUG] [LOCAL ] IQV: Loaded 50895 existing records from primary storage. [2025-09-29T02:17:23.994458] [INFO ] [MAIN ] IQV: Loaded 50895 primary data records. [2025-09-29T02:17:24.171386] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:24.218032] [INFO ] [MAIN ] IPI: Generated 1820 derivative records from 21704 primary records. [2025-09-29T02:17:24.351613] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-29T02:17:24.379251] [DEBUG] [LOCAL ] IPI: Derivative data saved (1820 records). [2025-09-29T02:17:24.393204] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-29T02:17:24.396481] [INFO ] [MAIN ] Derivative Progress: 1057/2211 symbols completed. IPI took 1.3s. Estimated remaining: 8m 9s. Rate: 141.7 symbols/min [2025-09-29T02:17:24.397967] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:24.397633] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:24.399303] [INFO ] [MAIN ] IQI: Generated 1820 derivative records from 18161 primary records. [2025-09-29T02:17:24.399616] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-29T02:17:24.418777] [DEBUG] [LOCAL ] IQI: Derivative data saved (1820 records). [2025-09-29T02:17:24.419112] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-29T02:17:24.422367] [INFO ] [MAIN ] Derivative Progress: 1058/2211 symbols completed. IQI took 1.2s. Estimated remaining: 8m 8s. Rate: 141.9 symbols/min [2025-09-29T02:17:24.422854] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:24.443014] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:24.444000] [INFO ] [MAIN ] IQV: Generated 1820 derivative records from 50895 primary records. [2025-09-29T02:17:24.444166] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-29T02:17:24.463919] [DEBUG] [LOCAL ] IQV: Derivative data saved (1820 records). [2025-09-29T02:17:24.464030] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-29T02:17:24.467254] [INFO ] [MAIN ] Derivative Progress: 1059/2211 symbols completed. IQV took 1.1s. Estimated remaining: 8m 7s. Rate: 142.0 symbols/min [2025-09-29T02:17:24.467621] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:24.526947] [DEBUG] [LOCAL ] IR: Loaded 53470 existing records from primary storage. [2025-09-29T02:17:24.528726] [INFO ] [MAIN ] IR: Loaded 53470 primary data records. [2025-09-29T02:17:24.607206] [DEBUG] [LOCAL ] IRS: Loaded 22136 existing records from primary storage. [2025-09-29T02:17:24.608056] [DEBUG] [LOCAL ] IRM: Loaded 50159 existing records from primary storage. [2025-09-29T02:17:24.649432] [INFO ] [MAIN ] IRS: Loaded 22136 primary data records. [2025-09-29T02:17:24.660327] [INFO ] [MAIN ] IRM: Loaded 50159 primary data records. [2025-09-29T02:17:25.609177] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:25.610810] [INFO ] [MAIN ] IR: Generated 1820 derivative records from 53470 primary records. [2025-09-29T02:17:25.611065] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-29T02:17:25.630937] [DEBUG] [LOCAL ] IR: Derivative data saved (1820 records). [2025-09-29T02:17:25.631044] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-29T02:17:25.633822] [INFO ] [MAIN ] Derivative Progress: 1060/2211 symbols completed. IR took 1.2s. Estimated remaining: 8m 7s. Rate: 141.7 symbols/min [2025-09-29T02:17:25.634041] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:25.668169] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:25.668996] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:25.670775] [INFO ] [MAIN ] IRM: Generated 1820 derivative records from 50159 primary records. [2025-09-29T02:17:25.670879] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-29T02:17:25.669941] [INFO ] [MAIN ] IRS: Generated 1820 derivative records from 22136 primary records. [2025-09-29T02:17:25.671921] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-29T02:17:25.705725] [DEBUG] [LOCAL ] IRS: Derivative data saved (1820 records). [2025-09-29T02:17:25.705963] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-29T02:17:25.709077] [INFO ] [MAIN ] Derivative Progress: 1061/2211 symbols completed. IRS took 1.2s. Estimated remaining: 8m 6s. Rate: 141.9 symbols/min [2025-09-29T02:17:25.709304] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:25.703916] [DEBUG] [LOCAL ] IRM: Derivative data saved (1820 records). [2025-09-29T02:17:25.709664] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-29T02:17:25.713089] [INFO ] [MAIN ] Derivative Progress: 1062/2211 symbols completed. IRM took 1.3s. Estimated remaining: 8m 6s. Rate: 142.0 symbols/min [2025-09-29T02:17:25.713452] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:25.748712] [DEBUG] [LOCAL ] ISD: Loaded 15803 existing records from primary storage. [2025-09-29T02:17:25.763792] [INFO ] [MAIN ] ISD: Loaded 15803 primary data records. [2025-09-29T02:17:25.764961] [DEBUG] [LOCAL ] IRT: Loaded 51146 existing records from primary storage. [2025-09-29T02:17:25.815265] [INFO ] [MAIN ] IRT: Loaded 51146 primary data records. [2025-09-29T02:17:25.990739] [DEBUG] [LOCAL ] IT: Loaded 42234 existing records from primary storage. [2025-09-29T02:17:26.042425] [INFO ] [MAIN ] IT: Loaded 42234 primary data records. [2025-09-29T02:17:26.840960] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:26.854935] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:26.856093] [INFO ] [MAIN ] ISD: Generated 1820 derivative records from 15803 primary records. [2025-09-29T02:17:26.857260] [INFO ] [MAIN ] IRT: Generated 1820 derivative records from 51146 primary records. [2025-09-29T02:17:26.857448] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-29T02:17:26.857671] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-29T02:17:26.896495] [DEBUG] [LOCAL ] IRT: Derivative data saved (1820 records). [2025-09-29T02:17:26.899039] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-29T02:17:26.902003] [INFO ] [MAIN ] Derivative Progress: 1063/2211 symbols completed. IRT took 1.3s. Estimated remaining: 8m 6s. Rate: 141.7 symbols/min [2025-09-29T02:17:26.904922] [DEBUG] [LOCAL ] ISD: Derivative data saved (1820 records). [2025-09-29T02:17:26.905193] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-29T02:17:26.908405] [INFO ] [MAIN ] Derivative Progress: 1064/2211 symbols completed. ISD took 1.2s. Estimated remaining: 8m 5s. Rate: 141.9 symbols/min [2025-09-29T02:17:26.924739] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:17:26.925727] [INFO ] [MAIN ] IT: Generated 1819 derivative records from 42234 primary records. [2025-09-29T02:17:26.925840] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-29T02:17:26.942460] [DEBUG] [LOCAL ] IT: Derivative data saved (1819 records). [2025-09-29T02:17:26.942562] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-29T02:17:26.946916] [INFO ] [MAIN ] Derivative Progress: 1065/2211 symbols completed. IT took 1.2s. Estimated remaining: 8m 4s. Rate: 142.0 symbols/min [2025-09-29T02:17:26.947697] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:26.947854] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:26.948155] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:26.997365] [DEBUG] [LOCAL ] ITGR: Loaded 31996 existing records from primary storage. [2025-09-29T02:17:27.011230] [INFO ] [MAIN ] ITGR: Loaded 31996 primary data records. [2025-09-29T02:17:27.103998] [DEBUG] [LOCAL ] ITT: Loaded 33511 existing records from primary storage. [2025-09-29T02:17:27.116627] [INFO ] [MAIN ] ITT: Loaded 33511 primary data records. [2025-09-29T02:17:27.210095] [DEBUG] [LOCAL ] ITUB: Loaded 54084 existing records from primary storage. [2025-09-29T02:17:27.255600] [INFO ] [MAIN ] ITUB: Loaded 54084 primary data records. [2025-09-29T02:17:28.133267] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:28.134409] [INFO ] [MAIN ] ITGR: Generated 1820 derivative records from 31996 primary records. [2025-09-29T02:17:28.134535] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-29T02:17:28.156963] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1820 records). [2025-09-29T02:17:28.165587] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-29T02:17:28.173965] [INFO ] [MAIN ] Derivative Progress: 1066/2211 symbols completed. ITGR took 1.2s. Estimated remaining: 8m 5s. Rate: 141.7 symbols/min [2025-09-29T02:17:28.175584] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:28.175829] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:28.177780] [INFO ] [MAIN ] ITT: Generated 1820 derivative records from 33511 primary records. [2025-09-29T02:17:28.179344] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-29T02:17:28.201388] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:28.209816] [DEBUG] [LOCAL ] ITT: Derivative data saved (1820 records). [2025-09-29T02:17:28.210898] [INFO ] [MAIN ] ITUB: Generated 1820 derivative records from 54084 primary records. [2025-09-29T02:17:28.211145] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-29T02:17:28.211289] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-29T02:17:28.214880] [INFO ] [MAIN ] Derivative Progress: 1067/2211 symbols completed. ITT took 1.3s. Estimated remaining: 8m 4s. Rate: 141.9 symbols/min [2025-09-29T02:17:28.215744] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:28.233166] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1820 records). [2025-09-29T02:17:28.233446] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-29T02:17:28.236145] [INFO ] [MAIN ] Derivative Progress: 1068/2211 symbols completed. ITUB took 1.3s. Estimated remaining: 8m 3s. Rate: 142.0 symbols/min [2025-09-29T02:17:28.236508] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:28.294993] [DEBUG] [LOCAL ] IVT: Loaded 31325 existing records from primary storage. [2025-09-29T02:17:28.309887] [INFO ] [MAIN ] IVT: Loaded 31325 primary data records. [2025-09-29T02:17:28.317730] [DEBUG] [LOCAL ] ITW: Loaded 46782 existing records from primary storage. [2025-09-29T02:17:28.374601] [INFO ] [MAIN ] ITW: Loaded 46782 primary data records. [2025-09-29T02:17:28.399050] [DEBUG] [LOCAL ] IVR: Loaded 48557 existing records from primary storage. [2025-09-29T02:17:28.483999] [INFO ] [MAIN ] IVR: Loaded 48557 primary data records. [2025-09-29T02:17:29.360448] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:29.362832] [INFO ] [MAIN ] IVT: Generated 1820 derivative records from 31325 primary records. [2025-09-29T02:17:29.363231] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-29T02:17:29.382335] [DEBUG] [LOCAL ] IVT: Derivative data saved (1820 records). [2025-09-29T02:17:29.382996] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-29T02:17:29.386981] [INFO ] [MAIN ] Derivative Progress: 1069/2211 symbols completed. IVT took 1.2s. Estimated remaining: 8m 3s. Rate: 141.8 symbols/min [2025-09-29T02:17:29.388152] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:29.406407] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:29.407909] [INFO ] [MAIN ] ITW: Generated 1820 derivative records from 46782 primary records. [2025-09-29T02:17:29.408220] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-29T02:17:29.422312] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:29.433009] [INFO ] [MAIN ] IVR: Generated 1820 derivative records from 48557 primary records. [2025-09-29T02:17:29.439090] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-29T02:17:29.441942] [DEBUG] [LOCAL ] ITW: Derivative data saved (1820 records). [2025-09-29T02:17:29.443007] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-29T02:17:29.446882] [INFO ] [MAIN ] Derivative Progress: 1070/2211 symbols completed. ITW took 1.3s. Estimated remaining: 8m 3s. Rate: 141.9 symbols/min [2025-09-29T02:17:29.447083] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:29.464354] [DEBUG] [LOCAL ] IVR: Derivative data saved (1820 records). [2025-09-29T02:17:29.464868] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-29T02:17:29.468066] [INFO ] [MAIN ] Derivative Progress: 1071/2211 symbols completed. IVR took 1.3s. Estimated remaining: 8m 2s. Rate: 142.0 symbols/min [2025-09-29T02:17:29.468330] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:29.508011] [DEBUG] [LOCAL ] IX: Loaded 22926 existing records from primary storage. [2025-09-29T02:17:29.508740] [INFO ] [MAIN ] IX: Loaded 22926 primary data records. [2025-09-29T02:17:29.660506] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-09-29T02:17:29.662680] [INFO ] [MAIN ] IVZ: Loaded 53908 primary data records. [2025-09-29T02:17:29.765335] [DEBUG] [LOCAL ] J: Loaded 40873 existing records from primary storage. [2025-09-29T02:17:30.002759] [INFO ] [MAIN ] J: Loaded 40873 primary data records. [2025-09-29T02:17:30.651836] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:30.653073] [INFO ] [MAIN ] IX: Generated 1820 derivative records from 22926 primary records. [2025-09-29T02:17:30.653265] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-29T02:17:30.675004] [DEBUG] [LOCAL ] IX: Derivative data saved (1820 records). [2025-09-29T02:17:30.675611] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-29T02:17:30.690905] [INFO ] [MAIN ] Derivative Progress: 1072/2211 symbols completed. IX took 1.2s. Estimated remaining: 8m 2s. Rate: 141.8 symbols/min [2025-09-29T02:17:30.691904] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:30.691458] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:30.693249] [INFO ] [MAIN ] IVZ: Generated 1820 derivative records from 53908 primary records. [2025-09-29T02:17:30.693527] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-29T02:17:30.729167] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1820 records). [2025-09-29T02:17:30.729574] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:30.729792] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-29T02:17:30.730599] [INFO ] [MAIN ] J: Generated 1820 derivative records from 40873 primary records. [2025-09-29T02:17:30.734220] [INFO ] [MAIN ] Derivative Progress: 1073/2211 symbols completed. IVZ took 1.3s. Estimated remaining: 8m 1s. Rate: 141.9 symbols/min [2025-09-29T02:17:30.734384] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:30.734637] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-29T02:17:30.754464] [DEBUG] [LOCAL ] J: Derivative data saved (1820 records). [2025-09-29T02:17:30.764251] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-29T02:17:30.767309] [INFO ] [MAIN ] Derivative Progress: 1074/2211 symbols completed. J took 1.3s. Estimated remaining: 8m 0s. Rate: 142.0 symbols/min [2025-09-29T02:17:30.767791] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:30.790864] [DEBUG] [LOCAL ] JBGS: Loaded 43089 existing records from primary storage. [2025-09-29T02:17:30.791156] [INFO ] [MAIN ] JBGS: Loaded 43089 primary data records. [2025-09-29T02:17:30.973697] [DEBUG] [LOCAL ] JBI: Loaded 44362 existing records from primary storage. [2025-09-29T02:17:31.028264] [INFO ] [MAIN ] JBI: Loaded 44362 primary data records. [2025-09-29T02:17:31.252386] [DEBUG] [LOCAL ] JBL: Loaded 49145 existing records from primary storage. [2025-09-29T02:17:31.275023] [INFO ] [MAIN ] JBL: Loaded 49145 primary data records. [2025-09-29T02:17:31.878682] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:31.880042] [INFO ] [MAIN ] JBGS: Generated 1820 derivative records from 43089 primary records. [2025-09-29T02:17:31.880309] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-29T02:17:31.900925] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1820 records). [2025-09-29T02:17:31.901916] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-29T02:17:31.905207] [INFO ] [MAIN ] Derivative Progress: 1075/2211 symbols completed. JBGS took 1.2s. Estimated remaining: 8m 1s. Rate: 141.8 symbols/min [2025-09-29T02:17:31.908007] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:31.924279] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:31.925414] [INFO ] [MAIN ] JBI: Generated 1820 derivative records from 44362 primary records. [2025-09-29T02:17:31.927598] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-29T02:17:31.953538] [DEBUG] [LOCAL ] JBI: Derivative data saved (1820 records). [2025-09-29T02:17:31.966379] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-29T02:17:31.967519] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:31.970039] [INFO ] [MAIN ] Derivative Progress: 1076/2211 symbols completed. JBI took 1.2s. Estimated remaining: 7m 60s. Rate: 141.9 symbols/min [2025-09-29T02:17:31.970362] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:31.971478] [INFO ] [MAIN ] JBL: Generated 1820 derivative records from 49145 primary records. [2025-09-29T02:17:31.971638] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-29T02:17:32.000909] [DEBUG] [LOCAL ] JBL: Derivative data saved (1820 records). [2025-09-29T02:17:32.001899] [DEBUG] [LOCAL ] JBND: Loaded 26051 existing records from primary storage. [2025-09-29T02:17:32.002173] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-29T02:17:32.002593] [INFO ] [MAIN ] JBND: Loaded 26051 primary data records. [2025-09-29T02:17:32.004892] [INFO ] [MAIN ] Derivative Progress: 1077/2211 symbols completed. JBL took 1.2s. Estimated remaining: 7m 59s. Rate: 142.0 symbols/min [2025-09-29T02:17:32.014962] [DEBUG] [LOCAL ] JCE: Loaded 6591 existing records from primary storage. [2025-09-29T02:17:32.015254] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:32.015460] [INFO ] [MAIN ] JCE: Loaded 6591 primary data records. [2025-09-29T02:17:32.793874] [DEBUG] [LOCAL ] JCI: Loaded 54327 existing records from primary storage. [2025-09-29T02:17:32.796620] [INFO ] [MAIN ] JCI: Loaded 54327 primary data records. [2025-09-29T02:17:33.154613] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:33.169959] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:33.169568] [INFO ] [MAIN ] JBND: Generated 1820 derivative records from 26051 primary records. [2025-09-29T02:17:33.170859] [INFO ] [MAIN ] JCE: Generated 1820 derivative records from 6591 primary records. [2025-09-29T02:17:33.171025] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-29T02:17:33.171105] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-29T02:17:33.203257] [DEBUG] [LOCAL ] JBND: Derivative data saved (1820 records). [2025-09-29T02:17:33.206009] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-29T02:17:33.211557] [DEBUG] [LOCAL ] JCE: Derivative data saved (1820 records). [2025-09-29T02:17:33.209287] [INFO ] [MAIN ] Derivative Progress: 1078/2211 symbols completed. JBND took 1.3s. Estimated remaining: 7m 60s. Rate: 141.8 symbols/min [2025-09-29T02:17:33.212260] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-29T02:17:33.215873] [INFO ] [MAIN ] Derivative Progress: 1079/2211 symbols completed. JCE took 1.2s. Estimated remaining: 7m 59s. Rate: 141.9 symbols/min [2025-09-29T02:17:33.234232] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:33.235090] [INFO ] [MAIN ] JCI: Generated 1820 derivative records from 54327 primary records. [2025-09-29T02:17:33.235179] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-29T02:17:33.251396] [DEBUG] [LOCAL ] JCI: Derivative data saved (1820 records). [2025-09-29T02:17:33.251516] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-29T02:17:33.255398] [INFO ] [MAIN ] Derivative Progress: 1080/2211 symbols completed. JCI took 1.2s. Estimated remaining: 7m 58s. Rate: 142.0 symbols/min [2025-09-29T02:17:33.256258] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:33.256147] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:33.256426] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:33.278614] [DEBUG] [LOCAL ] JEQ: Loaded 9336 existing records from primary storage. [2025-09-29T02:17:33.278980] [INFO ] [MAIN ] JEQ: Loaded 9336 primary data records. [2025-09-29T02:17:33.516186] [DEBUG] [LOCAL ] JELD: Loaded 46791 existing records from primary storage. [2025-09-29T02:17:33.544674] [INFO ] [MAIN ] JELD: Loaded 46791 primary data records. [2025-09-29T02:17:33.697762] [DEBUG] [LOCAL ] JEF: Loaded 50763 existing records from primary storage. [2025-09-29T02:17:33.740762] [INFO ] [MAIN ] JEF: Loaded 50763 primary data records. [2025-09-29T02:17:34.376953] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:34.378572] [INFO ] [MAIN ] JEQ: Generated 1820 derivative records from 9336 primary records. [2025-09-29T02:17:34.379448] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-29T02:17:34.397011] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1820 records). [2025-09-29T02:17:34.397853] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-29T02:17:34.400414] [INFO ] [MAIN ] Derivative Progress: 1081/2211 symbols completed. JEQ took 1.1s. Estimated remaining: 7m 58s. Rate: 141.8 symbols/min [2025-09-29T02:17:34.400822] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:34.421684] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:34.422543] [INFO ] [MAIN ] JELD: Generated 1820 derivative records from 46791 primary records. [2025-09-29T02:17:34.422931] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-29T02:17:34.443089] [DEBUG] [LOCAL ] JELD: Derivative data saved (1820 records). [2025-09-29T02:17:34.443563] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-29T02:17:34.447684] [INFO ] [MAIN ] Derivative Progress: 1082/2211 symbols completed. JELD took 1.2s. Estimated remaining: 7m 57s. Rate: 141.9 symbols/min [2025-09-29T02:17:34.460744] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:34.469928] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:34.470881] [INFO ] [MAIN ] JEF: Generated 1820 derivative records from 50763 primary records. [2025-09-29T02:17:34.470996] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-29T02:17:34.501116] [DEBUG] [LOCAL ] JFR: Loaded 30975 existing records from primary storage. [2025-09-29T02:17:34.500318] [DEBUG] [LOCAL ] JEF: Derivative data saved (1820 records). [2025-09-29T02:17:34.501627] [INFO ] [MAIN ] JFR: Loaded 30975 primary data records. [2025-09-29T02:17:34.501505] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-29T02:17:34.505382] [INFO ] [MAIN ] Derivative Progress: 1083/2211 symbols completed. JEF took 1.2s. Estimated remaining: 7m 57s. Rate: 142.0 symbols/min [2025-09-29T02:17:34.526077] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:34.632912] [DEBUG] [LOCAL ] JGH: Loaded 11064 existing records from primary storage. [2025-09-29T02:17:34.637248] [INFO ] [MAIN ] JGH: Loaded 11064 primary data records. [2025-09-29T02:17:35.262917] [DEBUG] [LOCAL ] JHG: Loaded 48497 existing records from primary storage. [2025-09-29T02:17:35.263598] [INFO ] [MAIN ] JHG: Loaded 48497 primary data records. [2025-09-29T02:17:35.622588] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:35.624426] [INFO ] [MAIN ] JFR: Generated 1820 derivative records from 30975 primary records. [2025-09-29T02:17:35.626420] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-29T02:17:35.656448] [DEBUG] [LOCAL ] JFR: Derivative data saved (1820 records). [2025-09-29T02:17:35.657895] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-29T02:17:35.674959] [INFO ] [MAIN ] Derivative Progress: 1084/2211 symbols completed. JFR took 1.3s. Estimated remaining: 7m 57s. Rate: 141.8 symbols/min [2025-09-29T02:17:35.676349] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:35.676064] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:35.678348] [INFO ] [MAIN ] JGH: Generated 1820 derivative records from 11064 primary records. [2025-09-29T02:17:35.678869] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-29T02:17:35.703599] [DEBUG] [LOCAL ] JGH: Derivative data saved (1820 records). [2025-09-29T02:17:35.708533] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-29T02:17:35.708932] [DEBUG] [LOCAL ] JHI: Loaded 3641 existing records from primary storage. [2025-09-29T02:17:35.712362] [INFO ] [MAIN ] Derivative Progress: 1085/2211 symbols completed. JGH took 1.3s. Estimated remaining: 7m 56s. Rate: 141.9 symbols/min [2025-09-29T02:17:35.712843] [INFO ] [MAIN ] JHI: Loaded 3641 primary data records. [2025-09-29T02:17:35.738275] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:35.755638] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:35.801276] [INFO ] [MAIN ] JHG: Generated 1820 derivative records from 48497 primary records. [2025-09-29T02:17:35.832343] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-29T02:17:35.873113] [DEBUG] [LOCAL ] JHS: Loaded 2878 existing records from primary storage. [2025-09-29T02:17:35.908693] [DEBUG] [LOCAL ] JHG: Derivative data saved (1820 records). [2025-09-29T02:17:35.948713] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-29T02:17:36.069131] [INFO ] [MAIN ] Derivative Progress: 1086/2211 symbols completed. JHG took 1.5s. Estimated remaining: 7m 56s. Rate: 141.9 symbols/min [2025-09-29T02:17:35.948873] [INFO ] [MAIN ] JHS: Loaded 2878 primary data records. [2025-09-29T02:17:36.082960] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:36.509344] [DEBUG] [LOCAL ] JHX: Loaded 51216 existing records from primary storage. [2025-09-29T02:17:36.515754] [INFO ] [MAIN ] JHX: Loaded 51216 primary data records. [2025-09-29T02:17:36.515550] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:36.517750] [INFO ] [MAIN ] JHI: Generated 1820 derivative records from 3641 primary records. [2025-09-29T02:17:36.535206] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-29T02:17:36.630905] [DEBUG] [LOCAL ] JHI: Derivative data saved (1820 records). [2025-09-29T02:17:36.652250] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-29T02:17:36.665791] [INFO ] [MAIN ] Derivative Progress: 1087/2211 symbols completed. JHI took 1.0s. Estimated remaining: 7m 55s. Rate: 141.9 symbols/min [2025-09-29T02:17:36.713633] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:36.938687] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:36.939803] [INFO ] [MAIN ] JHS: Generated 1820 derivative records from 2878 primary records. [2025-09-29T02:17:36.940156] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-29T02:17:36.968373] [DEBUG] [LOCAL ] JILL: Loaded 16931 existing records from primary storage. [2025-09-29T02:17:36.970375] [INFO ] [MAIN ] JILL: Loaded 16931 primary data records. [2025-09-29T02:17:36.970740] [DEBUG] [LOCAL ] JHS: Derivative data saved (1820 records). [2025-09-29T02:17:37.001640] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-29T02:17:37.041915] [INFO ] [MAIN ] Derivative Progress: 1088/2211 symbols completed. JHS took 1.3s. Estimated remaining: 7m 55s. Rate: 141.9 symbols/min [2025-09-29T02:17:37.072043] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:37.333593] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:37.335679] [INFO ] [MAIN ] JHX: Generated 1820 derivative records from 51216 primary records. [2025-09-29T02:17:37.335850] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-29T02:17:37.368056] [DEBUG] [LOCAL ] JHX: Derivative data saved (1820 records). [2025-09-29T02:17:37.368241] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-29T02:17:37.372308] [INFO ] [MAIN ] Derivative Progress: 1089/2211 symbols completed. JHX took 1.3s. Estimated remaining: 7m 54s. Rate: 141.9 symbols/min [2025-09-29T02:17:37.373166] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:37.395858] [DEBUG] [LOCAL ] JKS: Loaded 40672 existing records from primary storage. [2025-09-29T02:17:37.396184] [INFO ] [MAIN ] JKS: Loaded 40672 primary data records. [2025-09-29T02:17:37.556342] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:37.601584] [DEBUG] [LOCAL ] JLL: Loaded 32458 existing records from primary storage. [2025-09-29T02:17:37.611605] [INFO ] [MAIN ] JILL: Generated 1820 derivative records from 16931 primary records. [2025-09-29T02:17:37.644734] [INFO ] [MAIN ] JLL: Loaded 32458 primary data records. [2025-09-29T02:17:37.644963] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-29T02:17:37.877348] [DEBUG] [LOCAL ] JILL: Derivative data saved (1820 records). [2025-09-29T02:17:37.903936] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-29T02:17:37.919027] [INFO ] [MAIN ] Derivative Progress: 1090/2211 symbols completed. JILL took 1.2s. Estimated remaining: 7m 54s. Rate: 141.9 symbols/min [2025-09-29T02:17:37.950809] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:38.145916] [DEBUG] [LOCAL ] JLS: Loaded 4142 existing records from primary storage. [2025-09-29T02:17:38.146463] [INFO ] [MAIN ] JLS: Loaded 4142 primary data records. [2025-09-29T02:17:38.344841] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:38.393459] [INFO ] [MAIN ] JKS: Generated 1820 derivative records from 40672 primary records. [2025-09-29T02:17:38.508138] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-29T02:17:38.549914] [DEBUG] [LOCAL ] JKS: Derivative data saved (1820 records). [2025-09-29T02:17:38.550835] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-29T02:17:38.563453] [INFO ] [MAIN ] Derivative Progress: 1091/2211 symbols completed. JKS took 1.5s. Estimated remaining: 7m 54s. Rate: 141.8 symbols/min [2025-09-29T02:17:38.569869] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:38.570211] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:38.571818] [INFO ] [MAIN ] JLL: Generated 1820 derivative records from 32458 primary records. [2025-09-29T02:17:38.572588] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-29T02:17:38.592027] [DEBUG] [LOCAL ] JLL: Derivative data saved (1820 records). [2025-09-29T02:17:38.592505] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-29T02:17:38.596025] [INFO ] [MAIN ] Derivative Progress: 1092/2211 symbols completed. JLL took 1.2s. Estimated remaining: 7m 53s. Rate: 141.9 symbols/min [2025-09-29T02:17:38.596792] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:38.616170] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:38.617106] [INFO ] [MAIN ] JLS: Generated 1820 derivative records from 4142 primary records. [2025-09-29T02:17:38.617237] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-29T02:17:38.647862] [DEBUG] [LOCAL ] JLS: Derivative data saved (1820 records). [2025-09-29T02:17:38.648034] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-29T02:17:38.651490] [INFO ] [MAIN ] Derivative Progress: 1093/2211 symbols completed. JLS took 0.7s. Estimated remaining: 7m 52s. Rate: 142.0 symbols/min [2025-09-29T02:17:38.674007] [DEBUG] [LOCAL ] JMIA: Loaded 51279 existing records from primary storage. [2025-09-29T02:17:38.674230] [INFO ] [MAIN ] JMIA: Loaded 51279 primary data records. [2025-09-29T02:17:38.919531] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-29T02:17:39.034581] [INFO ] [MAIN ] JNJ: Loaded 54533 primary data records. [2025-09-29T02:17:39.452142] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:39.453632] [INFO ] [MAIN ] JMIA: Generated 1820 derivative records from 51279 primary records. [2025-09-29T02:17:39.454124] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-29T02:17:39.473928] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1820 records). [2025-09-29T02:17:39.474109] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-29T02:17:39.477171] [INFO ] [MAIN ] Derivative Progress: 1094/2211 symbols completed. JMIA took 0.9s. Estimated remaining: 7m 52s. Rate: 141.9 symbols/min [2025-09-29T02:17:39.497569] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:39.498397] [INFO ] [MAIN ] JNJ: Generated 1820 derivative records from 54533 primary records. [2025-09-29T02:17:39.498500] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-29T02:17:39.515202] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1820 records). [2025-09-29T02:17:39.515421] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-29T02:17:39.519019] [INFO ] [MAIN ] Derivative Progress: 1095/2211 symbols completed. JNJ took 0.9s. Estimated remaining: 7m 51s. Rate: 142.0 symbols/min [2025-09-29T02:17:39.519675] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:39.520046] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:39.519574] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:39.534181] [DEBUG] [LOCAL ] JOF: Loaded 7177 existing records from primary storage. [2025-09-29T02:17:39.534714] [INFO ] [MAIN ] JOF: Loaded 7177 primary data records. [2025-09-29T02:17:39.674949] [DEBUG] [LOCAL ] JOE: Loaded 24860 existing records from primary storage. [2025-09-29T02:17:39.691160] [INFO ] [MAIN ] JOE: Loaded 24860 primary data records. [2025-09-29T02:17:40.054395] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-09-29T02:17:40.065433] [INFO ] [MAIN ] JOBY: Loaded 54579 primary data records. [2025-09-29T02:17:40.651889] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:40.654153] [INFO ] [MAIN ] JOF: Generated 1820 derivative records from 7177 primary records. [2025-09-29T02:17:40.654743] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-29T02:17:40.674847] [DEBUG] [LOCAL ] JOF: Derivative data saved (1820 records). [2025-09-29T02:17:40.675579] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-29T02:17:40.679072] [INFO ] [MAIN ] Derivative Progress: 1096/2211 symbols completed. JOF took 1.2s. Estimated remaining: 7m 52s. Rate: 141.8 symbols/min [2025-09-29T02:17:40.682264] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:40.700483] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:40.701759] [INFO ] [MAIN ] JOE: Generated 1820 derivative records from 24860 primary records. [2025-09-29T02:17:40.702156] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-29T02:17:40.720758] [DEBUG] [LOCAL ] JOE: Derivative data saved (1820 records). [2025-09-29T02:17:40.721020] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-29T02:17:40.724219] [INFO ] [MAIN ] Derivative Progress: 1097/2211 symbols completed. JOE took 1.2s. Estimated remaining: 7m 51s. Rate: 141.9 symbols/min [2025-09-29T02:17:40.726846] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:40.741806] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:40.742594] [INFO ] [MAIN ] JOBY: Generated 1820 derivative records from 54579 primary records. [2025-09-29T02:17:40.742883] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-29T02:17:40.773569] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1820 records). [2025-09-29T02:17:40.773811] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-29T02:17:40.777229] [INFO ] [MAIN ] Derivative Progress: 1098/2211 symbols completed. JOBY took 1.3s. Estimated remaining: 7m 50s. Rate: 142.0 symbols/min [2025-09-29T02:17:40.778538] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:40.793560] [DEBUG] [LOCAL ] JPC: Loaded 37620 existing records from primary storage. [2025-09-29T02:17:40.793825] [INFO ] [MAIN ] JPC: Loaded 37620 primary data records. [2025-09-29T02:17:41.195346] [DEBUG] [LOCAL ] JQC: Loaded 34194 existing records from primary storage. [2025-09-29T02:17:41.195543] [INFO ] [MAIN ] JQC: Loaded 34194 primary data records. [2025-09-29T02:17:41.226586] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-29T02:17:41.247691] [INFO ] [MAIN ] JPM: Loaded 54574 primary data records. [2025-09-29T02:17:41.963331] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:41.966894] [INFO ] [MAIN ] JPC: Generated 1820 derivative records from 37620 primary records. [2025-09-29T02:17:41.968073] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-29T02:17:42.000578] [DEBUG] [LOCAL ] JPC: Derivative data saved (1820 records). [2025-09-29T02:17:42.001412] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-29T02:17:42.005681] [INFO ] [MAIN ] Derivative Progress: 1099/2211 symbols completed. JPC took 1.3s. Estimated remaining: 7m 51s. Rate: 141.8 symbols/min [2025-09-29T02:17:42.006196] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:42.025394] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:42.029111] [INFO ] [MAIN ] JPM: Generated 1820 derivative records from 54574 primary records. [2025-09-29T02:17:42.029373] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-29T02:17:42.049514] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:42.059465] [INFO ] [MAIN ] JQC: Generated 1820 derivative records from 34194 primary records. [2025-09-29T02:17:42.062439] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-29T02:17:42.092777] [DEBUG] [LOCAL ] JRI: Loaded 15068 existing records from primary storage. [2025-09-29T02:17:42.100839] [INFO ] [MAIN ] JRI: Loaded 15068 primary data records. [2025-09-29T02:17:42.100763] [DEBUG] [LOCAL ] JPM: Derivative data saved (1820 records). [2025-09-29T02:17:42.105115] [DEBUG] [LOCAL ] JQC: Derivative data saved (1820 records). [2025-09-29T02:17:42.105246] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-29T02:17:42.105476] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-29T02:17:42.114415] [INFO ] [MAIN ] Derivative Progress: 1100/2211 symbols completed. JPM took 1.4s. Estimated remaining: 7m 50s. Rate: 141.9 symbols/min [2025-09-29T02:17:42.154872] [INFO ] [MAIN ] Derivative Progress: 1101/2211 symbols completed. JQC took 1.3s. Estimated remaining: 7m 49s. Rate: 142.0 symbols/min [2025-09-29T02:17:42.149678] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:42.185845] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:42.333193] [DEBUG] [LOCAL ] JRS: Loaded 11250 existing records from primary storage. [2025-09-29T02:17:42.449543] [INFO ] [MAIN ] JRS: Loaded 11250 primary data records. [2025-09-29T02:17:42.687413] [DEBUG] [LOCAL ] JXN: Loaded 46558 existing records from primary storage. [2025-09-29T02:17:42.723380] [INFO ] [MAIN ] JXN: Loaded 46558 primary data records. [2025-09-29T02:17:43.190391] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:43.204050] [INFO ] [MAIN ] JRI: Generated 1820 derivative records from 15068 primary records. [2025-09-29T02:17:43.214476] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-29T02:17:43.235902] [DEBUG] [LOCAL ] JRI: Derivative data saved (1820 records). [2025-09-29T02:17:43.237542] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-29T02:17:43.239998] [INFO ] [MAIN ] Derivative Progress: 1102/2211 symbols completed. JRI took 1.2s. Estimated remaining: 7m 49s. Rate: 141.8 symbols/min [2025-09-29T02:17:43.240622] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:43.255553] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:43.256681] [INFO ] [MAIN ] JRS: Generated 1820 derivative records from 11250 primary records. [2025-09-29T02:17:43.257263] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-29T02:17:43.275903] [DEBUG] [LOCAL ] JRS: Derivative data saved (1820 records). [2025-09-29T02:17:43.276545] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-29T02:17:43.279288] [INFO ] [MAIN ] Derivative Progress: 1103/2211 symbols completed. JRS took 1.1s. Estimated remaining: 7m 48s. Rate: 141.9 symbols/min [2025-09-29T02:17:43.279501] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:43.302485] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:43.307189] [INFO ] [MAIN ] JXN: Generated 1820 derivative records from 46558 primary records. [2025-09-29T02:17:43.307467] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-29T02:17:43.342592] [DEBUG] [LOCAL ] KAI: Loaded 13729 existing records from primary storage. [2025-09-29T02:17:43.343869] [INFO ] [MAIN ] KAI: Loaded 13729 primary data records. [2025-09-29T02:17:43.358306] [DEBUG] [LOCAL ] JXN: Derivative data saved (1820 records). [2025-09-29T02:17:43.384603] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-29T02:17:43.438181] [INFO ] [MAIN ] Derivative Progress: 1104/2211 symbols completed. JXN took 1.3s. Estimated remaining: 7m 48s. Rate: 142.0 symbols/min [2025-09-29T02:17:43.491404] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:43.475396] [DEBUG] [LOCAL ] K: Loaded 50637 existing records from primary storage. [2025-09-29T02:17:43.491698] [INFO ] [MAIN ] K: Loaded 50637 primary data records. [2025-09-29T02:17:44.071301] [DEBUG] [LOCAL ] KAR: Loaded 40411 existing records from primary storage. [2025-09-29T02:17:44.072016] [INFO ] [MAIN ] KAR: Loaded 40411 primary data records. [2025-09-29T02:17:44.214769] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:44.295380] [INFO ] [MAIN ] KAI: Generated 1820 derivative records from 13729 primary records. [2025-09-29T02:17:44.295926] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-29T02:17:44.433708] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:44.435110] [INFO ] [MAIN ] K: Generated 1820 derivative records from 50637 primary records. [2025-09-29T02:17:44.435472] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-29T02:17:44.469840] [DEBUG] [LOCAL ] KAI: Derivative data saved (1820 records). [2025-09-29T02:17:44.471473] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-29T02:17:44.471899] [DEBUG] [LOCAL ] K: Derivative data saved (1820 records). [2025-09-29T02:17:44.478508] [INFO ] [MAIN ] Derivative Progress: 1105/2211 symbols completed. KAI took 1.2s. Estimated remaining: 7m 48s. Rate: 141.8 symbols/min [2025-09-29T02:17:44.479067] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:44.478661] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-29T02:17:44.485017] [INFO ] [MAIN ] Derivative Progress: 1106/2211 symbols completed. K took 1.2s. Estimated remaining: 7m 47s. Rate: 141.9 symbols/min [2025-09-29T02:17:44.485723] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:44.515763] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:44.516777] [INFO ] [MAIN ] KAR: Generated 1820 derivative records from 40411 primary records. [2025-09-29T02:17:44.516939] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-29T02:17:44.544290] [DEBUG] [LOCAL ] KBDC: Loaded 21252 existing records from primary storage. [2025-09-29T02:17:44.545028] [INFO ] [MAIN ] KBDC: Loaded 21252 primary data records. [2025-09-29T02:17:44.651039] [DEBUG] [LOCAL ] KB: Loaded 24453 existing records from primary storage. [2025-09-29T02:17:44.627001] [DEBUG] [LOCAL ] KAR: Derivative data saved (1820 records). [2025-09-29T02:17:44.651271] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-29T02:17:44.662966] [INFO ] [MAIN ] Derivative Progress: 1107/2211 symbols completed. KAR took 1.2s. Estimated remaining: 7m 46s. Rate: 142.0 symbols/min [2025-09-29T02:17:44.663223] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:44.651401] [INFO ] [MAIN ] KB: Loaded 24453 primary data records. [2025-09-29T02:17:45.260445] [DEBUG] [LOCAL ] KBH: Loaded 49678 existing records from primary storage. [2025-09-29T02:17:45.261996] [INFO ] [MAIN ] KBH: Loaded 49678 primary data records. [2025-09-29T02:17:45.599385] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:45.667278] [INFO ] [MAIN ] KBDC: Generated 1820 derivative records from 21252 primary records. [2025-09-29T02:17:45.670091] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-29T02:17:45.696356] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:45.701424] [INFO ] [MAIN ] KB: Generated 1820 derivative records from 24453 primary records. [2025-09-29T02:17:45.703780] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-29T02:17:45.708166] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1820 records). [2025-09-29T02:17:45.708533] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-29T02:17:45.723601] [INFO ] [MAIN ] Derivative Progress: 1108/2211 symbols completed. KBDC took 1.2s. Estimated remaining: 7m 47s. Rate: 141.8 symbols/min [2025-09-29T02:17:45.728844] [DEBUG] [LOCAL ] KB: Derivative data saved (1820 records). [2025-09-29T02:17:45.728996] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-29T02:17:45.732743] [INFO ] [MAIN ] Derivative Progress: 1109/2211 symbols completed. KB took 1.3s. Estimated remaining: 7m 46s. Rate: 141.9 symbols/min [2025-09-29T02:17:45.752437] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:45.753296] [INFO ] [MAIN ] KBH: Generated 1820 derivative records from 49678 primary records. [2025-09-29T02:17:45.753390] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-29T02:17:45.769378] [DEBUG] [LOCAL ] KBH: Derivative data saved (1820 records). [2025-09-29T02:17:45.769564] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-29T02:17:45.772943] [INFO ] [MAIN ] Derivative Progress: 1110/2211 symbols completed. KBH took 1.1s. Estimated remaining: 7m 45s. Rate: 142.1 symbols/min [2025-09-29T02:17:45.773679] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:45.773476] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:45.773599] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:45.784776] [DEBUG] [LOCAL ] KEN: Loaded 4784 existing records from primary storage. [2025-09-29T02:17:45.785020] [INFO ] [MAIN ] KEN: Loaded 4784 primary data records. [2025-09-29T02:17:46.171328] [DEBUG] [LOCAL ] KBR: Loaded 48899 existing records from primary storage. [2025-09-29T02:17:46.186636] [INFO ] [MAIN ] KBR: Loaded 48899 primary data records. [2025-09-29T02:17:46.193341] [DEBUG] [LOCAL ] KD: Loaded 53068 existing records from primary storage. [2025-09-29T02:17:46.206726] [INFO ] [MAIN ] KD: Loaded 53068 primary data records. [2025-09-29T02:17:46.899467] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:46.901871] [INFO ] [MAIN ] KEN: Generated 1820 derivative records from 4784 primary records. [2025-09-29T02:17:46.902728] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-29T02:17:46.923232] [DEBUG] [LOCAL ] KEN: Derivative data saved (1820 records). [2025-09-29T02:17:46.923415] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-29T02:17:46.926078] [INFO ] [MAIN ] Derivative Progress: 1111/2211 symbols completed. KEN took 1.2s. Estimated remaining: 7m 45s. Rate: 141.8 symbols/min [2025-09-29T02:17:46.926442] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:46.948608] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:46.951408] [INFO ] [MAIN ] KBR: Generated 1820 derivative records from 48899 primary records. [2025-09-29T02:17:46.951906] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-29T02:17:46.978955] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:46.993033] [INFO ] [MAIN ] KD: Generated 1820 derivative records from 53068 primary records. [2025-09-29T02:17:46.993461] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-29T02:17:46.993177] [DEBUG] [LOCAL ] KBR: Derivative data saved (1820 records). [2025-09-29T02:17:46.994860] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-29T02:17:46.997987] [INFO ] [MAIN ] Derivative Progress: 1112/2211 symbols completed. KBR took 1.2s. Estimated remaining: 7m 45s. Rate: 141.9 symbols/min [2025-09-29T02:17:47.005869] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:47.026851] [DEBUG] [LOCAL ] KD: Derivative data saved (1820 records). [2025-09-29T02:17:47.027090] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-29T02:17:47.032100] [INFO ] [MAIN ] Derivative Progress: 1113/2211 symbols completed. KD took 1.3s. Estimated remaining: 7m 44s. Rate: 142.1 symbols/min [2025-09-29T02:17:47.027890] [DEBUG] [LOCAL ] KEP: Loaded 31169 existing records from primary storage. [2025-09-29T02:17:47.032443] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:47.032575] [INFO ] [MAIN ] KEP: Loaded 31169 primary data records. [2025-09-29T02:17:47.401178] [DEBUG] [LOCAL ] KEX: Loaded 38712 existing records from primary storage. [2025-09-29T02:17:47.401547] [INFO ] [MAIN ] KEX: Loaded 38712 primary data records. [2025-09-29T02:17:47.530893] [DEBUG] [LOCAL ] KEYS: Loaded 43955 existing records from primary storage. [2025-09-29T02:17:47.553322] [INFO ] [MAIN ] KEYS: Loaded 43955 primary data records. [2025-09-29T02:17:48.140536] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:48.156268] [INFO ] [MAIN ] KEP: Generated 1820 derivative records from 31169 primary records. [2025-09-29T02:17:48.156854] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-29T02:17:48.176658] [DEBUG] [LOCAL ] KEP: Derivative data saved (1820 records). [2025-09-29T02:17:48.178507] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-29T02:17:48.181521] [INFO ] [MAIN ] Derivative Progress: 1114/2211 symbols completed. KEP took 1.3s. Estimated remaining: 7m 44s. Rate: 141.8 symbols/min [2025-09-29T02:17:48.182533] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:48.195526] [DEBUG] [LOCAL ] KF: Loaded 2486 existing records from primary storage. [2025-09-29T02:17:48.210575] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:48.210920] [INFO ] [MAIN ] KF: Loaded 2486 primary data records. [2025-09-29T02:17:48.212347] [INFO ] [MAIN ] KEX: Generated 1820 derivative records from 38712 primary records. [2025-09-29T02:17:48.218181] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-29T02:17:48.343470] [DEBUG] [LOCAL ] KEX: Derivative data saved (1820 records). [2025-09-29T02:17:48.345291] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-29T02:17:48.358481] [INFO ] [MAIN ] Derivative Progress: 1115/2211 symbols completed. KEX took 1.4s. Estimated remaining: 7m 43s. Rate: 141.9 symbols/min [2025-09-29T02:17:48.371888] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:48.404107] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:48.447102] [INFO ] [MAIN ] KEYS: Generated 1820 derivative records from 43955 primary records. [2025-09-29T02:17:48.447442] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-29T02:17:48.598501] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1820 records). [2025-09-29T02:17:48.606403] [DEBUG] [LOCAL ] KFRC: Loaded 19766 existing records from primary storage. [2025-09-29T02:17:48.605912] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-29T02:17:48.607216] [INFO ] [MAIN ] KFRC: Loaded 19766 primary data records. [2025-09-29T02:17:48.610071] [INFO ] [MAIN ] Derivative Progress: 1116/2211 symbols completed. KEYS took 1.6s. Estimated remaining: 7m 43s. Rate: 142.0 symbols/min [2025-09-29T02:17:48.655930] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:48.772477] [DEBUG] [LOCAL ] KFS: Loaded 8471 existing records from primary storage. [2025-09-29T02:17:48.822817] [INFO ] [MAIN ] KFS: Loaded 8471 primary data records. [2025-09-29T02:17:49.068048] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:49.103351] [INFO ] [MAIN ] KF: Generated 1820 derivative records from 2486 primary records. [2025-09-29T02:17:49.104527] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-29T02:17:49.338812] [DEBUG] [LOCAL ] KF: Derivative data saved (1820 records). [2025-09-29T02:17:49.339154] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-29T02:17:49.341476] [INFO ] [MAIN ] Derivative Progress: 1117/2211 symbols completed. KF took 1.2s. Estimated remaining: 7m 43s. Rate: 141.9 symbols/min [2025-09-29T02:17:49.342231] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:49.362225] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:49.363267] [INFO ] [MAIN ] KFRC: Generated 1820 derivative records from 19766 primary records. [2025-09-29T02:17:49.363370] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-29T02:17:49.381421] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1820 records). [2025-09-29T02:17:49.381929] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-29T02:17:49.384616] [INFO ] [MAIN ] Derivative Progress: 1118/2211 symbols completed. KFRC took 1.0s. Estimated remaining: 7m 42s. Rate: 142.0 symbols/min [2025-09-29T02:17:49.385178] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:49.412147] [DEBUG] [LOCAL ] KFY: Loaded 31057 existing records from primary storage. [2025-09-29T02:17:49.425610] [INFO ] [MAIN ] KFY: Loaded 31057 primary data records. [2025-09-29T02:17:49.426363] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:49.468105] [INFO ] [MAIN ] KFS: Generated 1820 derivative records from 8471 primary records. [2025-09-29T02:17:49.501972] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-29T02:17:49.789317] [DEBUG] [LOCAL ] KFS: Derivative data saved (1820 records). [2025-09-29T02:17:49.804255] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-29T02:17:49.809960] [INFO ] [MAIN ] Derivative Progress: 1119/2211 symbols completed. KFS took 1.2s. Estimated remaining: 7m 41s. Rate: 142.0 symbols/min [2025-09-29T02:17:49.810568] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:49.813163] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-29T02:17:49.814225] [INFO ] [MAIN ] KGC: Loaded 54479 primary data records. [2025-09-29T02:17:50.213578] [DEBUG] [LOCAL ] KGS: Loaded 46487 existing records from primary storage. [2025-09-29T02:17:50.216211] [INFO ] [MAIN ] KGS: Loaded 46487 primary data records. [2025-09-29T02:17:50.309161] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:50.343772] [INFO ] [MAIN ] KFY: Generated 1820 derivative records from 31057 primary records. [2025-09-29T02:17:50.349217] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-29T02:17:50.579039] [DEBUG] [LOCAL ] KFY: Derivative data saved (1820 records). [2025-09-29T02:17:50.579422] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-29T02:17:50.583021] [INFO ] [MAIN ] Derivative Progress: 1120/2211 symbols completed. KFY took 1.2s. Estimated remaining: 7m 41s. Rate: 141.9 symbols/min [2025-09-29T02:17:50.583455] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:50.605540] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:50.608337] [INFO ] [MAIN ] KGC: Generated 1820 derivative records from 54479 primary records. [2025-09-29T02:17:50.609130] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-29T02:17:50.630266] [DEBUG] [LOCAL ] KGC: Derivative data saved (1820 records). [2025-09-29T02:17:50.630688] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-29T02:17:50.633996] [INFO ] [MAIN ] Derivative Progress: 1121/2211 symbols completed. KGC took 1.2s. Estimated remaining: 7m 41s. Rate: 142.0 symbols/min [2025-09-29T02:17:50.634500] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:50.656109] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:50.657184] [INFO ] [MAIN ] KGS: Generated 1820 derivative records from 46487 primary records. [2025-09-29T02:17:50.672757] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-29T02:17:50.689574] [DEBUG] [LOCAL ] KGS: Derivative data saved (1820 records). [2025-09-29T02:17:50.695095] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-29T02:17:50.701462] [INFO ] [MAIN ] Derivative Progress: 1122/2211 symbols completed. KGS took 0.9s. Estimated remaining: 7m 40s. Rate: 142.1 symbols/min [2025-09-29T02:17:50.716079] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:50.719990] [DEBUG] [LOCAL ] KIM: Loaded 53831 existing records from primary storage. [2025-09-29T02:17:50.720434] [INFO ] [MAIN ] KIM: Loaded 53831 primary data records. [2025-09-29T02:17:50.798633] [DEBUG] [LOCAL ] KIO: Loaded 21625 existing records from primary storage. [2025-09-29T02:17:50.823103] [INFO ] [MAIN ] KIO: Loaded 21625 primary data records. [2025-09-29T02:17:51.424520] [DEBUG] [LOCAL ] KKR: Loaded 54281 existing records from primary storage. [2025-09-29T02:17:51.427455] [INFO ] [MAIN ] KKR: Loaded 54281 primary data records. [2025-09-29T02:17:51.652554] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:51.791173] [INFO ] [MAIN ] KIM: Generated 1820 derivative records from 53831 primary records. [2025-09-29T02:17:51.792684] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-29T02:17:51.814089] [DEBUG] [LOCAL ] KIM: Derivative data saved (1820 records). [2025-09-29T02:17:51.817227] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-29T02:17:51.821389] [INFO ] [MAIN ] Derivative Progress: 1123/2211 symbols completed. KIM took 1.2s. Estimated remaining: 7m 40s. Rate: 141.9 symbols/min [2025-09-29T02:17:51.839572] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:51.840523] [INFO ] [MAIN ] KIO: Generated 1820 derivative records from 21625 primary records. [2025-09-29T02:17:51.840721] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-29T02:17:51.860240] [DEBUG] [LOCAL ] KIO: Derivative data saved (1820 records). [2025-09-29T02:17:51.860555] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-29T02:17:51.863691] [INFO ] [MAIN ] Derivative Progress: 1124/2211 symbols completed. KIO took 1.2s. Estimated remaining: 7m 39s. Rate: 142.0 symbols/min [2025-09-29T02:17:51.880152] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:51.880938] [INFO ] [MAIN ] KKR: Generated 1820 derivative records from 54281 primary records. [2025-09-29T02:17:51.881045] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-29T02:17:51.897468] [DEBUG] [LOCAL ] KKR: Derivative data saved (1820 records). [2025-09-29T02:17:51.897574] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-29T02:17:51.900308] [INFO ] [MAIN ] Derivative Progress: 1125/2211 symbols completed. KKR took 1.2s. Estimated remaining: 7m 38s. Rate: 142.1 symbols/min [2025-09-29T02:17:51.900835] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:51.900957] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:51.901064] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:51.912558] [DEBUG] [LOCAL ] KKRS: Loaded 5801 existing records from primary storage. [2025-09-29T02:17:51.912929] [INFO ] [MAIN ] KKRS: Loaded 5801 primary data records. [2025-09-29T02:17:52.140266] [DEBUG] [LOCAL ] KLC: Loaded 37107 existing records from primary storage. [2025-09-29T02:17:52.147228] [INFO ] [MAIN ] KLC: Loaded 37107 primary data records. [2025-09-29T02:17:52.497696] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-29T02:17:52.516706] [INFO ] [MAIN ] KMI: Loaded 54473 primary data records. [2025-09-29T02:17:53.057827] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:53.058824] [INFO ] [MAIN ] KKRS: Generated 1820 derivative records from 5801 primary records. [2025-09-29T02:17:53.059314] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-29T02:17:53.078966] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1820 records). [2025-09-29T02:17:53.079990] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-29T02:17:53.082294] [INFO ] [MAIN ] Derivative Progress: 1126/2211 symbols completed. KKRS took 1.2s. Estimated remaining: 7m 39s. Rate: 141.9 symbols/min [2025-09-29T02:17:53.082898] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:53.102963] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:53.105492] [INFO ] [MAIN ] KLC: Generated 1820 derivative records from 37107 primary records. [2025-09-29T02:17:53.109537] [DEBUG] [LOCAL ] KMPB: Loaded 3646 existing records from primary storage. [2025-09-29T02:17:53.109785] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-29T02:17:53.110225] [INFO ] [MAIN ] KMPB: Loaded 3646 primary data records. [2025-09-29T02:17:53.239504] [DEBUG] [LOCAL ] KLC: Derivative data saved (1820 records). [2025-09-29T02:17:53.249346] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-29T02:17:53.256926] [INFO ] [MAIN ] Derivative Progress: 1127/2211 symbols completed. KLC took 1.4s. Estimated remaining: 7m 38s. Rate: 142.0 symbols/min [2025-09-29T02:17:53.271275] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:53.316487] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:53.339326] [INFO ] [MAIN ] KMI: Generated 1820 derivative records from 54473 primary records. [2025-09-29T02:17:53.355172] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-29T02:17:53.537459] [DEBUG] [LOCAL ] KMI: Derivative data saved (1820 records). [2025-09-29T02:17:53.539580] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-29T02:17:53.543307] [INFO ] [MAIN ] Derivative Progress: 1128/2211 symbols completed. KMI took 1.6s. Estimated remaining: 7m 38s. Rate: 142.0 symbols/min [2025-09-29T02:17:53.556742] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:53.589621] [DEBUG] [LOCAL ] KMPR: Loaded 39117 existing records from primary storage. [2025-09-29T02:17:53.590141] [INFO ] [MAIN ] KMPR: Loaded 39117 primary data records. [2025-09-29T02:17:53.665617] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:17:53.702866] [INFO ] [MAIN ] KMPB: Generated 1819 derivative records from 3646 primary records. [2025-09-29T02:17:53.714765] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-29T02:17:53.983176] [DEBUG] [LOCAL ] KMT: Loaded 43687 existing records from primary storage. [2025-09-29T02:17:53.901358] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1819 records). [2025-09-29T02:17:53.993170] [INFO ] [MAIN ] KMT: Loaded 43687 primary data records. [2025-09-29T02:17:53.994281] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-29T02:17:54.014486] [INFO ] [MAIN ] Derivative Progress: 1129/2211 symbols completed. KMPB took 0.9s. Estimated remaining: 7m 37s. Rate: 142.0 symbols/min [2025-09-29T02:17:54.021525] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:54.456611] [DEBUG] [LOCAL ] KMX: Loaded 53897 existing records from primary storage. [2025-09-29T02:17:54.457944] [INFO ] [MAIN ] KMX: Loaded 53897 primary data records. [2025-09-29T02:17:54.457411] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:54.477363] [INFO ] [MAIN ] KMPR: Generated 1820 derivative records from 39117 primary records. [2025-09-29T02:17:54.511033] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-29T02:17:54.818537] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1820 records). [2025-09-29T02:17:54.823070] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-29T02:17:54.826495] [INFO ] [MAIN ] Derivative Progress: 1130/2211 symbols completed. KMPR took 1.6s. Estimated remaining: 7m 37s. Rate: 141.9 symbols/min [2025-09-29T02:17:54.827419] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:54.844519] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:54.845820] [INFO ] [MAIN ] KMT: Generated 1820 derivative records from 43687 primary records. [2025-09-29T02:17:54.846088] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-29T02:17:54.865980] [DEBUG] [LOCAL ] KMT: Derivative data saved (1820 records). [2025-09-29T02:17:54.866533] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-29T02:17:54.870060] [INFO ] [MAIN ] Derivative Progress: 1131/2211 symbols completed. KMT took 1.3s. Estimated remaining: 7m 36s. Rate: 142.0 symbols/min [2025-09-29T02:17:54.870421] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:54.903823] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:54.904774] [INFO ] [MAIN ] KMX: Generated 1820 derivative records from 53897 primary records. [2025-09-29T02:17:54.904947] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-29T02:17:54.923225] [DEBUG] [LOCAL ] KMX: Derivative data saved (1820 records). [2025-09-29T02:17:54.943527] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-29T02:17:54.946198] [INFO ] [MAIN ] Derivative Progress: 1132/2211 symbols completed. KMX took 0.9s. Estimated remaining: 7m 36s. Rate: 142.1 symbols/min [2025-09-29T02:17:54.946631] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:54.947866] [DEBUG] [LOCAL ] KN: Loaded 39393 existing records from primary storage. [2025-09-29T02:17:54.948152] [INFO ] [MAIN ] KN: Loaded 39393 primary data records. [2025-09-29T02:17:54.979323] [DEBUG] [LOCAL ] KNF: Loaded 36435 existing records from primary storage. [2025-09-29T02:17:55.009313] [INFO ] [MAIN ] KNF: Loaded 36435 primary data records. [2025-09-29T02:17:55.175159] [DEBUG] [LOCAL ] KNOP: Loaded 10274 existing records from primary storage. [2025-09-29T02:17:55.206052] [INFO ] [MAIN ] KNOP: Loaded 10274 primary data records. [2025-09-29T02:17:56.010022] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:56.009259] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:56.012534] [INFO ] [MAIN ] KN: Generated 1820 derivative records from 39393 primary records. [2025-09-29T02:17:56.011381] [INFO ] [MAIN ] KNF: Generated 1820 derivative records from 36435 primary records. [2025-09-29T02:17:56.012883] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-29T02:17:56.013290] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-29T02:17:56.039401] [DEBUG] [LOCAL ] KN: Derivative data saved (1820 records). [2025-09-29T02:17:56.044359] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-29T02:17:56.049184] [INFO ] [MAIN ] Derivative Progress: 1133/2211 symbols completed. KN took 1.2s. Estimated remaining: 7m 36s. Rate: 141.9 symbols/min [2025-09-29T02:17:56.050340] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:56.052840] [DEBUG] [LOCAL ] KNF: Derivative data saved (1820 records). [2025-09-29T02:17:56.053201] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-29T02:17:56.057084] [INFO ] [MAIN ] Derivative Progress: 1134/2211 symbols completed. KNF took 1.2s. Estimated remaining: 7m 35s. Rate: 142.0 symbols/min [2025-09-29T02:17:56.059231] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:56.075256] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:56.076091] [INFO ] [MAIN ] KNOP: Generated 1820 derivative records from 10274 primary records. [2025-09-29T02:17:56.076450] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-29T02:17:56.097713] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1820 records). [2025-09-29T02:17:56.105250] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-29T02:17:56.106434] [DEBUG] [LOCAL ] KNSL: Loaded 18372 existing records from primary storage. [2025-09-29T02:17:56.109911] [INFO ] [MAIN ] KNSL: Loaded 18372 primary data records. [2025-09-29T02:17:56.109613] [INFO ] [MAIN ] Derivative Progress: 1135/2211 symbols completed. KNOP took 1.2s. Estimated remaining: 7m 34s. Rate: 142.1 symbols/min [2025-09-29T02:17:56.115465] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:56.348683] [DEBUG] [LOCAL ] KNTK: Loaded 46794 existing records from primary storage. [2025-09-29T02:17:56.489684] [INFO ] [MAIN ] KNTK: Loaded 46794 primary data records. [2025-09-29T02:17:56.704224] [DEBUG] [LOCAL ] KNX: Loaded 53363 existing records from primary storage. [2025-09-29T02:17:56.705581] [INFO ] [MAIN ] KNX: Loaded 53363 primary data records. [2025-09-29T02:17:57.273556] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:57.275001] [INFO ] [MAIN ] KNSL: Generated 1820 derivative records from 18372 primary records. [2025-09-29T02:17:57.275125] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-29T02:17:57.294555] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1820 records). [2025-09-29T02:17:57.295006] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-29T02:17:57.297594] [INFO ] [MAIN ] Derivative Progress: 1136/2211 symbols completed. KNSL took 1.2s. Estimated remaining: 7m 35s. Rate: 141.9 symbols/min [2025-09-29T02:17:57.298226] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:57.319850] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:57.321636] [INFO ] [MAIN ] KNTK: Generated 1820 derivative records from 46794 primary records. [2025-09-29T02:17:57.322032] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-29T02:17:57.336519] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:57.352677] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1820 records). [2025-09-29T02:17:57.352903] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-29T02:17:57.351728] [INFO ] [MAIN ] KNX: Generated 1820 derivative records from 53363 primary records. [2025-09-29T02:17:57.355976] [INFO ] [MAIN ] Derivative Progress: 1137/2211 symbols completed. KNTK took 1.3s. Estimated remaining: 7m 34s. Rate: 142.0 symbols/min [2025-09-29T02:17:57.356272] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:57.356452] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-29T02:17:57.384996] [DEBUG] [LOCAL ] KNX: Derivative data saved (1820 records). [2025-09-29T02:17:57.385222] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-29T02:17:57.388333] [INFO ] [MAIN ] Derivative Progress: 1138/2211 symbols completed. KNX took 1.3s. Estimated remaining: 7m 33s. Rate: 142.1 symbols/min [2025-09-29T02:17:57.413296] [DEBUG] [LOCAL ] KODK: Loaded 44025 existing records from primary storage. [2025-09-29T02:17:57.413528] [INFO ] [MAIN ] KODK: Loaded 44025 primary data records. [2025-09-29T02:17:57.527534] [DEBUG] [LOCAL ] KOF: Loaded 26219 existing records from primary storage. [2025-09-29T02:17:57.530593] [INFO ] [MAIN ] KOF: Loaded 26219 primary data records. [2025-09-29T02:17:58.104984] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:58.106043] [INFO ] [MAIN ] KODK: Generated 1820 derivative records from 44025 primary records. [2025-09-29T02:17:58.106410] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-29T02:17:58.128612] [DEBUG] [LOCAL ] KODK: Derivative data saved (1820 records). [2025-09-29T02:17:58.129259] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-29T02:17:58.132199] [INFO ] [MAIN ] Derivative Progress: 1139/2211 symbols completed. KODK took 0.8s. Estimated remaining: 7m 33s. Rate: 142.0 symbols/min [2025-09-29T02:17:58.146234] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:58.147197] [INFO ] [MAIN ] KOF: Generated 1820 derivative records from 26219 primary records. [2025-09-29T02:17:58.147284] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-29T02:17:58.165024] [DEBUG] [LOCAL ] KOF: Derivative data saved (1820 records). [2025-09-29T02:17:58.165199] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-29T02:17:58.168426] [INFO ] [MAIN ] Derivative Progress: 1140/2211 symbols completed. KOF took 0.8s. Estimated remaining: 7m 32s. Rate: 142.1 symbols/min [2025-09-29T02:17:58.169299] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:58.170000] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:58.169220] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:58.176695] [DEBUG] [LOCAL ] KORE: Loaded 2010 existing records from primary storage. [2025-09-29T02:17:58.177146] [INFO ] [MAIN ] KORE: Loaded 2010 primary data records. [2025-09-29T02:17:58.324145] [DEBUG] [LOCAL ] KOP: Loaded 18066 existing records from primary storage. [2025-09-29T02:17:58.330548] [INFO ] [MAIN ] KOP: Loaded 18066 primary data records. [2025-09-29T02:17:58.722864] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-09-29T02:17:58.762597] [INFO ] [MAIN ] KOS: Loaded 53828 primary data records. [2025-09-29T02:17:59.571892] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:59.574457] [INFO ] [MAIN ] KORE: Generated 1820 derivative records from 2010 primary records. [2025-09-29T02:17:59.575534] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-29T02:17:59.595123] [DEBUG] [LOCAL ] KORE: Derivative data saved (1820 records). [2025-09-29T02:17:59.595698] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-29T02:17:59.599142] [INFO ] [MAIN ] Derivative Progress: 1141/2211 symbols completed. KORE took 1.4s. Estimated remaining: 7m 33s. Rate: 141.8 symbols/min [2025-09-29T02:17:59.599633] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:59.616938] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:59.618456] [INFO ] [MAIN ] KOP: Generated 1820 derivative records from 18066 primary records. [2025-09-29T02:17:59.618941] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-29T02:17:59.639569] [DEBUG] [LOCAL ] KOP: Derivative data saved (1820 records). [2025-09-29T02:17:59.653244] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-29T02:17:59.656163] [INFO ] [MAIN ] Derivative Progress: 1142/2211 symbols completed. KOP took 1.5s. Estimated remaining: 7m 32s. Rate: 141.9 symbols/min [2025-09-29T02:17:59.653157] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:59.656411] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:59.657826] [INFO ] [MAIN ] KOS: Generated 1820 derivative records from 53828 primary records. [2025-09-29T02:17:59.658372] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-29T02:17:59.678774] [DEBUG] [LOCAL ] KOS: Derivative data saved (1820 records). [2025-09-29T02:17:59.679211] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-29T02:17:59.683081] [INFO ] [MAIN ] Derivative Progress: 1143/2211 symbols completed. KOS took 1.5s. Estimated remaining: 7m 31s. Rate: 142.1 symbols/min [2025-09-29T02:17:59.683457] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:59.758326] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-09-29T02:17:59.761034] [DEBUG] [LOCAL ] KRC: Loaded 49114 existing records from primary storage. [2025-09-29T02:17:59.760117] [INFO ] [MAIN ] KR: Loaded 54461 primary data records. [2025-09-29T02:17:59.761406] [INFO ] [MAIN ] KRC: Loaded 49114 primary data records. [2025-09-29T02:18:00.022464] [DEBUG] [LOCAL ] KREF: Loaded 37767 existing records from primary storage. [2025-09-29T02:18:00.092931] [INFO ] [MAIN ] KREF: Loaded 37767 primary data records. [2025-09-29T02:18:00.844018] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:00.845299] [INFO ] [MAIN ] KRC: Generated 1820 derivative records from 49114 primary records. [2025-09-29T02:18:00.845417] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-29T02:18:00.864121] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:00.865535] [INFO ] [MAIN ] KR: Generated 1820 derivative records from 54461 primary records. [2025-09-29T02:18:00.873106] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-29T02:18:00.883659] [DEBUG] [LOCAL ] KRC: Derivative data saved (1820 records). [2025-09-29T02:18:00.896892] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-29T02:18:00.904348] [INFO ] [MAIN ] Derivative Progress: 1144/2211 symbols completed. KRC took 1.2s. Estimated remaining: 7m 31s. Rate: 141.8 symbols/min [2025-09-29T02:18:00.907405] [DEBUG] [LOCAL ] KR: Derivative data saved (1820 records). [2025-09-29T02:18:00.907574] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-29T02:18:00.908567] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:00.911409] [INFO ] [MAIN ] Derivative Progress: 1145/2211 symbols completed. KR took 1.3s. Estimated remaining: 7m 31s. Rate: 142.0 symbols/min [2025-09-29T02:18:00.912906] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:00.929177] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:00.930098] [INFO ] [MAIN ] KREF: Generated 1820 derivative records from 37767 primary records. [2025-09-29T02:18:00.930356] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-29T02:18:00.950564] [DEBUG] [LOCAL ] KREF: Derivative data saved (1820 records). [2025-09-29T02:18:00.951081] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-29T02:18:00.954155] [INFO ] [MAIN ] Derivative Progress: 1146/2211 symbols completed. KREF took 1.3s. Estimated remaining: 7m 30s. Rate: 142.1 symbols/min [2025-09-29T02:18:00.954454] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:00.977985] [DEBUG] [LOCAL ] KRO: Loaded 26448 existing records from primary storage. [2025-09-29T02:18:00.978193] [INFO ] [MAIN ] KRO: Loaded 26448 primary data records. [2025-09-29T02:18:01.226527] [DEBUG] [LOCAL ] KRP: Loaded 37947 existing records from primary storage. [2025-09-29T02:18:01.400710] [DEBUG] [LOCAL ] KRG: Loaded 49859 existing records from primary storage. [2025-09-29T02:18:01.419142] [INFO ] [MAIN ] KRP: Loaded 37947 primary data records. [2025-09-29T02:18:01.419241] [INFO ] [MAIN ] KRG: Loaded 49859 primary data records. [2025-09-29T02:18:02.135791] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:02.137989] [INFO ] [MAIN ] KRO: Generated 1820 derivative records from 26448 primary records. [2025-09-29T02:18:02.138283] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-29T02:18:02.159081] [DEBUG] [LOCAL ] KRO: Derivative data saved (1820 records). [2025-09-29T02:18:02.159600] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-29T02:18:02.162260] [INFO ] [MAIN ] Derivative Progress: 1147/2211 symbols completed. KRO took 1.2s. Estimated remaining: 7m 30s. Rate: 141.8 symbols/min [2025-09-29T02:18:02.162818] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:02.183885] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:02.186422] [INFO ] [MAIN ] KRP: Generated 1820 derivative records from 37947 primary records. [2025-09-29T02:18:02.186537] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-29T02:18:02.215393] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:02.218915] [DEBUG] [LOCAL ] KRP: Derivative data saved (1820 records). [2025-09-29T02:18:02.220026] [INFO ] [MAIN ] KRG: Generated 1820 derivative records from 49859 primary records. [2025-09-29T02:18:02.220218] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-29T02:18:02.220142] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-29T02:18:02.223986] [INFO ] [MAIN ] Derivative Progress: 1148/2211 symbols completed. KRP took 1.3s. Estimated remaining: 7m 29s. Rate: 141.9 symbols/min [2025-09-29T02:18:02.224601] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:02.241030] [DEBUG] [LOCAL ] KRG: Derivative data saved (1820 records). [2025-09-29T02:18:02.241267] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-29T02:18:02.244498] [INFO ] [MAIN ] Derivative Progress: 1149/2211 symbols completed. KRG took 1.3s. Estimated remaining: 7m 29s. Rate: 142.1 symbols/min [2025-09-29T02:18:02.244888] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:02.286309] [DEBUG] [LOCAL ] KSS: Loaded 54385 existing records from primary storage. [2025-09-29T02:18:02.286701] [INFO ] [MAIN ] KSS: Loaded 54385 primary data records. [2025-09-29T02:18:02.452596] [DEBUG] [LOCAL ] KT: Loaded 46336 existing records from primary storage. [2025-09-29T02:18:02.523712] [INFO ] [MAIN ] KT: Loaded 46336 primary data records. [2025-09-29T02:18:02.741038] [DEBUG] [LOCAL ] KTB: Loaded 41738 existing records from primary storage. [2025-09-29T02:18:02.760622] [INFO ] [MAIN ] KTB: Loaded 41738 primary data records. [2025-09-29T02:18:03.445079] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:03.446544] [INFO ] [MAIN ] KSS: Generated 1820 derivative records from 54385 primary records. [2025-09-29T02:18:03.446698] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-29T02:18:03.470017] [DEBUG] [LOCAL ] KSS: Derivative data saved (1820 records). [2025-09-29T02:18:03.471498] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-29T02:18:03.477053] [INFO ] [MAIN ] Derivative Progress: 1150/2211 symbols completed. KSS took 1.3s. Estimated remaining: 7m 29s. Rate: 141.8 symbols/min [2025-09-29T02:18:03.477500] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:03.494308] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:03.496948] [INFO ] [MAIN ] KT: Generated 1820 derivative records from 46336 primary records. [2025-09-29T02:18:03.497256] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-29T02:18:03.522956] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:03.534331] [DEBUG] [LOCAL ] KTF: Loaded 13065 existing records from primary storage. [2025-09-29T02:18:03.533189] [INFO ] [MAIN ] KTB: Generated 1820 derivative records from 41738 primary records. [2025-09-29T02:18:03.534519] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-29T02:18:03.534584] [INFO ] [MAIN ] KTF: Loaded 13065 primary data records. [2025-09-29T02:18:03.639516] [DEBUG] [LOCAL ] KTB: Derivative data saved (1820 records). [2025-09-29T02:18:03.646196] [DEBUG] [LOCAL ] KT: Derivative data saved (1820 records). [2025-09-29T02:18:03.646282] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-29T02:18:03.651554] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-29T02:18:03.659619] [INFO ] [MAIN ] Derivative Progress: 1151/2211 symbols completed. KT took 1.4s. Estimated remaining: 7m 28s. Rate: 141.9 symbols/min [2025-09-29T02:18:03.685714] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:03.685798] [INFO ] [MAIN ] Derivative Progress: 1152/2211 symbols completed. KTB took 1.4s. Estimated remaining: 7m 27s. Rate: 142.0 symbols/min [2025-09-29T02:18:03.691987] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:03.954879] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:03.955687] [INFO ] [MAIN ] KTF: Generated 1820 derivative records from 13065 primary records. [2025-09-29T02:18:03.955782] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-29T02:18:03.990240] [DEBUG] [LOCAL ] KTF: Derivative data saved (1820 records). [2025-09-29T02:18:04.004608] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-29T02:18:04.009298] [INFO ] [MAIN ] Derivative Progress: 1153/2211 symbols completed. KTF took 0.5s. Estimated remaining: 7m 27s. Rate: 142.0 symbols/min [2025-09-29T02:18:04.012137] [DEBUG] [LOCAL ] KVYO: Loaded 50696 existing records from primary storage. [2025-09-29T02:18:04.014258] [INFO ] [MAIN ] KVYO: Loaded 50696 primary data records. [2025-09-29T02:18:04.111754] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-29T02:18:04.141716] [INFO ] [MAIN ] KVUE: Loaded 54447 primary data records. [2025-09-29T02:18:04.735711] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:04.736606] [INFO ] [MAIN ] KVYO: Generated 1820 derivative records from 50696 primary records. [2025-09-29T02:18:04.736939] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-29T02:18:04.756855] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1820 records). [2025-09-29T02:18:04.772165] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-29T02:18:04.775419] [INFO ] [MAIN ] Derivative Progress: 1154/2211 symbols completed. KVYO took 1.1s. Estimated remaining: 7m 27s. Rate: 141.9 symbols/min [2025-09-29T02:18:04.775979] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:04.777101] [INFO ] [MAIN ] KVUE: Generated 1820 derivative records from 54447 primary records. [2025-09-29T02:18:04.777261] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-29T02:18:04.793901] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1820 records). [2025-09-29T02:18:04.794040] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-29T02:18:04.796361] [INFO ] [MAIN ] Derivative Progress: 1155/2211 symbols completed. KVUE took 1.1s. Estimated remaining: 7m 26s. Rate: 142.1 symbols/min [2025-09-29T02:18:04.796871] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:04.797035] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:04.797087] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:04.847468] [DEBUG] [LOCAL ] KWR: Loaded 16931 existing records from primary storage. [2025-09-29T02:18:04.847713] [INFO ] [MAIN ] KWR: Loaded 16931 primary data records. [2025-09-29T02:18:04.967309] [DEBUG] [LOCAL ] KW: Loaded 41236 existing records from primary storage. [2025-09-29T02:18:04.980327] [DEBUG] [LOCAL ] KYN: Loaded 30432 existing records from primary storage. [2025-09-29T02:18:04.993719] [INFO ] [MAIN ] KW: Loaded 41236 primary data records. [2025-09-29T02:18:04.993613] [INFO ] [MAIN ] KYN: Loaded 30432 primary data records. [2025-09-29T02:18:05.978390] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:05.979868] [INFO ] [MAIN ] KWR: Generated 1820 derivative records from 16931 primary records. [2025-09-29T02:18:05.983062] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-29T02:18:06.015980] [DEBUG] [LOCAL ] KWR: Derivative data saved (1820 records). [2025-09-29T02:18:06.017087] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-29T02:18:06.017003] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:06.018193] [INFO ] [MAIN ] KYN: Generated 1820 derivative records from 30432 primary records. [2025-09-29T02:18:06.020618] [INFO ] [MAIN ] Derivative Progress: 1156/2211 symbols completed. KWR took 1.2s. Estimated remaining: 7m 26s. Rate: 141.8 symbols/min [2025-09-29T02:18:06.020935] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:06.021206] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-29T02:18:06.043069] [DEBUG] [LOCAL ] KYN: Derivative data saved (1820 records). [2025-09-29T02:18:06.045184] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-29T02:18:06.048350] [INFO ] [MAIN ] Derivative Progress: 1157/2211 symbols completed. KYN took 1.3s. Estimated remaining: 7m 26s. Rate: 141.9 symbols/min [2025-09-29T02:18:06.048725] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:06.063231] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:06.064051] [INFO ] [MAIN ] KW: Generated 1820 derivative records from 41236 primary records. [2025-09-29T02:18:06.064272] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-29T02:18:06.082480] [DEBUG] [LOCAL ] KW: Derivative data saved (1820 records). [2025-09-29T02:18:06.082856] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-29T02:18:06.085511] [INFO ] [MAIN ] Derivative Progress: 1158/2211 symbols completed. KW took 1.3s. Estimated remaining: 7m 25s. Rate: 142.0 symbols/min [2025-09-29T02:18:06.096414] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:06.120121] [DEBUG] [LOCAL ] L: Loaded 41562 existing records from primary storage. [2025-09-29T02:18:06.120504] [INFO ] [MAIN ] L: Loaded 41562 primary data records. [2025-09-29T02:18:06.265172] [DEBUG] [LOCAL ] LAD: Loaded 24089 existing records from primary storage. [2025-09-29T02:18:06.292079] [INFO ] [MAIN ] LAD: Loaded 24089 primary data records. [2025-09-29T02:18:06.334709] [DEBUG] [LOCAL ] LAC: Loaded 53091 existing records from primary storage. [2025-09-29T02:18:06.501414] [INFO ] [MAIN ] LAC: Loaded 53091 primary data records. [2025-09-29T02:18:07.241811] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:07.244245] [INFO ] [MAIN ] L: Generated 1820 derivative records from 41562 primary records. [2025-09-29T02:18:07.244958] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-29T02:18:07.275448] [DEBUG] [LOCAL ] L: Derivative data saved (1820 records). [2025-09-29T02:18:07.280772] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-29T02:18:07.285072] [INFO ] [MAIN ] Derivative Progress: 1159/2211 symbols completed. L took 1.3s. Estimated remaining: 7m 25s. Rate: 141.8 symbols/min [2025-09-29T02:18:07.285464] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:07.300866] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:07.302233] [INFO ] [MAIN ] LAD: Generated 1820 derivative records from 24089 primary records. [2025-09-29T02:18:07.302453] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-29T02:18:07.325206] [DEBUG] [LOCAL ] LAD: Derivative data saved (1820 records). [2025-09-29T02:18:07.325704] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-29T02:18:07.343056] [INFO ] [MAIN ] Derivative Progress: 1160/2211 symbols completed. LAD took 1.2s. Estimated remaining: 7m 24s. Rate: 141.9 symbols/min [2025-09-29T02:18:07.344296] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:07.344489] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:07.345728] [INFO ] [MAIN ] LAC: Generated 1820 derivative records from 53091 primary records. [2025-09-29T02:18:07.346134] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-29T02:18:07.365517] [DEBUG] [LOCAL ] LAC: Derivative data saved (1820 records). [2025-09-29T02:18:07.377291] [DEBUG] [LOCAL ] LANV: Loaded 2851 existing records from primary storage. [2025-09-29T02:18:07.377106] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-29T02:18:07.380787] [INFO ] [MAIN ] Derivative Progress: 1161/2211 symbols completed. LAC took 1.3s. Estimated remaining: 7m 24s. Rate: 142.0 symbols/min [2025-09-29T02:18:07.377459] [INFO ] [MAIN ] LANV: Loaded 2851 primary data records. [2025-09-29T02:18:07.381103] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:07.502561] [DEBUG] [LOCAL ] LADR: Loaded 39204 existing records from primary storage. [2025-09-29T02:18:07.531589] [INFO ] [MAIN ] LADR: Loaded 39204 primary data records. [2025-09-29T02:18:07.576395] [DEBUG] [LOCAL ] LAW: Loaded 14171 existing records from primary storage. [2025-09-29T02:18:07.631849] [INFO ] [MAIN ] LAW: Loaded 14171 primary data records. [2025-09-29T02:18:08.535028] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:18:08.536452] [INFO ] [MAIN ] LANV: Generated 1818 derivative records from 2851 primary records. [2025-09-29T02:18:08.536967] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-29T02:18:08.552485] [DEBUG] [LOCAL ] LANV: Derivative data saved (1818 records). [2025-09-29T02:18:08.552871] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-29T02:18:08.555199] [INFO ] [MAIN ] Derivative Progress: 1162/2211 symbols completed. LANV took 1.2s. Estimated remaining: 7m 24s. Rate: 141.8 symbols/min [2025-09-29T02:18:08.555920] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:08.588332] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:08.588630] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:08.589749] [INFO ] [MAIN ] LAW: Generated 1820 derivative records from 14171 primary records. [2025-09-29T02:18:08.590636] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-29T02:18:08.590512] [INFO ] [MAIN ] LADR: Generated 1820 derivative records from 39204 primary records. [2025-09-29T02:18:08.591584] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-29T02:18:08.608850] [DEBUG] [LOCAL ] LAW: Derivative data saved (1820 records). [2025-09-29T02:18:08.609257] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-29T02:18:08.619498] [INFO ] [MAIN ] Derivative Progress: 1163/2211 symbols completed. LAW took 1.2s. Estimated remaining: 7m 23s. Rate: 141.9 symbols/min [2025-09-29T02:18:08.624606] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:08.629008] [DEBUG] [LOCAL ] LADR: Derivative data saved (1820 records). [2025-09-29T02:18:08.629544] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-29T02:18:08.632348] [INFO ] [MAIN ] Derivative Progress: 1164/2211 symbols completed. LADR took 1.3s. Estimated remaining: 7m 22s. Rate: 142.0 symbols/min [2025-09-29T02:18:08.633923] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:08.670321] [DEBUG] [LOCAL ] LAZ: Loaded 45784 existing records from primary storage. [2025-09-29T02:18:08.670568] [INFO ] [MAIN ] LAZ: Loaded 45784 primary data records. [2025-09-29T02:18:09.086295] [DEBUG] [LOCAL ] LB: Loaded 38116 existing records from primary storage. [2025-09-29T02:18:09.088889] [INFO ] [MAIN ] LB: Loaded 38116 primary data records. [2025-09-29T02:18:09.130861] [DEBUG] [LOCAL ] LBRT: Loaded 53695 existing records from primary storage. [2025-09-29T02:18:09.180927] [INFO ] [MAIN ] LBRT: Loaded 53695 primary data records. [2025-09-29T02:18:09.805411] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:09.816462] [INFO ] [MAIN ] LAZ: Generated 1820 derivative records from 45784 primary records. [2025-09-29T02:18:09.817048] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-29T02:18:09.839103] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1820 records). [2025-09-29T02:18:09.839798] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-29T02:18:09.843387] [INFO ] [MAIN ] Derivative Progress: 1165/2211 symbols completed. LAZ took 1.3s. Estimated remaining: 7m 23s. Rate: 141.8 symbols/min [2025-09-29T02:18:09.843596] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:09.866938] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:09.868592] [INFO ] [MAIN ] LB: Generated 1820 derivative records from 38116 primary records. [2025-09-29T02:18:09.868926] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-29T02:18:09.889135] [DEBUG] [LOCAL ] LB: Derivative data saved (1820 records). [2025-09-29T02:18:09.891355] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-29T02:18:09.893907] [INFO ] [MAIN ] Derivative Progress: 1166/2211 symbols completed. LB took 1.3s. Estimated remaining: 7m 22s. Rate: 141.9 symbols/min [2025-09-29T02:18:09.894355] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:09.910341] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:09.923044] [INFO ] [MAIN ] LBRT: Generated 1820 derivative records from 53695 primary records. [2025-09-29T02:18:09.923195] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-29T02:18:09.944154] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1820 records). [2025-09-29T02:18:09.958126] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-29T02:18:09.962982] [INFO ] [MAIN ] Derivative Progress: 1167/2211 symbols completed. LBRT took 1.3s. Estimated remaining: 7m 21s. Rate: 142.0 symbols/min [2025-09-29T02:18:09.972131] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:09.971588] [DEBUG] [LOCAL ] LC: Loaded 48605 existing records from primary storage. [2025-09-29T02:18:09.972956] [INFO ] [MAIN ] LC: Loaded 48605 primary data records. [2025-09-29T02:18:10.075975] [DEBUG] [LOCAL ] LCII: Loaded 28900 existing records from primary storage. [2025-09-29T02:18:10.094937] [INFO ] [MAIN ] LCII: Loaded 28900 primary data records. [2025-09-29T02:18:10.317285] [DEBUG] [LOCAL ] LDI: Loaded 44776 existing records from primary storage. [2025-09-29T02:18:10.344357] [INFO ] [MAIN ] LDI: Loaded 44776 primary data records. [2025-09-29T02:18:11.159413] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:11.160823] [INFO ] [MAIN ] LC: Generated 1820 derivative records from 48605 primary records. [2025-09-29T02:18:11.161965] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-29T02:18:11.196800] [DEBUG] [LOCAL ] LC: Derivative data saved (1820 records). [2025-09-29T02:18:11.197882] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-29T02:18:11.196138] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:11.198827] [INFO ] [MAIN ] LCII: Generated 1820 derivative records from 28900 primary records. [2025-09-29T02:18:11.202243] [INFO ] [MAIN ] Derivative Progress: 1168/2211 symbols completed. LC took 1.4s. Estimated remaining: 7m 21s. Rate: 141.8 symbols/min [2025-09-29T02:18:11.202576] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-29T02:18:11.224351] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:11.230331] [INFO ] [MAIN ] LDI: Generated 1820 derivative records from 44776 primary records. [2025-09-29T02:18:11.230447] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-29T02:18:11.234094] [DEBUG] [LOCAL ] LCII: Derivative data saved (1820 records). [2025-09-29T02:18:11.234433] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-29T02:18:11.237884] [INFO ] [MAIN ] Derivative Progress: 1169/2211 symbols completed. LCII took 1.3s. Estimated remaining: 7m 21s. Rate: 141.9 symbols/min [2025-09-29T02:18:11.254112] [DEBUG] [LOCAL ] LDI: Derivative data saved (1820 records). [2025-09-29T02:18:11.254264] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-29T02:18:11.257888] [INFO ] [MAIN ] Derivative Progress: 1170/2211 symbols completed. LDI took 1.3s. Estimated remaining: 7m 20s. Rate: 142.0 symbols/min [2025-09-29T02:18:11.258318] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:11.258437] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:11.258580] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:11.281219] [DEBUG] [LOCAL ] LDP: Loaded 13128 existing records from primary storage. [2025-09-29T02:18:11.281581] [INFO ] [MAIN ] LDP: Loaded 13128 primary data records. [2025-09-29T02:18:11.479133] [DEBUG] [LOCAL ] LDOS: Loaded 46407 existing records from primary storage. [2025-09-29T02:18:11.541379] [INFO ] [MAIN ] LDOS: Loaded 46407 primary data records. [2025-09-29T02:18:11.666187] [DEBUG] [LOCAL ] LEA: Loaded 42464 existing records from primary storage. [2025-09-29T02:18:11.671846] [INFO ] [MAIN ] LEA: Loaded 42464 primary data records. [2025-09-29T02:18:12.398471] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:12.400592] [INFO ] [MAIN ] LDP: Generated 1820 derivative records from 13128 primary records. [2025-09-29T02:18:12.401775] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-29T02:18:12.430765] [DEBUG] [LOCAL ] LDP: Derivative data saved (1820 records). [2025-09-29T02:18:12.431828] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-29T02:18:12.435550] [INFO ] [MAIN ] Derivative Progress: 1171/2211 symbols completed. LDP took 1.2s. Estimated remaining: 7m 20s. Rate: 141.8 symbols/min [2025-09-29T02:18:12.436773] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:12.473456] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:12.473757] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:12.475924] [INFO ] [MAIN ] LEA: Generated 1820 derivative records from 42464 primary records. [2025-09-29T02:18:12.475764] [INFO ] [MAIN ] LDOS: Generated 1820 derivative records from 46407 primary records. [2025-09-29T02:18:12.476139] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-29T02:18:12.476603] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-29T02:18:12.508451] [DEBUG] [LOCAL ] LEA: Derivative data saved (1820 records). [2025-09-29T02:18:12.512225] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-29T02:18:12.512682] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1820 records). [2025-09-29T02:18:12.516389] [INFO ] [MAIN ] Derivative Progress: 1172/2211 symbols completed. LEA took 1.3s. Estimated remaining: 7m 19s. Rate: 141.9 symbols/min [2025-09-29T02:18:12.517067] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:12.516882] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-29T02:18:12.521513] [INFO ] [MAIN ] Derivative Progress: 1173/2211 symbols completed. LDOS took 1.3s. Estimated remaining: 7m 19s. Rate: 142.0 symbols/min [2025-09-29T02:18:12.522098] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:12.561928] [DEBUG] [LOCAL ] LEO: Loaded 17785 existing records from primary storage. [2025-09-29T02:18:12.563599] [INFO ] [MAIN ] LEO: Loaded 17785 primary data records. [2025-09-29T02:18:12.651207] [DEBUG] [LOCAL ] LEG: Loaded 51130 existing records from primary storage. [2025-09-29T02:18:12.710211] [INFO ] [MAIN ] LEG: Loaded 51130 primary data records. [2025-09-29T02:18:12.987538] [DEBUG] [LOCAL ] LEN: Loaded 53967 existing records from primary storage. [2025-09-29T02:18:13.048045] [INFO ] [MAIN ] LEN: Loaded 53967 primary data records. [2025-09-29T02:18:13.638538] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:13.640170] [INFO ] [MAIN ] LEO: Generated 1820 derivative records from 17785 primary records. [2025-09-29T02:18:13.641286] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-29T02:18:13.663099] [DEBUG] [LOCAL ] LEO: Derivative data saved (1820 records). [2025-09-29T02:18:13.664020] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-29T02:18:13.666892] [INFO ] [MAIN ] Derivative Progress: 1174/2211 symbols completed. LEO took 1.1s. Estimated remaining: 7m 19s. Rate: 141.8 symbols/min [2025-09-29T02:18:13.667623] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:13.688298] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:13.690413] [INFO ] [MAIN ] LEN: Generated 1820 derivative records from 53967 primary records. [2025-09-29T02:18:13.691427] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-29T02:18:13.719545] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:13.723066] [INFO ] [MAIN ] LEG: Generated 1820 derivative records from 51130 primary records. [2025-09-29T02:18:13.724543] [DEBUG] [LOCAL ] LEN: Derivative data saved (1820 records). [2025-09-29T02:18:13.724673] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-29T02:18:13.724953] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-29T02:18:13.730144] [INFO ] [MAIN ] Derivative Progress: 1175/2211 symbols completed. LEN took 1.2s. Estimated remaining: 7m 18s. Rate: 141.9 symbols/min [2025-09-29T02:18:13.738891] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:13.748508] [DEBUG] [LOCAL ] LEG: Derivative data saved (1820 records). [2025-09-29T02:18:13.748903] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-29T02:18:13.754096] [INFO ] [MAIN ] Derivative Progress: 1176/2211 symbols completed. LEG took 1.3s. Estimated remaining: 7m 17s. Rate: 142.0 symbols/min [2025-09-29T02:18:13.754794] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:13.790796] [DEBUG] [LOCAL ] LGI: Loaded 10137 existing records from primary storage. [2025-09-29T02:18:13.791123] [INFO ] [MAIN ] LGI: Loaded 10137 primary data records. [2025-09-29T02:18:13.869203] [DEBUG] [LOCAL ] LFT: Loaded 18286 existing records from primary storage. [2025-09-29T02:18:13.863473] [DEBUG] [LOCAL ] LEVI: Loaded 52306 existing records from primary storage. [2025-09-29T02:18:13.894921] [INFO ] [MAIN ] LEVI: Loaded 52306 primary data records. [2025-09-29T02:18:13.894725] [INFO ] [MAIN ] LFT: Loaded 18286 primary data records. [2025-09-29T02:18:14.909306] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:14.910360] [INFO ] [MAIN ] LGI: Generated 1820 derivative records from 10137 primary records. [2025-09-29T02:18:14.911162] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-29T02:18:14.930373] [DEBUG] [LOCAL ] LGI: Derivative data saved (1820 records). [2025-09-29T02:18:14.930961] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-29T02:18:14.935499] [INFO ] [MAIN ] Derivative Progress: 1177/2211 symbols completed. LGI took 1.2s. Estimated remaining: 7m 17s. Rate: 141.8 symbols/min [2025-09-29T02:18:14.937708] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:14.955825] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:14.979291] [INFO ] [MAIN ] LFT: Generated 1820 derivative records from 18286 primary records. [2025-09-29T02:18:14.979730] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:14.979994] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-29T02:18:14.981238] [INFO ] [MAIN ] LEVI: Generated 1820 derivative records from 52306 primary records. [2025-09-29T02:18:14.982685] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-29T02:18:15.016424] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1820 records). [2025-09-29T02:18:15.016733] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-29T02:18:15.019992] [INFO ] [MAIN ] Derivative Progress: 1178/2211 symbols completed. LEVI took 1.4s. Estimated remaining: 7m 17s. Rate: 141.9 symbols/min [2025-09-29T02:18:15.016560] [DEBUG] [LOCAL ] LFT: Derivative data saved (1820 records). [2025-09-29T02:18:15.020276] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:15.020571] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-29T02:18:15.024521] [INFO ] [MAIN ] Derivative Progress: 1179/2211 symbols completed. LFT took 1.3s. Estimated remaining: 7m 16s. Rate: 142.0 symbols/min [2025-09-29T02:18:15.026468] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:15.065684] [DEBUG] [LOCAL ] LH: Loaded 38660 existing records from primary storage. [2025-09-29T02:18:15.066136] [INFO ] [MAIN ] LH: Loaded 38660 primary data records. [2025-09-29T02:18:15.213027] [DEBUG] [LOCAL ] LII: Loaded 28648 existing records from primary storage. [2025-09-29T02:18:15.219039] [INFO ] [MAIN ] LII: Loaded 28648 primary data records. [2025-09-29T02:18:15.535442] [DEBUG] [LOCAL ] LHX: Loaded 49413 existing records from primary storage. [2025-09-29T02:18:15.565392] [INFO ] [MAIN ] LHX: Loaded 49413 primary data records. [2025-09-29T02:18:16.170832] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:16.172364] [INFO ] [MAIN ] LH: Generated 1820 derivative records from 38660 primary records. [2025-09-29T02:18:16.173220] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-29T02:18:16.197431] [DEBUG] [LOCAL ] LH: Derivative data saved (1820 records). [2025-09-29T02:18:16.211868] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-29T02:18:16.212761] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:16.216164] [INFO ] [MAIN ] Derivative Progress: 1180/2211 symbols completed. LH took 1.3s. Estimated remaining: 7m 16s. Rate: 141.8 symbols/min [2025-09-29T02:18:16.218680] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:16.218490] [INFO ] [MAIN ] LII: Generated 1820 derivative records from 28648 primary records. [2025-09-29T02:18:16.220346] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-29T02:18:16.253822] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:16.253459] [DEBUG] [LOCAL ] LII: Derivative data saved (1820 records). [2025-09-29T02:18:16.254723] [INFO ] [MAIN ] LHX: Generated 1820 derivative records from 49413 primary records. [2025-09-29T02:18:16.254878] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-29T02:18:16.258298] [INFO ] [MAIN ] Derivative Progress: 1181/2211 symbols completed. LII took 1.2s. Estimated remaining: 7m 15s. Rate: 141.9 symbols/min [2025-09-29T02:18:16.258601] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:16.254975] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-29T02:18:16.279341] [DEBUG] [LOCAL ] LHX: Derivative data saved (1820 records). [2025-09-29T02:18:16.282888] [DEBUG] [LOCAL ] LITB: Loaded 4436 existing records from primary storage. [2025-09-29T02:18:16.283248] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-29T02:18:16.286398] [INFO ] [MAIN ] LITB: Loaded 4436 primary data records. [2025-09-29T02:18:16.286270] [INFO ] [MAIN ] Derivative Progress: 1182/2211 symbols completed. LHX took 1.3s. Estimated remaining: 7m 15s. Rate: 142.0 symbols/min [2025-09-29T02:18:16.305207] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:16.452501] [DEBUG] [LOCAL ] LION: Loaded 43950 existing records from primary storage. [2025-09-29T02:18:16.496048] [INFO ] [MAIN ] LION: Loaded 43950 primary data records. [2025-09-29T02:18:16.936398] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-09-29T02:18:17.075211] [INFO ] [MAIN ] LLY: Loaded 54064 primary data records. [2025-09-29T02:18:17.375040] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:17.433814] [INFO ] [MAIN ] LITB: Generated 1820 derivative records from 4436 primary records. [2025-09-29T02:18:17.434702] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-29T02:18:17.466297] [DEBUG] [LOCAL ] LITB: Derivative data saved (1820 records). [2025-09-29T02:18:17.472337] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:17.472560] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-29T02:18:17.475961] [INFO ] [MAIN ] Derivative Progress: 1183/2211 symbols completed. LITB took 1.2s. Estimated remaining: 7m 15s. Rate: 141.8 symbols/min [2025-09-29T02:18:17.473416] [INFO ] [MAIN ] LION: Generated 1820 derivative records from 43950 primary records. [2025-09-29T02:18:17.476747] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-29T02:18:17.494283] [DEBUG] [LOCAL ] LION: Derivative data saved (1820 records). [2025-09-29T02:18:17.494534] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-29T02:18:17.498441] [INFO ] [MAIN ] Derivative Progress: 1184/2211 symbols completed. LION took 1.3s. Estimated remaining: 7m 14s. Rate: 141.9 symbols/min [2025-09-29T02:18:17.515237] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:17.515931] [INFO ] [MAIN ] LLY: Generated 1820 derivative records from 54064 primary records. [2025-09-29T02:18:17.516015] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-29T02:18:17.532612] [DEBUG] [LOCAL ] LLY: Derivative data saved (1820 records). [2025-09-29T02:18:17.532732] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-29T02:18:17.536455] [INFO ] [MAIN ] Derivative Progress: 1185/2211 symbols completed. LLY took 1.2s. Estimated remaining: 7m 13s. Rate: 142.0 symbols/min [2025-09-29T02:18:17.537128] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:17.537208] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:17.537036] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:17.640944] [DEBUG] [LOCAL ] LMT: Loaded 50608 existing records from primary storage. [2025-09-29T02:18:17.642601] [DEBUG] [LOCAL ] LNC: Loaded 52369 existing records from primary storage. [2025-09-29T02:18:17.642885] [INFO ] [MAIN ] LMT: Loaded 50608 primary data records. [2025-09-29T02:18:17.643096] [INFO ] [MAIN ] LNC: Loaded 52369 primary data records. [2025-09-29T02:18:17.894067] [DEBUG] [LOCAL ] LMND: Loaded 52647 existing records from primary storage. [2025-09-29T02:18:17.920405] [INFO ] [MAIN ] LMND: Loaded 52647 primary data records. [2025-09-29T02:18:18.725684] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:18.727553] [INFO ] [MAIN ] LNC: Generated 1820 derivative records from 52369 primary records. [2025-09-29T02:18:18.727924] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-29T02:18:18.726514] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:18.728874] [INFO ] [MAIN ] LMT: Generated 1820 derivative records from 50608 primary records. [2025-09-29T02:18:18.729811] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-29T02:18:18.759337] [DEBUG] [LOCAL ] LNC: Derivative data saved (1820 records). [2025-09-29T02:18:18.764396] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-29T02:18:18.768549] [DEBUG] [LOCAL ] LMT: Derivative data saved (1820 records). [2025-09-29T02:18:18.767476] [INFO ] [MAIN ] Derivative Progress: 1186/2211 symbols completed. LNC took 1.2s. Estimated remaining: 7m 14s. Rate: 141.8 symbols/min [2025-09-29T02:18:18.769922] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:18.771671] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-29T02:18:18.776126] [INFO ] [MAIN ] Derivative Progress: 1187/2211 symbols completed. LMT took 1.2s. Estimated remaining: 7m 13s. Rate: 141.9 symbols/min [2025-09-29T02:18:18.791282] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:18.791775] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:18.796376] [DEBUG] [LOCAL ] LND: Loaded 5013 existing records from primary storage. [2025-09-29T02:18:18.797289] [INFO ] [MAIN ] LMND: Generated 1820 derivative records from 52647 primary records. [2025-09-29T02:18:18.797623] [INFO ] [MAIN ] LND: Loaded 5013 primary data records. [2025-09-29T02:18:18.803136] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-29T02:18:18.923333] [DEBUG] [LOCAL ] LMND: Derivative data saved (1820 records). [2025-09-29T02:18:18.927345] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-29T02:18:18.947348] [INFO ] [MAIN ] Derivative Progress: 1188/2211 symbols completed. LMND took 1.4s. Estimated remaining: 7m 12s. Rate: 142.0 symbols/min [2025-09-29T02:18:18.985603] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:19.204390] [DEBUG] [LOCAL ] LNG: Loaded 52224 existing records from primary storage. [2025-09-29T02:18:19.208777] [INFO ] [MAIN ] LNG: Loaded 52224 primary data records. [2025-09-29T02:18:19.264707] [DEBUG] [LOCAL ] LNN: Loaded 11404 existing records from primary storage. [2025-09-29T02:18:19.294078] [INFO ] [MAIN ] LNN: Loaded 11404 primary data records. [2025-09-29T02:18:19.906894] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:19.908404] [INFO ] [MAIN ] LND: Generated 1820 derivative records from 5013 primary records. [2025-09-29T02:18:19.908553] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-29T02:18:19.928238] [DEBUG] [LOCAL ] LND: Derivative data saved (1820 records). [2025-09-29T02:18:19.928694] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-29T02:18:19.931044] [INFO ] [MAIN ] Derivative Progress: 1189/2211 symbols completed. LND took 1.2s. Estimated remaining: 7m 12s. Rate: 141.8 symbols/min [2025-09-29T02:18:19.931347] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:19.953507] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:19.956052] [INFO ] [MAIN ] LNG: Generated 1820 derivative records from 52224 primary records. [2025-09-29T02:18:19.958279] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-29T02:18:19.990109] [DEBUG] [LOCAL ] LNG: Derivative data saved (1820 records). [2025-09-29T02:18:19.990265] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-29T02:18:19.985551] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:19.993981] [INFO ] [MAIN ] Derivative Progress: 1190/2211 symbols completed. LNG took 1.2s. Estimated remaining: 7m 12s. Rate: 141.9 symbols/min [2025-09-29T02:18:19.994404] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:19.995346] [INFO ] [MAIN ] LNN: Generated 1820 derivative records from 11404 primary records. [2025-09-29T02:18:19.995591] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-29T02:18:20.027250] [DEBUG] [LOCAL ] LNN: Derivative data saved (1820 records). [2025-09-29T02:18:20.027602] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-29T02:18:20.032925] [INFO ] [MAIN ] Derivative Progress: 1191/2211 symbols completed. LNN took 1.0s. Estimated remaining: 7m 11s. Rate: 142.0 symbols/min [2025-09-29T02:18:20.033318] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:20.054094] [DEBUG] [LOCAL ] LOCL: Loaded 3644 existing records from primary storage. [2025-09-29T02:18:20.055477] [DEBUG] [LOCAL ] LOAR: Loaded 42150 existing records from primary storage. [2025-09-29T02:18:20.064335] [INFO ] [MAIN ] LOAR: Loaded 42150 primary data records. [2025-09-29T02:18:20.064697] [INFO ] [MAIN ] LOCL: Loaded 3644 primary data records. [2025-09-29T02:18:20.243083] [DEBUG] [LOCAL ] LOB: Loaded 27886 existing records from primary storage. [2025-09-29T02:18:20.300444] [INFO ] [MAIN ] LOB: Loaded 27886 primary data records. [2025-09-29T02:18:21.197804] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:21.212803] [INFO ] [MAIN ] LOCL: Generated 1820 derivative records from 3644 primary records. [2025-09-29T02:18:21.213223] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:21.214371] [INFO ] [MAIN ] LOAR: Generated 1820 derivative records from 42150 primary records. [2025-09-29T02:18:21.213390] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-29T02:18:21.214878] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-29T02:18:21.249757] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1820 records). [2025-09-29T02:18:21.250980] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1820 records). [2025-09-29T02:18:21.263963] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-29T02:18:21.267507] [INFO ] [MAIN ] Derivative Progress: 1192/2211 symbols completed. LOCL took 1.2s. Estimated remaining: 7m 11s. Rate: 141.8 symbols/min [2025-09-29T02:18:21.268329] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:21.268067] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:21.269474] [INFO ] [MAIN ] LOB: Generated 1820 derivative records from 27886 primary records. [2025-09-29T02:18:21.264080] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-29T02:18:21.272662] [INFO ] [MAIN ] Derivative Progress: 1193/2211 symbols completed. LOAR took 1.3s. Estimated remaining: 7m 10s. Rate: 141.9 symbols/min [2025-09-29T02:18:21.270016] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-29T02:18:21.273533] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:21.290407] [DEBUG] [LOCAL ] LOB: Derivative data saved (1820 records). [2025-09-29T02:18:21.290530] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-29T02:18:21.294429] [INFO ] [MAIN ] Derivative Progress: 1194/2211 symbols completed. LOB took 1.3s. Estimated remaining: 7m 10s. Rate: 142.0 symbols/min [2025-09-29T02:18:21.294755] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:21.342309] [DEBUG] [LOCAL ] LOMA: Loaded 32576 existing records from primary storage. [2025-09-29T02:18:21.342791] [INFO ] [MAIN ] LOMA: Loaded 32576 primary data records. [2025-09-29T02:18:21.481085] [DEBUG] [LOCAL ] LPG: Loaded 40536 existing records from primary storage. [2025-09-29T02:18:21.513319] [INFO ] [MAIN ] LPG: Loaded 40536 primary data records. [2025-09-29T02:18:21.531189] [DEBUG] [LOCAL ] LOW: Loaded 53721 existing records from primary storage. [2025-09-29T02:18:21.571986] [INFO ] [MAIN ] LOW: Loaded 53721 primary data records. [2025-09-29T02:18:22.448340] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:22.450570] [INFO ] [MAIN ] LOMA: Generated 1820 derivative records from 32576 primary records. [2025-09-29T02:18:22.450853] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-29T02:18:22.468686] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1820 records). [2025-09-29T02:18:22.468945] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-29T02:18:22.472354] [INFO ] [MAIN ] Derivative Progress: 1195/2211 symbols completed. LOMA took 1.2s. Estimated remaining: 7m 10s. Rate: 141.8 symbols/min [2025-09-29T02:18:22.473057] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:22.495578] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:22.509402] [INFO ] [MAIN ] LPG: Generated 1820 derivative records from 40536 primary records. [2025-09-29T02:18:22.509747] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-29T02:18:22.510173] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:22.512021] [INFO ] [MAIN ] LOW: Generated 1820 derivative records from 53721 primary records. [2025-09-29T02:18:22.519605] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-29T02:18:22.561334] [DEBUG] [LOCAL ] LPL: Loaded 26305 existing records from primary storage. [2025-09-29T02:18:22.562913] [INFO ] [MAIN ] LPL: Loaded 26305 primary data records. [2025-09-29T02:18:22.562817] [DEBUG] [LOCAL ] LPG: Derivative data saved (1820 records). [2025-09-29T02:18:22.563155] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-29T02:18:22.566048] [INFO ] [MAIN ] Derivative Progress: 1196/2211 symbols completed. LPG took 1.3s. Estimated remaining: 7m 9s. Rate: 141.9 symbols/min [2025-09-29T02:18:22.562982] [DEBUG] [LOCAL ] LOW: Derivative data saved (1820 records). [2025-09-29T02:18:22.571458] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:22.615459] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-29T02:18:22.650181] [INFO ] [MAIN ] Derivative Progress: 1197/2211 symbols completed. LOW took 1.4s. Estimated remaining: 7m 8s. Rate: 142.0 symbols/min [2025-09-29T02:18:22.691511] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:22.945954] [DEBUG] [LOCAL ] LPX: Loaded 40311 existing records from primary storage. [2025-09-29T02:18:22.946226] [INFO ] [MAIN ] LPX: Loaded 40311 primary data records. [2025-09-29T02:18:23.074705] [DEBUG] [LOCAL ] LRN: Loaded 40503 existing records from primary storage. [2025-09-29T02:18:23.075620] [INFO ] [MAIN ] LRN: Loaded 40503 primary data records. [2025-09-29T02:18:23.671746] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:23.688068] [INFO ] [MAIN ] LPL: Generated 1820 derivative records from 26305 primary records. [2025-09-29T02:18:23.688945] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-29T02:18:23.708023] [DEBUG] [LOCAL ] LPL: Derivative data saved (1820 records). [2025-09-29T02:18:23.708682] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-29T02:18:23.711287] [INFO ] [MAIN ] Derivative Progress: 1198/2211 symbols completed. LPL took 1.2s. Estimated remaining: 7m 9s. Rate: 141.8 symbols/min [2025-09-29T02:18:23.733581] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:23.734414] [INFO ] [MAIN ] LPX: Generated 1820 derivative records from 40311 primary records. [2025-09-29T02:18:23.734606] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-29T02:18:23.753405] [DEBUG] [LOCAL ] LPX: Derivative data saved (1820 records). [2025-09-29T02:18:23.754325] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-29T02:18:23.757460] [INFO ] [MAIN ] Derivative Progress: 1199/2211 symbols completed. LPX took 1.2s. Estimated remaining: 7m 8s. Rate: 141.9 symbols/min [2025-09-29T02:18:23.770255] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:23.770925] [INFO ] [MAIN ] LRN: Generated 1820 derivative records from 40503 primary records. [2025-09-29T02:18:23.771008] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-29T02:18:23.787120] [DEBUG] [LOCAL ] LRN: Derivative data saved (1820 records). [2025-09-29T02:18:23.787249] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-29T02:18:23.790357] [INFO ] [MAIN ] Derivative Progress: 1200/2211 symbols completed. LRN took 1.1s. Estimated remaining: 7m 7s. Rate: 142.1 symbols/min [2025-09-29T02:18:23.790874] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:23.791021] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:23.791174] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:23.831337] [DEBUG] [LOCAL ] LTC: Loaded 30478 existing records from primary storage. [2025-09-29T02:18:23.840874] [INFO ] [MAIN ] LTC: Loaded 30478 primary data records. [2025-09-29T02:18:24.003991] [DEBUG] [LOCAL ] LSPD: Loaded 43782 existing records from primary storage. [2025-09-29T02:18:24.016639] [INFO ] [MAIN ] LSPD: Loaded 43782 primary data records. [2025-09-29T02:18:24.065530] [DEBUG] [LOCAL ] LTH: Loaded 52563 existing records from primary storage. [2025-09-29T02:18:24.149476] [INFO ] [MAIN ] LTH: Loaded 52563 primary data records. [2025-09-29T02:18:24.920408] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:24.922357] [INFO ] [MAIN ] LTC: Generated 1820 derivative records from 30478 primary records. [2025-09-29T02:18:24.922616] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-29T02:18:24.943953] [DEBUG] [LOCAL ] LTC: Derivative data saved (1820 records). [2025-09-29T02:18:24.945080] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-29T02:18:24.947607] [INFO ] [MAIN ] Derivative Progress: 1201/2211 symbols completed. LTC took 1.2s. Estimated remaining: 7m 7s. Rate: 141.8 symbols/min [2025-09-29T02:18:24.948366] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:24.963034] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:24.964614] [INFO ] [MAIN ] LSPD: Generated 1820 derivative records from 43782 primary records. [2025-09-29T02:18:24.964782] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-29T02:18:24.998910] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1820 records). [2025-09-29T02:18:24.999666] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:25.000530] [INFO ] [MAIN ] LTH: Generated 1820 derivative records from 52563 primary records. [2025-09-29T02:18:25.000704] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-29T02:18:25.000822] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-29T02:18:25.004782] [INFO ] [MAIN ] Derivative Progress: 1202/2211 symbols completed. LSPD took 1.2s. Estimated remaining: 7m 6s. Rate: 142.0 symbols/min [2025-09-29T02:18:25.005413] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:25.033911] [DEBUG] [LOCAL ] LTH: Derivative data saved (1820 records). [2025-09-29T02:18:25.034172] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-29T02:18:25.037088] [INFO ] [MAIN ] Derivative Progress: 1203/2211 symbols completed. LTH took 1.2s. Estimated remaining: 7m 6s. Rate: 142.1 symbols/min [2025-09-29T02:18:25.037524] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:25.054810] [DEBUG] [LOCAL ] LTM: Loaded 37076 existing records from primary storage. [2025-09-29T02:18:25.055304] [INFO ] [MAIN ] LTM: Loaded 37076 primary data records. [2025-09-29T02:18:25.455553] [DEBUG] [LOCAL ] LU: Loaded 49679 existing records from primary storage. [2025-09-29T02:18:25.456316] [INFO ] [MAIN ] LU: Loaded 49679 primary data records. [2025-09-29T02:18:25.484851] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-29T02:18:25.510935] [INFO ] [MAIN ] LUMN: Loaded 54414 primary data records. [2025-09-29T02:18:26.231472] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:26.233714] [INFO ] [MAIN ] LTM: Generated 1820 derivative records from 37076 primary records. [2025-09-29T02:18:26.233924] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-29T02:18:26.264543] [DEBUG] [LOCAL ] LTM: Derivative data saved (1820 records). [2025-09-29T02:18:26.266977] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-29T02:18:26.276735] [INFO ] [MAIN ] Derivative Progress: 1204/2211 symbols completed. LTM took 1.3s. Estimated remaining: 7m 6s. Rate: 141.8 symbols/min [2025-09-29T02:18:26.277477] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:26.310342] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:26.313283] [INFO ] [MAIN ] LU: Generated 1820 derivative records from 49679 primary records. [2025-09-29T02:18:26.313623] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-29T02:18:26.331101] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:26.345065] [INFO ] [MAIN ] LUMN: Generated 1820 derivative records from 54414 primary records. [2025-09-29T02:18:26.349163] [DEBUG] [LOCAL ] LU: Derivative data saved (1820 records). [2025-09-29T02:18:26.349390] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-29T02:18:26.349542] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-29T02:18:26.356503] [INFO ] [MAIN ] Derivative Progress: 1205/2211 symbols completed. LU took 1.4s. Estimated remaining: 7m 5s. Rate: 141.9 symbols/min [2025-09-29T02:18:26.358109] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:26.376282] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1820 records). [2025-09-29T02:18:26.376464] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-29T02:18:26.381768] [INFO ] [MAIN ] Derivative Progress: 1206/2211 symbols completed. LUMN took 1.3s. Estimated remaining: 7m 5s. Rate: 142.0 symbols/min [2025-09-29T02:18:26.382253] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:26.437186] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-29T02:18:26.437694] [INFO ] [MAIN ] LUV: Loaded 54469 primary data records. [2025-09-29T02:18:26.513542] [DEBUG] [LOCAL ] LVWR: Loaded 17668 existing records from primary storage. [2025-09-29T02:18:26.538278] [INFO ] [MAIN ] LVWR: Loaded 17668 primary data records. [2025-09-29T02:18:26.941617] [DEBUG] [LOCAL ] LVS: Loaded 54342 existing records from primary storage. [2025-09-29T02:18:26.953562] [INFO ] [MAIN ] LVS: Loaded 54342 primary data records. [2025-09-29T02:18:27.519768] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:27.520839] [INFO ] [MAIN ] LUV: Generated 1820 derivative records from 54469 primary records. [2025-09-29T02:18:27.521232] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-29T02:18:27.558143] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:27.560341] [DEBUG] [LOCAL ] LUV: Derivative data saved (1820 records). [2025-09-29T02:18:27.561735] [INFO ] [MAIN ] LVWR: Generated 1820 derivative records from 17668 primary records. [2025-09-29T02:18:27.562684] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-29T02:18:27.563012] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-29T02:18:27.566590] [INFO ] [MAIN ] Derivative Progress: 1207/2211 symbols completed. LUV took 1.3s. Estimated remaining: 7m 5s. Rate: 141.8 symbols/min [2025-09-29T02:18:27.567367] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:27.586606] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1820 records). [2025-09-29T02:18:27.586878] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-29T02:18:27.589540] [INFO ] [MAIN ] Derivative Progress: 1208/2211 symbols completed. LVWR took 1.2s. Estimated remaining: 7m 4s. Rate: 141.9 symbols/min [2025-09-29T02:18:27.590211] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:27.608011] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:27.609228] [INFO ] [MAIN ] LVS: Generated 1820 derivative records from 54342 primary records. [2025-09-29T02:18:27.609416] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-29T02:18:27.638024] [DEBUG] [LOCAL ] LVS: Derivative data saved (1820 records). [2025-09-29T02:18:27.638332] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-29T02:18:27.641944] [INFO ] [MAIN ] Derivative Progress: 1209/2211 symbols completed. LVS took 1.3s. Estimated remaining: 7m 3s. Rate: 142.0 symbols/min [2025-09-29T02:18:27.643014] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:27.650745] [DEBUG] [LOCAL ] LXFR: Loaded 17259 existing records from primary storage. [2025-09-29T02:18:27.650934] [INFO ] [MAIN ] LXFR: Loaded 17259 primary data records. [2025-09-29T02:18:28.010088] [DEBUG] [LOCAL ] LW: Loaded 51915 existing records from primary storage. [2025-09-29T02:18:28.071419] [INFO ] [MAIN ] LW: Loaded 51915 primary data records. [2025-09-29T02:18:28.210094] [DEBUG] [LOCAL ] LXP: Loaded 51361 existing records from primary storage. [2025-09-29T02:18:28.210856] [INFO ] [MAIN ] LXP: Loaded 51361 primary data records. [2025-09-29T02:18:28.762474] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:28.765189] [INFO ] [MAIN ] LXFR: Generated 1820 derivative records from 17259 primary records. [2025-09-29T02:18:28.766612] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-29T02:18:28.789261] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1820 records). [2025-09-29T02:18:28.789916] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-29T02:18:28.793396] [INFO ] [MAIN ] Derivative Progress: 1210/2211 symbols completed. LXFR took 1.2s. Estimated remaining: 7m 3s. Rate: 141.8 symbols/min [2025-09-29T02:18:28.794061] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:28.814839] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:28.816324] [INFO ] [MAIN ] LW: Generated 1820 derivative records from 51915 primary records. [2025-09-29T02:18:28.816557] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-29T02:18:28.861817] [DEBUG] [LOCAL ] LW: Derivative data saved (1820 records). [2025-09-29T02:18:28.860998] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:28.862751] [INFO ] [MAIN ] LXP: Generated 1820 derivative records from 51361 primary records. [2025-09-29T02:18:28.862873] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-29T02:18:28.875890] [INFO ] [MAIN ] Derivative Progress: 1211/2211 symbols completed. LW took 1.3s. Estimated remaining: 7m 3s. Rate: 141.9 symbols/min [2025-09-29T02:18:28.873322] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-29T02:18:28.876339] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:28.887243] [DEBUG] [LOCAL ] LXU: Loaded 32354 existing records from primary storage. [2025-09-29T02:18:28.891820] [INFO ] [MAIN ] LXU: Loaded 32354 primary data records. [2025-09-29T02:18:28.908002] [DEBUG] [LOCAL ] LXP: Derivative data saved (1820 records). [2025-09-29T02:18:28.936275] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-29T02:18:28.990889] [INFO ] [MAIN ] Derivative Progress: 1212/2211 symbols completed. LXP took 1.3s. Estimated remaining: 7m 2s. Rate: 142.0 symbols/min [2025-09-29T02:18:29.011314] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:29.287053] [DEBUG] [LOCAL ] LYB: Loaded 54379 existing records from primary storage. [2025-09-29T02:18:29.289030] [INFO ] [MAIN ] LYB: Loaded 54379 primary data records. [2025-09-29T02:18:29.667558] [DEBUG] [LOCAL ] LYG: Loaded 53606 existing records from primary storage. [2025-09-29T02:18:29.668579] [INFO ] [MAIN ] LYG: Loaded 53606 primary data records. [2025-09-29T02:18:29.802100] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:29.835613] [INFO ] [MAIN ] LXU: Generated 1820 derivative records from 32354 primary records. [2025-09-29T02:18:29.893975] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-29T02:18:30.101290] [DEBUG] [LOCAL ] LXU: Derivative data saved (1820 records). [2025-09-29T02:18:30.102329] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-29T02:18:30.105450] [INFO ] [MAIN ] Derivative Progress: 1213/2211 symbols completed. LXU took 1.3s. Estimated remaining: 7m 2s. Rate: 141.8 symbols/min [2025-09-29T02:18:30.120001] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:30.120728] [INFO ] [MAIN ] LYB: Generated 1820 derivative records from 54379 primary records. [2025-09-29T02:18:30.120817] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-29T02:18:30.142701] [DEBUG] [LOCAL ] LYB: Derivative data saved (1820 records). [2025-09-29T02:18:30.143235] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-29T02:18:30.147130] [INFO ] [MAIN ] Derivative Progress: 1214/2211 symbols completed. LYB took 1.3s. Estimated remaining: 7m 1s. Rate: 141.9 symbols/min [2025-09-29T02:18:30.164898] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:30.165689] [INFO ] [MAIN ] LYG: Generated 1820 derivative records from 53606 primary records. [2025-09-29T02:18:30.165774] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-29T02:18:30.181474] [DEBUG] [LOCAL ] LYG: Derivative data saved (1820 records). [2025-09-29T02:18:30.181576] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-29T02:18:30.185479] [INFO ] [MAIN ] Derivative Progress: 1215/2211 symbols completed. LYG took 1.2s. Estimated remaining: 7m 1s. Rate: 142.0 symbols/min [2025-09-29T02:18:30.186408] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:30.186495] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:30.186453] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:30.211100] [DEBUG] [LOCAL ] LZM: Loaded 13905 existing records from primary storage. [2025-09-29T02:18:30.211263] [INFO ] [MAIN ] LZM: Loaded 13905 primary data records. [2025-09-29T02:18:30.555060] [DEBUG] [LOCAL ] LZB: Loaded 36113 existing records from primary storage. [2025-09-29T02:18:30.560764] [INFO ] [MAIN ] LZB: Loaded 36113 primary data records. [2025-09-29T02:18:30.683850] [DEBUG] [LOCAL ] LYV: Loaded 51906 existing records from primary storage. [2025-09-29T02:18:30.710034] [INFO ] [MAIN ] LYV: Loaded 51906 primary data records. [2025-09-29T02:18:31.282419] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:31.283313] [INFO ] [MAIN ] LZM: Generated 1820 derivative records from 13905 primary records. [2025-09-29T02:18:31.283576] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-29T02:18:31.305117] [DEBUG] [LOCAL ] LZM: Derivative data saved (1820 records). [2025-09-29T02:18:31.305281] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-29T02:18:31.309765] [INFO ] [MAIN ] Derivative Progress: 1216/2211 symbols completed. LZM took 1.1s. Estimated remaining: 7m 1s. Rate: 141.8 symbols/min [2025-09-29T02:18:31.311667] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:31.329020] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:31.329917] [INFO ] [MAIN ] LZB: Generated 1820 derivative records from 36113 primary records. [2025-09-29T02:18:31.330194] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-29T02:18:31.351864] [DEBUG] [LOCAL ] LZB: Derivative data saved (1820 records). [2025-09-29T02:18:31.352218] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-29T02:18:31.355749] [INFO ] [MAIN ] Derivative Progress: 1217/2211 symbols completed. LZB took 1.2s. Estimated remaining: 7m 0s. Rate: 141.9 symbols/min [2025-09-29T02:18:31.373044] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:31.373501] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:31.374828] [INFO ] [MAIN ] LYV: Generated 1820 derivative records from 51906 primary records. [2025-09-29T02:18:31.375013] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-29T02:18:31.417579] [DEBUG] [LOCAL ] LYV: Derivative data saved (1820 records). [2025-09-29T02:18:31.418163] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-29T02:18:31.423386] [INFO ] [MAIN ] Derivative Progress: 1218/2211 symbols completed. LYV took 1.2s. Estimated remaining: 6m 59s. Rate: 142.0 symbols/min [2025-09-29T02:18:31.423905] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:31.453062] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-29T02:18:31.453427] [INFO ] [MAIN ] M: Loaded 54315 primary data records. [2025-09-29T02:18:31.826245] [DEBUG] [LOCAL ] MA: Loaded 53329 existing records from primary storage. [2025-09-29T02:18:31.854681] [INFO ] [MAIN ] MA: Loaded 53329 primary data records. [2025-09-29T02:18:31.879819] [DEBUG] [LOCAL ] MAA: Loaded 43354 existing records from primary storage. [2025-09-29T02:18:31.905406] [INFO ] [MAIN ] MAA: Loaded 43354 primary data records. [2025-09-29T02:18:32.615485] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:32.616466] [INFO ] [MAIN ] M: Generated 1820 derivative records from 54315 primary records. [2025-09-29T02:18:32.616572] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-29T02:18:32.638480] [DEBUG] [LOCAL ] M: Derivative data saved (1820 records). [2025-09-29T02:18:32.639789] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-29T02:18:32.642846] [INFO ] [MAIN ] Derivative Progress: 1219/2211 symbols completed. M took 1.3s. Estimated remaining: 6m 60s. Rate: 141.8 symbols/min [2025-09-29T02:18:32.643428] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:32.666524] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:32.668262] [INFO ] [MAIN ] MA: Generated 1820 derivative records from 53329 primary records. [2025-09-29T02:18:32.669251] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-29T02:18:32.688538] [DEBUG] [LOCAL ] MA: Derivative data saved (1820 records). [2025-09-29T02:18:32.690807] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-29T02:18:32.695055] [INFO ] [MAIN ] Derivative Progress: 1220/2211 symbols completed. MA took 1.3s. Estimated remaining: 6m 59s. Rate: 141.9 symbols/min [2025-09-29T02:18:32.695868] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:32.716782] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:32.718054] [INFO ] [MAIN ] MAA: Generated 1820 derivative records from 43354 primary records. [2025-09-29T02:18:32.718280] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-29T02:18:32.756289] [DEBUG] [LOCAL ] MAA: Derivative data saved (1820 records). [2025-09-29T02:18:32.756511] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-29T02:18:32.760575] [INFO ] [MAIN ] Derivative Progress: 1221/2211 symbols completed. MAA took 1.3s. Estimated remaining: 6m 58s. Rate: 142.0 symbols/min [2025-09-29T02:18:32.762203] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:32.778427] [DEBUG] [LOCAL ] MAC: Loaded 50469 existing records from primary storage. [2025-09-29T02:18:32.778819] [INFO ] [MAIN ] MAC: Loaded 50469 primary data records. [2025-09-29T02:18:32.930016] [DEBUG] [LOCAL ] MAGN: Loaded 35466 existing records from primary storage. [2025-09-29T02:18:32.974946] [INFO ] [MAIN ] MAGN: Loaded 35466 primary data records. [2025-09-29T02:18:33.272568] [DEBUG] [LOCAL ] MAIN: Loaded 41929 existing records from primary storage. [2025-09-29T02:18:33.325833] [INFO ] [MAIN ] MAIN: Loaded 41929 primary data records. [2025-09-29T02:18:33.843925] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:33.845495] [INFO ] [MAIN ] MAC: Generated 1820 derivative records from 50469 primary records. [2025-09-29T02:18:33.846002] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-29T02:18:33.869447] [DEBUG] [LOCAL ] MAC: Derivative data saved (1820 records). [2025-09-29T02:18:33.870833] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-29T02:18:33.876813] [INFO ] [MAIN ] Derivative Progress: 1222/2211 symbols completed. MAC took 1.2s. Estimated remaining: 6m 58s. Rate: 141.8 symbols/min [2025-09-29T02:18:33.877287] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:33.891279] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:33.892012] [INFO ] [MAIN ] MAGN: Generated 1820 derivative records from 35466 primary records. [2025-09-29T02:18:33.892224] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-29T02:18:33.910778] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1820 records). [2025-09-29T02:18:33.911237] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-29T02:18:33.915565] [INFO ] [MAIN ] Derivative Progress: 1223/2211 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 58s. Rate: 141.9 symbols/min [2025-09-29T02:18:33.917835] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:33.932785] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:33.933575] [INFO ] [MAIN ] MAIN: Generated 1820 derivative records from 41929 primary records. [2025-09-29T02:18:33.933695] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-29T02:18:33.962185] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1820 records). [2025-09-29T02:18:33.962549] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-29T02:18:33.965787] [INFO ] [MAIN ] Derivative Progress: 1224/2211 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 57s. Rate: 142.0 symbols/min [2025-09-29T02:18:33.966151] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:33.993447] [DEBUG] [LOCAL ] MAN: Loaded 44216 existing records from primary storage. [2025-09-29T02:18:33.993746] [INFO ] [MAIN ] MAN: Loaded 44216 primary data records. [2025-09-29T02:18:34.096369] [DEBUG] [LOCAL ] MANU: Loaded 27544 existing records from primary storage. [2025-09-29T02:18:34.121049] [INFO ] [MAIN ] MANU: Loaded 27544 primary data records. [2025-09-29T02:18:34.589548] [DEBUG] [LOCAL ] MAS: Loaded 53102 existing records from primary storage. [2025-09-29T02:18:34.627522] [INFO ] [MAIN ] MAS: Loaded 53102 primary data records. [2025-09-29T02:18:35.111109] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:35.113305] [INFO ] [MAIN ] MAN: Generated 1820 derivative records from 44216 primary records. [2025-09-29T02:18:35.113753] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-29T02:18:35.135297] [DEBUG] [LOCAL ] MAN: Derivative data saved (1820 records). [2025-09-29T02:18:35.135887] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-29T02:18:35.139151] [INFO ] [MAIN ] Derivative Progress: 1225/2211 symbols completed. MAN took 1.3s. Estimated remaining: 6m 57s. Rate: 141.8 symbols/min [2025-09-29T02:18:35.139460] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:35.154036] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:35.155177] [INFO ] [MAIN ] MANU: Generated 1820 derivative records from 27544 primary records. [2025-09-29T02:18:35.155443] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-29T02:18:35.173629] [DEBUG] [LOCAL ] MANU: Derivative data saved (1820 records). [2025-09-29T02:18:35.173820] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-29T02:18:35.177711] [INFO ] [MAIN ] Derivative Progress: 1226/2211 symbols completed. MANU took 1.3s. Estimated remaining: 6m 56s. Rate: 141.9 symbols/min [2025-09-29T02:18:35.178839] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:35.193999] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:35.195020] [INFO ] [MAIN ] MAS: Generated 1820 derivative records from 53102 primary records. [2025-09-29T02:18:35.195311] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-29T02:18:35.227344] [DEBUG] [LOCAL ] MAS: Derivative data saved (1820 records). [2025-09-29T02:18:35.228362] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-29T02:18:35.231512] [INFO ] [MAIN ] Derivative Progress: 1227/2211 symbols completed. MAS took 1.3s. Estimated remaining: 6m 56s. Rate: 142.0 symbols/min [2025-09-29T02:18:35.231829] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:35.254252] [DEBUG] [LOCAL ] MATV: Loaded 37964 existing records from primary storage. [2025-09-29T02:18:35.254424] [INFO ] [MAIN ] MATV: Loaded 37964 primary data records. [2025-09-29T02:18:35.377725] [DEBUG] [LOCAL ] MATX: Loaded 31851 existing records from primary storage. [2025-09-29T02:18:35.392219] [INFO ] [MAIN ] MATX: Loaded 31851 primary data records. [2025-09-29T02:18:35.684737] [DEBUG] [LOCAL ] MAX: Loaded 31209 existing records from primary storage. [2025-09-29T02:18:35.723206] [INFO ] [MAIN ] MAX: Loaded 31209 primary data records. [2025-09-29T02:18:36.356807] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:36.358493] [INFO ] [MAIN ] MATV: Generated 1820 derivative records from 37964 primary records. [2025-09-29T02:18:36.359182] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-29T02:18:36.384523] [DEBUG] [LOCAL ] MATV: Derivative data saved (1820 records). [2025-09-29T02:18:36.385027] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-29T02:18:36.388286] [INFO ] [MAIN ] Derivative Progress: 1228/2211 symbols completed. MATV took 1.2s. Estimated remaining: 6m 56s. Rate: 141.8 symbols/min [2025-09-29T02:18:36.403128] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:36.404141] [INFO ] [MAIN ] MATX: Generated 1820 derivative records from 31851 primary records. [2025-09-29T02:18:36.404497] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-29T02:18:36.424246] [DEBUG] [LOCAL ] MATX: Derivative data saved (1820 records). [2025-09-29T02:18:36.426423] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-29T02:18:36.430105] [INFO ] [MAIN ] Derivative Progress: 1229/2211 symbols completed. MATX took 1.3s. Estimated remaining: 6m 55s. Rate: 141.9 symbols/min [2025-09-29T02:18:36.443567] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:36.444328] [INFO ] [MAIN ] MAX: Generated 1820 derivative records from 31209 primary records. [2025-09-29T02:18:36.444417] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-29T02:18:36.461228] [DEBUG] [LOCAL ] MAX: Derivative data saved (1820 records). [2025-09-29T02:18:36.461366] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-29T02:18:36.464378] [INFO ] [MAIN ] Derivative Progress: 1230/2211 symbols completed. MAX took 1.2s. Estimated remaining: 6m 54s. Rate: 142.1 symbols/min [2025-09-29T02:18:36.465072] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:36.465024] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:36.465193] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:36.521863] [DEBUG] [LOCAL ] MBI: Loaded 24930 existing records from primary storage. [2025-09-29T02:18:36.522224] [INFO ] [MAIN ] MBI: Loaded 24930 primary data records. [2025-09-29T02:18:36.670715] [DEBUG] [LOCAL ] MBC: Loaded 43803 existing records from primary storage. [2025-09-29T02:18:36.671286] [INFO ] [MAIN ] MBC: Loaded 43803 primary data records. [2025-09-29T02:18:36.673127] [DEBUG] [LOCAL ] MC: Loaded 44878 existing records from primary storage. [2025-09-29T02:18:36.673376] [INFO ] [MAIN ] MC: Loaded 44878 primary data records. [2025-09-29T02:18:37.623375] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:37.624452] [INFO ] [MAIN ] MBI: Generated 1820 derivative records from 24930 primary records. [2025-09-29T02:18:37.624842] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-29T02:18:37.643017] [DEBUG] [LOCAL ] MBI: Derivative data saved (1820 records). [2025-09-29T02:18:37.643433] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-29T02:18:37.646248] [INFO ] [MAIN ] Derivative Progress: 1231/2211 symbols completed. MBI took 1.2s. Estimated remaining: 6m 55s. Rate: 141.8 symbols/min [2025-09-29T02:18:37.646487] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:37.667011] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:37.668040] [INFO ] [MAIN ] MBC: Generated 1820 derivative records from 43803 primary records. [2025-09-29T02:18:37.668286] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-29T02:18:37.689821] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:37.694511] [INFO ] [MAIN ] MC: Generated 1820 derivative records from 44878 primary records. [2025-09-29T02:18:37.700417] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-29T02:18:37.703105] [DEBUG] [LOCAL ] MBC: Derivative data saved (1820 records). [2025-09-29T02:18:37.703271] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-29T02:18:37.706024] [INFO ] [MAIN ] Derivative Progress: 1232/2211 symbols completed. MBC took 1.2s. Estimated remaining: 6m 54s. Rate: 141.9 symbols/min [2025-09-29T02:18:37.719544] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:37.723985] [DEBUG] [LOCAL ] MCB: Loaded 11834 existing records from primary storage. [2025-09-29T02:18:37.724904] [INFO ] [MAIN ] MCB: Loaded 11834 primary data records. [2025-09-29T02:18:37.773856] [DEBUG] [LOCAL ] MC: Derivative data saved (1820 records). [2025-09-29T02:18:37.807066] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-29T02:18:37.833417] [INFO ] [MAIN ] Derivative Progress: 1233/2211 symbols completed. MC took 1.4s. Estimated remaining: 6m 53s. Rate: 142.0 symbols/min [2025-09-29T02:18:37.856085] [DEBUG] [LOCAL ] MCI: Loaded 6477 existing records from primary storage. [2025-09-29T02:18:37.861223] [INFO ] [MAIN ] MCI: Loaded 6477 primary data records. [2025-09-29T02:18:37.861344] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:38.495372] [DEBUG] [LOCAL ] MCK: Loaded 39985 existing records from primary storage. [2025-09-29T02:18:38.498257] [INFO ] [MAIN ] MCK: Loaded 39985 primary data records. [2025-09-29T02:18:38.542671] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:38.580594] [INFO ] [MAIN ] MCB: Generated 1820 derivative records from 11834 primary records. [2025-09-29T02:18:38.635369] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-29T02:18:38.752853] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:38.753974] [DEBUG] [LOCAL ] MCB: Derivative data saved (1820 records). [2025-09-29T02:18:38.755152] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-29T02:18:38.758544] [INFO ] [MAIN ] Derivative Progress: 1234/2211 symbols completed. MCB took 1.1s. Estimated remaining: 6m 53s. Rate: 141.9 symbols/min [2025-09-29T02:18:38.760558] [INFO ] [MAIN ] MCI: Generated 1820 derivative records from 6477 primary records. [2025-09-29T02:18:38.777805] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:38.878129] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-29T02:18:38.991018] [DEBUG] [LOCAL ] MCN: Loaded 8231 existing records from primary storage. [2025-09-29T02:18:38.991249] [INFO ] [MAIN ] MCN: Loaded 8231 primary data records. [2025-09-29T02:18:38.986288] [DEBUG] [LOCAL ] MCI: Derivative data saved (1820 records). [2025-09-29T02:18:39.003529] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-29T02:18:39.060635] [INFO ] [MAIN ] Derivative Progress: 1235/2211 symbols completed. MCI took 1.3s. Estimated remaining: 6m 53s. Rate: 141.9 symbols/min [2025-09-29T02:18:39.100734] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:39.350948] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:39.352443] [INFO ] [MAIN ] MCK: Generated 1820 derivative records from 39985 primary records. [2025-09-29T02:18:39.353078] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-29T02:18:39.380894] [DEBUG] [LOCAL ] MCK: Derivative data saved (1820 records). [2025-09-29T02:18:39.381242] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-29T02:18:39.383830] [INFO ] [MAIN ] Derivative Progress: 1236/2211 symbols completed. MCK took 1.5s. Estimated remaining: 6m 52s. Rate: 141.9 symbols/min [2025-09-29T02:18:39.385663] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:39.401199] [DEBUG] [LOCAL ] MCO: Loaded 40102 existing records from primary storage. [2025-09-29T02:18:39.401916] [INFO ] [MAIN ] MCO: Loaded 40102 primary data records. [2025-09-29T02:18:39.504197] [DEBUG] [LOCAL ] MCR: Loaded 8858 existing records from primary storage. [2025-09-29T02:18:39.538531] [INFO ] [MAIN ] MCR: Loaded 8858 primary data records. [2025-09-29T02:18:39.611833] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:39.643423] [INFO ] [MAIN ] MCN: Generated 1820 derivative records from 8231 primary records. [2025-09-29T02:18:39.713553] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-29T02:18:39.989240] [DEBUG] [LOCAL ] MCN: Derivative data saved (1820 records). [2025-09-29T02:18:39.997732] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-29T02:18:40.117909] [INFO ] [MAIN ] Derivative Progress: 1237/2211 symbols completed. MCN took 1.3s. Estimated remaining: 6m 52s. Rate: 141.9 symbols/min [2025-09-29T02:18:40.129898] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:40.157774] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:18:40.159148] [INFO ] [MAIN ] MCO: Generated 1819 derivative records from 40102 primary records. [2025-09-29T02:18:40.165729] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-29T02:18:40.193475] [DEBUG] [LOCAL ] MCO: Derivative data saved (1819 records). [2025-09-29T02:18:40.193665] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-29T02:18:40.197732] [DEBUG] [LOCAL ] MCS: Loaded 21454 existing records from primary storage. [2025-09-29T02:18:40.196616] [INFO ] [MAIN ] Derivative Progress: 1238/2211 symbols completed. MCO took 1.1s. Estimated remaining: 6m 51s. Rate: 142.0 symbols/min [2025-09-29T02:18:40.198231] [INFO ] [MAIN ] MCS: Loaded 21454 primary data records. [2025-09-29T02:18:40.198104] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:40.310052] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:40.353707] [INFO ] [MAIN ] MCR: Generated 1820 derivative records from 8858 primary records. [2025-09-29T02:18:40.354057] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-29T02:18:40.411836] [DEBUG] [LOCAL ] MCR: Derivative data saved (1820 records). [2025-09-29T02:18:40.438621] [DEBUG] [LOCAL ] MCY: Loaded 25345 existing records from primary storage. [2025-09-29T02:18:40.447186] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-29T02:18:40.586802] [INFO ] [MAIN ] MCY: Loaded 25345 primary data records. [2025-09-29T02:18:40.589418] [INFO ] [MAIN ] Derivative Progress: 1239/2211 symbols completed. MCR took 1.2s. Estimated remaining: 6m 51s. Rate: 142.0 symbols/min [2025-09-29T02:18:40.629822] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:41.033156] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:41.034449] [DEBUG] [LOCAL ] MD: Loaded 39064 existing records from primary storage. [2025-09-29T02:18:41.034791] [INFO ] [MAIN ] MD: Loaded 39064 primary data records. [2025-09-29T02:18:41.048399] [INFO ] [MAIN ] MCS: Generated 1820 derivative records from 21454 primary records. [2025-09-29T02:18:41.073282] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-29T02:18:41.177132] [DEBUG] [LOCAL ] MCS: Derivative data saved (1820 records). [2025-09-29T02:18:41.178051] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-29T02:18:41.181081] [INFO ] [MAIN ] Derivative Progress: 1240/2211 symbols completed. MCS took 1.1s. Estimated remaining: 6m 51s. Rate: 141.9 symbols/min [2025-09-29T02:18:41.186925] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:41.278517] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:41.287930] [INFO ] [MAIN ] MCY: Generated 1820 derivative records from 25345 primary records. [2025-09-29T02:18:41.415633] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-29T02:18:41.433813] [DEBUG] [LOCAL ] MDST: Loaded 5688 existing records from primary storage. [2025-09-29T02:18:41.437790] [INFO ] [MAIN ] MDST: Loaded 5688 primary data records. [2025-09-29T02:18:41.463387] [DEBUG] [LOCAL ] MCY: Derivative data saved (1820 records). [2025-09-29T02:18:41.484693] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-29T02:18:41.515555] [INFO ] [MAIN ] Derivative Progress: 1241/2211 symbols completed. MCY took 1.3s. Estimated remaining: 6m 50s. Rate: 141.9 symbols/min [2025-09-29T02:18:41.571262] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:41.827562] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:41.828489] [INFO ] [MAIN ] MD: Generated 1820 derivative records from 39064 primary records. [2025-09-29T02:18:41.828585] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-29T02:18:41.861696] [DEBUG] [LOCAL ] MD: Derivative data saved (1820 records). [2025-09-29T02:18:41.862239] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-29T02:18:41.865805] [INFO ] [MAIN ] Derivative Progress: 1242/2211 symbols completed. MD took 1.2s. Estimated remaining: 6m 50s. Rate: 142.0 symbols/min [2025-09-29T02:18:41.866100] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:41.890279] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-29T02:18:41.890814] [INFO ] [MAIN ] MDT: Loaded 54458 primary data records. [2025-09-29T02:18:42.279191] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:42.278772] [DEBUG] [LOCAL ] MDU: Loaded 48643 existing records from primary storage. [2025-09-29T02:18:42.280210] [INFO ] [MAIN ] MDST: Generated 1820 derivative records from 5688 primary records. [2025-09-29T02:18:42.281179] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-29T02:18:42.280298] [INFO ] [MAIN ] MDU: Loaded 48643 primary data records. [2025-09-29T02:18:42.447003] [DEBUG] [LOCAL ] MDST: Derivative data saved (1820 records). [2025-09-29T02:18:42.506869] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-29T02:18:42.513725] [INFO ] [MAIN ] Derivative Progress: 1243/2211 symbols completed. MDST took 1.3s. Estimated remaining: 6m 49s. Rate: 141.9 symbols/min [2025-09-29T02:18:42.672746] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:42.674222] [INFO ] [MAIN ] MDT: Generated 1820 derivative records from 54458 primary records. [2025-09-29T02:18:42.674339] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-29T02:18:42.700858] [DEBUG] [LOCAL ] MDT: Derivative data saved (1820 records). [2025-09-29T02:18:42.701222] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-29T02:18:42.705232] [INFO ] [MAIN ] Derivative Progress: 1244/2211 symbols completed. MDT took 1.1s. Estimated remaining: 6m 49s. Rate: 142.0 symbols/min [2025-09-29T02:18:42.721816] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:42.722461] [INFO ] [MAIN ] MDU: Generated 1820 derivative records from 48643 primary records. [2025-09-29T02:18:42.722548] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-29T02:18:42.738588] [DEBUG] [LOCAL ] MDU: Derivative data saved (1820 records). [2025-09-29T02:18:42.738712] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-29T02:18:42.741498] [INFO ] [MAIN ] Derivative Progress: 1245/2211 symbols completed. MDU took 0.9s. Estimated remaining: 6m 48s. Rate: 142.1 symbols/min [2025-09-29T02:18:42.742118] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:42.742550] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:42.742310] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:42.766598] [DEBUG] [LOCAL ] MDV: Loaded 8733 existing records from primary storage. [2025-09-29T02:18:42.766842] [INFO ] [MAIN ] MDV: Loaded 8733 primary data records. [2025-09-29T02:18:42.833963] [DEBUG] [LOCAL ] MED: Loaded 22043 existing records from primary storage. [2025-09-29T02:18:42.863541] [INFO ] [MAIN ] MED: Loaded 22043 primary data records. [2025-09-29T02:18:42.930079] [DEBUG] [LOCAL ] MEC: Loaded 16695 existing records from primary storage. [2025-09-29T02:18:42.948083] [INFO ] [MAIN ] MEC: Loaded 16695 primary data records. [2025-09-29T02:18:43.851837] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:43.852733] [INFO ] [MAIN ] MDV: Generated 1820 derivative records from 8733 primary records. [2025-09-29T02:18:43.852946] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-29T02:18:43.873850] [DEBUG] [LOCAL ] MDV: Derivative data saved (1820 records). [2025-09-29T02:18:43.874762] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-29T02:18:43.877865] [INFO ] [MAIN ] Derivative Progress: 1246/2211 symbols completed. MDV took 1.1s. Estimated remaining: 6m 48s. Rate: 141.9 symbols/min [2025-09-29T02:18:43.887311] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:43.894992] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:43.896223] [INFO ] [MAIN ] MED: Generated 1820 derivative records from 22043 primary records. [2025-09-29T02:18:43.904570] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-29T02:18:43.911093] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:18:43.920120] [INFO ] [MAIN ] MEC: Generated 1819 derivative records from 16695 primary records. [2025-09-29T02:18:43.920264] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-29T02:18:43.929468] [DEBUG] [LOCAL ] MED: Derivative data saved (1820 records). [2025-09-29T02:18:43.929942] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-29T02:18:43.939627] [INFO ] [MAIN ] Derivative Progress: 1247/2211 symbols completed. MED took 1.2s. Estimated remaining: 6m 47s. Rate: 142.0 symbols/min [2025-09-29T02:18:43.939950] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:43.958136] [DEBUG] [LOCAL ] MEC: Derivative data saved (1819 records). [2025-09-29T02:18:43.958480] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-29T02:18:43.962417] [INFO ] [MAIN ] Derivative Progress: 1248/2211 symbols completed. MEC took 1.2s. Estimated remaining: 6m 47s. Rate: 142.1 symbols/min [2025-09-29T02:18:43.962759] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:43.982524] [DEBUG] [LOCAL ] MEG: Loaded 32426 existing records from primary storage. [2025-09-29T02:18:43.982831] [INFO ] [MAIN ] MEG: Loaded 32426 primary data records. [2025-09-29T02:18:44.087983] [DEBUG] [LOCAL ] MEGI: Loaded 20630 existing records from primary storage. [2025-09-29T02:18:44.088353] [INFO ] [MAIN ] MEGI: Loaded 20630 primary data records. [2025-09-29T02:18:44.289343] [DEBUG] [LOCAL ] MEI: Loaded 32933 existing records from primary storage. [2025-09-29T02:18:44.306725] [INFO ] [MAIN ] MEI: Loaded 32933 primary data records. [2025-09-29T02:18:45.059768] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:45.069987] [INFO ] [MAIN ] MEG: Generated 1820 derivative records from 32426 primary records. [2025-09-29T02:18:45.075833] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-29T02:18:45.076384] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:45.079190] [INFO ] [MAIN ] MEGI: Generated 1820 derivative records from 20630 primary records. [2025-09-29T02:18:45.093254] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-29T02:18:45.094800] [DEBUG] [LOCAL ] MEG: Derivative data saved (1820 records). [2025-09-29T02:18:45.096429] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-29T02:18:45.099211] [INFO ] [MAIN ] Derivative Progress: 1249/2211 symbols completed. MEG took 1.2s. Estimated remaining: 6m 47s. Rate: 141.9 symbols/min [2025-09-29T02:18:45.109433] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:45.120033] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1820 records). [2025-09-29T02:18:45.120731] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-29T02:18:45.125394] [INFO ] [MAIN ] Derivative Progress: 1250/2211 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 46s. Rate: 142.0 symbols/min [2025-09-29T02:18:45.126033] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:45.145627] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:45.146894] [INFO ] [MAIN ] MEI: Generated 1820 derivative records from 32933 primary records. [2025-09-29T02:18:45.147242] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-29T02:18:45.167796] [DEBUG] [LOCAL ] MEI: Derivative data saved (1820 records). [2025-09-29T02:18:45.168090] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-29T02:18:45.171325] [INFO ] [MAIN ] Derivative Progress: 1251/2211 symbols completed. MEI took 1.2s. Estimated remaining: 6m 45s. Rate: 142.1 symbols/min [2025-09-29T02:18:45.171701] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:45.197257] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-09-29T02:18:45.207968] [INFO ] [MAIN ] MFAN: Loaded 4331 primary data records. [2025-09-29T02:18:45.313689] [DEBUG] [LOCAL ] MET: Loaded 54089 existing records from primary storage. [2025-09-29T02:18:45.346539] [INFO ] [MAIN ] MET: Loaded 54089 primary data records. [2025-09-29T02:18:45.365500] [DEBUG] [LOCAL ] MFA: Loaded 46019 existing records from primary storage. [2025-09-29T02:18:45.470822] [INFO ] [MAIN ] MFA: Loaded 46019 primary data records. [2025-09-29T02:18:46.279467] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:46.280978] [INFO ] [MAIN ] MFAN: Generated 1820 derivative records from 4331 primary records. [2025-09-29T02:18:46.281257] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-29T02:18:46.299750] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1820 records). [2025-09-29T02:18:46.313438] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-29T02:18:46.315886] [INFO ] [MAIN ] Derivative Progress: 1252/2211 symbols completed. MFAN took 1.1s. Estimated remaining: 6m 45s. Rate: 141.9 symbols/min [2025-09-29T02:18:46.313323] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:46.316114] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:46.317982] [INFO ] [MAIN ] MET: Generated 1820 derivative records from 54089 primary records. [2025-09-29T02:18:46.318218] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-29T02:18:46.340101] [DEBUG] [LOCAL ] MFAO: Loaded 3853 existing records from primary storage. [2025-09-29T02:18:46.342422] [DEBUG] [LOCAL ] MET: Derivative data saved (1820 records). [2025-09-29T02:18:46.343297] [INFO ] [MAIN ] MFAO: Loaded 3853 primary data records. [2025-09-29T02:18:46.343524] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-29T02:18:46.399562] [INFO ] [MAIN ] Derivative Progress: 1253/2211 symbols completed. MET took 1.3s. Estimated remaining: 6m 45s. Rate: 142.0 symbols/min [2025-09-29T02:18:46.415319] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:46.430201] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:46.454210] [INFO ] [MAIN ] MFA: Generated 1820 derivative records from 46019 primary records. [2025-09-29T02:18:46.486042] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-29T02:18:46.724467] [DEBUG] [LOCAL ] MFA: Derivative data saved (1820 records). [2025-09-29T02:18:46.726988] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-29T02:18:46.732223] [INFO ] [MAIN ] Derivative Progress: 1254/2211 symbols completed. MFA took 1.6s. Estimated remaining: 6m 44s. Rate: 142.0 symbols/min [2025-09-29T02:18:46.733827] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:46.759472] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-29T02:18:46.760486] [INFO ] [MAIN ] MFAO: Generated 1817 derivative records from 3853 primary records. [2025-09-29T02:18:46.760600] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-29T02:18:46.793182] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1817 records). [2025-09-29T02:18:46.793468] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-29T02:18:46.796144] [INFO ] [MAIN ] Derivative Progress: 1255/2211 symbols completed. MFAO took 0.5s. Estimated remaining: 6m 44s. Rate: 142.1 symbols/min [2025-09-29T02:18:46.796574] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:46.834637] [DEBUG] [LOCAL ] MFC: Loaded 52000 existing records from primary storage. [2025-09-29T02:18:46.835051] [INFO ] [MAIN ] MFC: Loaded 52000 primary data records. [2025-09-29T02:18:46.901428] [DEBUG] [LOCAL ] MFM: Loaded 14390 existing records from primary storage. [2025-09-29T02:18:46.963836] [DEBUG] [LOCAL ] MFG: Loaded 49748 existing records from primary storage. [2025-09-29T02:18:46.964107] [INFO ] [MAIN ] MFM: Loaded 14390 primary data records. [2025-09-29T02:18:46.978720] [INFO ] [MAIN ] MFG: Loaded 49748 primary data records. [2025-09-29T02:18:47.982748] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:47.984258] [INFO ] [MAIN ] MFC: Generated 1820 derivative records from 52000 primary records. [2025-09-29T02:18:47.984684] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-29T02:18:48.010419] [DEBUG] [LOCAL ] MFC: Derivative data saved (1820 records). [2025-09-29T02:18:48.025109] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:48.039349] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:48.039448] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-29T02:18:48.040735] [INFO ] [MAIN ] MFG: Generated 1820 derivative records from 49748 primary records. [2025-09-29T02:18:48.042157] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-29T02:18:48.041785] [INFO ] [MAIN ] MFM: Generated 1820 derivative records from 14390 primary records. [2025-09-29T02:18:48.045341] [INFO ] [MAIN ] Derivative Progress: 1256/2211 symbols completed. MFC took 1.6s. Estimated remaining: 6m 44s. Rate: 141.9 symbols/min [2025-09-29T02:18:48.045779] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.047236] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-29T02:18:48.082587] [DEBUG] [LOCAL ] MFM: Derivative data saved (1820 records). [2025-09-29T02:18:48.077982] [DEBUG] [LOCAL ] MFG: Derivative data saved (1820 records). [2025-09-29T02:18:48.083049] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-29T02:18:48.086308] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-29T02:18:48.086154] [INFO ] [MAIN ] Derivative Progress: 1257/2211 symbols completed. MFM took 1.3s. Estimated remaining: 6m 43s. Rate: 142.0 symbols/min [2025-09-29T02:18:48.086740] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.090013] [INFO ] [MAIN ] Derivative Progress: 1258/2211 symbols completed. MFG took 1.4s. Estimated remaining: 6m 42s. Rate: 142.1 symbols/min [2025-09-29T02:18:48.094214] [DEBUG] [LOCAL ] MFSG: Loaded 5267 existing records from primary storage. [2025-09-29T02:18:48.094997] [INFO ] [MAIN ] MFSG: Loaded 5267 primary data records. [2025-09-29T02:18:48.229364] [DEBUG] [LOCAL ] MFSI: Loaded 11358 existing records from primary storage. [2025-09-29T02:18:48.255359] [INFO ] [MAIN ] MFSI: Loaded 11358 primary data records. [2025-09-29T02:18:48.787233] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7800 incomplete bins [2025-09-29T02:18:48.789305] [INFO ] [MAIN ] MFSG: Generated 1814 derivative records from 5267 primary records. [2025-09-29T02:18:48.789440] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-29T02:18:48.807369] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1814 records). [2025-09-29T02:18:48.807826] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-29T02:18:48.810155] [INFO ] [MAIN ] Derivative Progress: 1259/2211 symbols completed. MFSG took 0.8s. Estimated remaining: 6m 42s. Rate: 142.0 symbols/min [2025-09-29T02:18:48.826975] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:48.827769] [INFO ] [MAIN ] MFSI: Generated 1820 derivative records from 11358 primary records. [2025-09-29T02:18:48.827859] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-29T02:18:48.843713] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1820 records). [2025-09-29T02:18:48.843815] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-29T02:18:48.846525] [INFO ] [MAIN ] Derivative Progress: 1260/2211 symbols completed. MFSI took 0.8s. Estimated remaining: 6m 41s. Rate: 142.1 symbols/min [2025-09-29T02:18:48.847259] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.847403] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.847130] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.853254] [DEBUG] [LOCAL ] MFSV: Loaded 2514 existing records from primary storage. [2025-09-29T02:18:48.853797] [INFO ] [MAIN ] MFSV: Loaded 2514 primary data records. [2025-09-29T02:18:48.987063] [DEBUG] [LOCAL ] MG: Loaded 16832 existing records from primary storage. [2025-09-29T02:18:48.998612] [INFO ] [MAIN ] MG: Loaded 16832 primary data records. [2025-09-29T02:18:49.381539] [DEBUG] [LOCAL ] MGA: Loaded 51414 existing records from primary storage. [2025-09-29T02:18:49.433865] [INFO ] [MAIN ] MGA: Loaded 51414 primary data records. [2025-09-29T02:18:49.976875] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:18:49.978076] [INFO ] [MAIN ] MFSV: Generated 1819 derivative records from 2514 primary records. [2025-09-29T02:18:49.979050] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-29T02:18:50.001300] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1819 records). [2025-09-29T02:18:50.001879] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-29T02:18:50.018955] [INFO ] [MAIN ] Derivative Progress: 1261/2211 symbols completed. MFSV took 1.2s. Estimated remaining: 6m 42s. Rate: 141.9 symbols/min [2025-09-29T02:18:50.020516] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:50.020983] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:50.022582] [INFO ] [MAIN ] MG: Generated 1820 derivative records from 16832 primary records. [2025-09-29T02:18:50.022798] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-29T02:18:50.046072] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-29T02:18:50.045764] [DEBUG] [LOCAL ] MG: Derivative data saved (1820 records). [2025-09-29T02:18:50.046967] [INFO ] [MAIN ] MGF: Loaded 4186 primary data records. [2025-09-29T02:18:50.046843] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-29T02:18:50.062307] [INFO ] [MAIN ] Derivative Progress: 1262/2211 symbols completed. MG took 1.2s. Estimated remaining: 6m 41s. Rate: 142.0 symbols/min [2025-09-29T02:18:50.062742] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:50.202208] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:50.266503] [INFO ] [MAIN ] MGA: Generated 1820 derivative records from 51414 primary records. [2025-09-29T02:18:50.385689] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-29T02:18:50.429559] [DEBUG] [LOCAL ] MGA: Derivative data saved (1820 records). [2025-09-29T02:18:50.430546] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-29T02:18:50.434199] [INFO ] [MAIN ] Derivative Progress: 1263/2211 symbols completed. MGA took 1.6s. Estimated remaining: 6m 40s. Rate: 142.0 symbols/min [2025-09-29T02:18:50.434755] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:50.462981] [DEBUG] [LOCAL ] MGR: Loaded 5675 existing records from primary storage. [2025-09-29T02:18:50.465321] [INFO ] [MAIN ] MGR: Loaded 5675 primary data records. [2025-09-29T02:18:50.464882] [DEBUG] [LOCAL ] MGM: Loaded 54388 existing records from primary storage. [2025-09-29T02:18:50.489069] [INFO ] [MAIN ] MGM: Loaded 54388 primary data records. [2025-09-29T02:18:50.712015] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:50.738496] [INFO ] [MAIN ] MGF: Generated 1820 derivative records from 4186 primary records. [2025-09-29T02:18:50.800998] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-29T02:18:51.199328] [DEBUG] [LOCAL ] MGF: Derivative data saved (1820 records). [2025-09-29T02:18:51.200061] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-29T02:18:51.202901] [INFO ] [MAIN ] Derivative Progress: 1264/2211 symbols completed. MGF took 1.2s. Estimated remaining: 6m 40s. Rate: 142.0 symbols/min [2025-09-29T02:18:51.204276] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:51.215739] [DEBUG] [LOCAL ] MGRB: Loaded 4102 existing records from primary storage. [2025-09-29T02:18:51.217050] [INFO ] [MAIN ] MGRB: Loaded 4102 primary data records. [2025-09-29T02:18:51.402122] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:51.432331] [INFO ] [MAIN ] MGR: Generated 1820 derivative records from 5675 primary records. [2025-09-29T02:18:51.461173] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-29T02:18:51.499203] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:51.609458] [INFO ] [MAIN ] MGM: Generated 1820 derivative records from 54388 primary records. [2025-09-29T02:18:51.667974] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-29T02:18:51.789103] [DEBUG] [LOCAL ] MGR: Derivative data saved (1820 records). [2025-09-29T02:18:51.792423] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-29T02:18:51.798122] [INFO ] [MAIN ] Derivative Progress: 1265/2211 symbols completed. MGR took 1.4s. Estimated remaining: 6m 40s. Rate: 141.9 symbols/min [2025-09-29T02:18:51.834441] [DEBUG] [LOCAL ] MGM: Derivative data saved (1820 records). [2025-09-29T02:18:51.836319] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-29T02:18:51.841744] [INFO ] [MAIN ] Derivative Progress: 1266/2211 symbols completed. MGM took 1.8s. Estimated remaining: 6m 39s. Rate: 142.0 symbols/min [2025-09-29T02:18:51.842092] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:51.834727] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:51.851276] [DEBUG] [LOCAL ] MGRD: Loaded 2231 existing records from primary storage. [2025-09-29T02:18:51.867861] [INFO ] [MAIN ] MGRD: Loaded 2231 primary data records. [2025-09-29T02:18:51.910737] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:51.917173] [DEBUG] [LOCAL ] MGRE: Loaded 6684 existing records from primary storage. [2025-09-29T02:18:52.000719] [INFO ] [MAIN ] MGRE: Loaded 6684 primary data records. [2025-09-29T02:18:51.966141] [INFO ] [MAIN ] MGRB: Generated 1820 derivative records from 4102 primary records. [2025-09-29T02:18:52.081055] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-29T02:18:52.572229] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1820 records). [2025-09-29T02:18:52.572418] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-29T02:18:52.699026] [INFO ] [MAIN ] Derivative Progress: 1267/2211 symbols completed. MGRB took 1.5s. Estimated remaining: 6m 39s. Rate: 141.9 symbols/min [2025-09-29T02:18:52.700275] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:52.735797] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:52.745315] [INFO ] [MAIN ] MGRD: Generated 1820 derivative records from 2231 primary records. [2025-09-29T02:18:52.750916] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-29T02:18:52.750839] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:52.753101] [INFO ] [MAIN ] MGRE: Generated 1820 derivative records from 6684 primary records. [2025-09-29T02:18:52.753313] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-29T02:18:52.795966] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1820 records). [2025-09-29T02:18:52.797833] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-29T02:18:52.797590] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1820 records). [2025-09-29T02:18:52.800377] [INFO ] [MAIN ] Derivative Progress: 1268/2211 symbols completed. MGRD took 1.0s. Estimated remaining: 6m 39s. Rate: 142.0 symbols/min [2025-09-29T02:18:52.800891] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:52.800693] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-29T02:18:52.804298] [INFO ] [MAIN ] Derivative Progress: 1269/2211 symbols completed. MGRE took 1.0s. Estimated remaining: 6m 38s. Rate: 142.1 symbols/min [2025-09-29T02:18:52.804806] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:52.824125] [DEBUG] [LOCAL ] MGY: Loaded 53195 existing records from primary storage. [2025-09-29T02:18:52.824600] [INFO ] [MAIN ] MGY: Loaded 53195 primary data records. [2025-09-29T02:18:52.943410] [DEBUG] [LOCAL ] MHF: Loaded 8713 existing records from primary storage. [2025-09-29T02:18:52.942638] [DEBUG] [LOCAL ] MHD: Loaded 12297 existing records from primary storage. [2025-09-29T02:18:52.956237] [INFO ] [MAIN ] MHF: Loaded 8713 primary data records. [2025-09-29T02:18:52.961826] [INFO ] [MAIN ] MHD: Loaded 12297 primary data records. [2025-09-29T02:18:53.868129] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:53.869280] [INFO ] [MAIN ] MGY: Generated 1820 derivative records from 53195 primary records. [2025-09-29T02:18:53.869845] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-29T02:18:53.890321] [DEBUG] [LOCAL ] MGY: Derivative data saved (1820 records). [2025-09-29T02:18:53.900970] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-29T02:18:53.909012] [INFO ] [MAIN ] Derivative Progress: 1270/2211 symbols completed. MGY took 1.2s. Estimated remaining: 6m 38s. Rate: 141.9 symbols/min [2025-09-29T02:18:53.906506] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:53.909400] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:53.918598] [INFO ] [MAIN ] MHD: Generated 1820 derivative records from 12297 primary records. [2025-09-29T02:18:53.924012] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-29T02:18:53.924551] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:53.926221] [INFO ] [MAIN ] MHF: Generated 1820 derivative records from 8713 primary records. [2025-09-29T02:18:53.926632] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-29T02:18:53.949454] [DEBUG] [LOCAL ] MHD: Derivative data saved (1820 records). [2025-09-29T02:18:53.953546] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-29T02:18:53.956467] [INFO ] [MAIN ] Derivative Progress: 1271/2211 symbols completed. MHD took 1.2s. Estimated remaining: 6m 37s. Rate: 142.0 symbols/min [2025-09-29T02:18:53.957074] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:53.966478] [DEBUG] [LOCAL ] MHF: Derivative data saved (1820 records). [2025-09-29T02:18:53.966762] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-29T02:18:53.969668] [INFO ] [MAIN ] Derivative Progress: 1272/2211 symbols completed. MHF took 1.2s. Estimated remaining: 6m 36s. Rate: 142.1 symbols/min [2025-09-29T02:18:53.972062] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:53.987863] [DEBUG] [LOCAL ] MHN: Loaded 7867 existing records from primary storage. [2025-09-29T02:18:53.988033] [INFO ] [MAIN ] MHN: Loaded 7867 primary data records. [2025-09-29T02:18:54.126489] [DEBUG] [LOCAL ] MHK: Loaded 43076 existing records from primary storage. [2025-09-29T02:18:54.137661] [INFO ] [MAIN ] MHK: Loaded 43076 primary data records. [2025-09-29T02:18:54.319829] [DEBUG] [LOCAL ] MHO: Loaded 24650 existing records from primary storage. [2025-09-29T02:18:54.514747] [INFO ] [MAIN ] MHO: Loaded 24650 primary data records. [2025-09-29T02:18:55.116563] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:55.119898] [INFO ] [MAIN ] MHN: Generated 1820 derivative records from 7867 primary records. [2025-09-29T02:18:55.121126] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-29T02:18:55.143249] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:55.148315] [INFO ] [MAIN ] MHK: Generated 1820 derivative records from 43076 primary records. [2025-09-29T02:18:55.149055] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-29T02:18:55.168420] [DEBUG] [LOCAL ] MHK: Derivative data saved (1820 records). [2025-09-29T02:18:55.170005] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-29T02:18:55.169482] [DEBUG] [LOCAL ] MHN: Derivative data saved (1820 records). [2025-09-29T02:18:55.173808] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-29T02:18:55.173633] [INFO ] [MAIN ] Derivative Progress: 1273/2211 symbols completed. MHK took 1.3s. Estimated remaining: 6m 37s. Rate: 141.9 symbols/min [2025-09-29T02:18:55.177315] [INFO ] [MAIN ] Derivative Progress: 1274/2211 symbols completed. MHN took 1.2s. Estimated remaining: 6m 36s. Rate: 142.0 symbols/min [2025-09-29T02:18:55.196077] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:55.196878] [INFO ] [MAIN ] MHO: Generated 1820 derivative records from 24650 primary records. [2025-09-29T02:18:55.196965] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-29T02:18:55.214488] [DEBUG] [LOCAL ] MHO: Derivative data saved (1820 records). [2025-09-29T02:18:55.214623] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-29T02:18:55.217868] [INFO ] [MAIN ] Derivative Progress: 1275/2211 symbols completed. MHO took 1.2s. Estimated remaining: 6m 35s. Rate: 142.1 symbols/min [2025-09-29T02:18:55.218586] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:55.218724] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:55.218448] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:55.226964] [DEBUG] [LOCAL ] MITP: Loaded 2467 existing records from primary storage. [2025-09-29T02:18:55.227261] [INFO ] [MAIN ] MITP: Loaded 2467 primary data records. [2025-09-29T02:18:55.330243] [DEBUG] [LOCAL ] MIN: Loaded 13224 existing records from primary storage. [2025-09-29T02:18:55.356030] [INFO ] [MAIN ] MIN: Loaded 13224 primary data records. [2025-09-29T02:18:55.764634] [DEBUG] [LOCAL ] MIR: Loaded 51622 existing records from primary storage. [2025-09-29T02:18:55.783695] [INFO ] [MAIN ] MIR: Loaded 51622 primary data records. [2025-09-29T02:18:56.352278] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:18:56.354521] [INFO ] [MAIN ] MITP: Generated 1818 derivative records from 2467 primary records. [2025-09-29T02:18:56.355518] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-29T02:18:56.388002] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:56.391009] [DEBUG] [LOCAL ] MITP: Derivative data saved (1818 records). [2025-09-29T02:18:56.392180] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-29T02:18:56.391939] [INFO ] [MAIN ] MIN: Generated 1820 derivative records from 13224 primary records. [2025-09-29T02:18:56.395245] [INFO ] [MAIN ] Derivative Progress: 1276/2211 symbols completed. MITP took 1.2s. Estimated remaining: 6m 35s. Rate: 141.9 symbols/min [2025-09-29T02:18:56.396041] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:56.395723] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-29T02:18:56.414728] [DEBUG] [LOCAL ] MIN: Derivative data saved (1820 records). [2025-09-29T02:18:56.414876] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-29T02:18:56.417937] [INFO ] [MAIN ] Derivative Progress: 1277/2211 symbols completed. MIN took 1.2s. Estimated remaining: 6m 35s. Rate: 142.0 symbols/min [2025-09-29T02:18:56.418585] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:56.447719] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:56.449038] [INFO ] [MAIN ] MIR: Generated 1820 derivative records from 51622 primary records. [2025-09-29T02:18:56.449271] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-29T02:18:56.454766] [DEBUG] [LOCAL ] MIY: Loaded 6084 existing records from primary storage. [2025-09-29T02:18:56.472426] [INFO ] [MAIN ] MIY: Loaded 6084 primary data records. [2025-09-29T02:18:56.477605] [DEBUG] [LOCAL ] MITT: Loaded 23379 existing records from primary storage. [2025-09-29T02:18:56.478313] [INFO ] [MAIN ] MITT: Loaded 23379 primary data records. [2025-09-29T02:18:56.650429] [DEBUG] [LOCAL ] MIR: Derivative data saved (1820 records). [2025-09-29T02:18:56.681613] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-29T02:18:56.707053] [INFO ] [MAIN ] Derivative Progress: 1278/2211 symbols completed. MIR took 1.5s. Estimated remaining: 6m 34s. Rate: 142.1 symbols/min [2025-09-29T02:18:56.730250] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:57.224234] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:57.226486] [INFO ] [MAIN ] MITT: Generated 1820 derivative records from 23379 primary records. [2025-09-29T02:18:57.228082] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-29T02:18:57.256159] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:57.274410] [DEBUG] [LOCAL ] MITT: Derivative data saved (1820 records). [2025-09-29T02:18:57.274578] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-29T02:18:57.277543] [INFO ] [MAIN ] Derivative Progress: 1279/2211 symbols completed. MITT took 0.9s. Estimated remaining: 6m 34s. Rate: 142.0 symbols/min [2025-09-29T02:18:57.280218] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:57.278635] [INFO ] [MAIN ] MIY: Generated 1820 derivative records from 6084 primary records. [2025-09-29T02:18:57.281132] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-29T02:18:57.283829] [DEBUG] [LOCAL ] MKC: Loaded 53204 existing records from primary storage. [2025-09-29T02:18:57.299310] [INFO ] [MAIN ] MKC: Loaded 53204 primary data records. [2025-09-29T02:18:57.303906] [DEBUG] [LOCAL ] MIY: Derivative data saved (1820 records). [2025-09-29T02:18:57.304459] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-29T02:18:57.331924] [INFO ] [MAIN ] Derivative Progress: 1280/2211 symbols completed. MIY took 0.9s. Estimated remaining: 6m 33s. Rate: 142.1 symbols/min [2025-09-29T02:18:57.349097] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:57.584860] [DEBUG] [LOCAL ] MKL: Loaded 34588 existing records from primary storage. [2025-09-29T02:18:57.654576] [INFO ] [MAIN ] MKL: Loaded 34588 primary data records. [2025-09-29T02:18:57.788304] [DEBUG] [LOCAL ] MLI: Loaded 44447 existing records from primary storage. [2025-09-29T02:18:57.802520] [INFO ] [MAIN ] MLI: Loaded 44447 primary data records. [2025-09-29T02:18:58.443040] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:58.456566] [INFO ] [MAIN ] MKC: Generated 1820 derivative records from 53204 primary records. [2025-09-29T02:18:58.457208] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-29T02:18:58.496301] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:58.495465] [DEBUG] [LOCAL ] MKC: Derivative data saved (1820 records). [2025-09-29T02:18:58.498282] [INFO ] [MAIN ] MKL: Generated 1820 derivative records from 34588 primary records. [2025-09-29T02:18:58.497486] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-29T02:18:58.498389] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-29T02:18:58.502278] [INFO ] [MAIN ] Derivative Progress: 1281/2211 symbols completed. MKC took 1.8s. Estimated remaining: 6m 33s. Rate: 141.9 symbols/min [2025-09-29T02:18:58.503269] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:58.527508] [DEBUG] [LOCAL ] MKL: Derivative data saved (1820 records). [2025-09-29T02:18:58.528094] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-29T02:18:58.532407] [INFO ] [MAIN ] Derivative Progress: 1282/2211 symbols completed. MKL took 1.3s. Estimated remaining: 6m 32s. Rate: 142.0 symbols/min [2025-09-29T02:18:58.540889] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:58.547092] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:58.548373] [INFO ] [MAIN ] MLI: Generated 1820 derivative records from 44447 primary records. [2025-09-29T02:18:58.548616] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-29T02:18:58.575249] [DEBUG] [LOCAL ] MLI: Derivative data saved (1820 records). [2025-09-29T02:18:58.575541] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-29T02:18:58.578437] [INFO ] [MAIN ] Derivative Progress: 1283/2211 symbols completed. MLI took 1.2s. Estimated remaining: 6m 32s. Rate: 142.1 symbols/min [2025-09-29T02:18:58.578898] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:58.598405] [DEBUG] [LOCAL ] MLP: Loaded 3120 existing records from primary storage. [2025-09-29T02:18:58.595457] [DEBUG] [LOCAL ] MLM: Loaded 31068 existing records from primary storage. [2025-09-29T02:18:58.605800] [INFO ] [MAIN ] MLM: Loaded 31068 primary data records. [2025-09-29T02:18:58.606028] [INFO ] [MAIN ] MLP: Loaded 3120 primary data records. [2025-09-29T02:18:58.817876] [DEBUG] [LOCAL ] MLNK: Loaded 25921 existing records from primary storage. [2025-09-29T02:18:58.881730] [INFO ] [MAIN ] MLNK: Loaded 25921 primary data records. [2025-09-29T02:18:59.707458] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:59.710858] [INFO ] [MAIN ] MLM: Generated 1820 derivative records from 31068 primary records. [2025-09-29T02:18:59.712717] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-29T02:18:59.730435] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-29T02:18:59.749995] [INFO ] [MAIN ] MLP: Generated 1817 derivative records from 3120 primary records. [2025-09-29T02:18:59.750610] [DEBUG] [LOCAL ] MLM: Derivative data saved (1820 records). [2025-09-29T02:18:59.751858] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-29T02:18:59.751947] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-29T02:18:59.756739] [INFO ] [MAIN ] Derivative Progress: 1284/2211 symbols completed. MLM took 1.3s. Estimated remaining: 6m 32s. Rate: 141.9 symbols/min [2025-09-29T02:18:59.757897] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:59.774458] [DEBUG] [LOCAL ] MLP: Derivative data saved (1817 records). [2025-09-29T02:18:59.776782] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-29T02:18:59.780743] [INFO ] [MAIN ] Derivative Progress: 1285/2211 symbols completed. MLP took 1.2s. Estimated remaining: 6m 31s. Rate: 142.0 symbols/min [2025-09-29T02:18:59.781168] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:59.795351] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:59.800565] [INFO ] [MAIN ] MLNK: Generated 1820 derivative records from 25921 primary records. [2025-09-29T02:18:59.800824] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-29T02:18:59.825928] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1820 records). [2025-09-29T02:18:59.826470] [DEBUG] [LOCAL ] MLR: Loaded 12982 existing records from primary storage. [2025-09-29T02:18:59.826718] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-29T02:18:59.831471] [INFO ] [MAIN ] Derivative Progress: 1286/2211 symbols completed. MLNK took 1.3s. Estimated remaining: 6m 30s. Rate: 142.1 symbols/min [2025-09-29T02:18:59.831730] [INFO ] [MAIN ] MLR: Loaded 12982 primary data records. [2025-09-29T02:18:59.831863] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:59.996889] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-09-29T02:19:00.060052] [INFO ] [MAIN ] MMD: Loaded 11435 primary data records. [2025-09-29T02:19:00.384055] [DEBUG] [LOCAL ] MMC: Loaded 52551 existing records from primary storage. [2025-09-29T02:19:00.396544] [INFO ] [MAIN ] MMC: Loaded 52551 primary data records. [2025-09-29T02:19:01.033338] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:01.034977] [INFO ] [MAIN ] MLR: Generated 1820 derivative records from 12982 primary records. [2025-09-29T02:19:01.035550] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-29T02:19:01.055679] [DEBUG] [LOCAL ] MLR: Derivative data saved (1820 records). [2025-09-29T02:19:01.055875] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-29T02:19:01.060425] [INFO ] [MAIN ] Derivative Progress: 1287/2211 symbols completed. MLR took 1.3s. Estimated remaining: 6m 31s. Rate: 141.9 symbols/min [2025-09-29T02:19:01.062085] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:01.081702] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:01.082599] [INFO ] [MAIN ] MMD: Generated 1820 derivative records from 11435 primary records. [2025-09-29T02:19:01.082839] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-29T02:19:01.105723] [DEBUG] [LOCAL ] MMD: Derivative data saved (1820 records). [2025-09-29T02:19:01.106298] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-29T02:19:01.108786] [INFO ] [MAIN ] Derivative Progress: 1288/2211 symbols completed. MMD took 1.3s. Estimated remaining: 6m 30s. Rate: 142.0 symbols/min [2025-09-29T02:19:01.119839] [DEBUG] [LOCAL ] MMI: Loaded 15452 existing records from primary storage. [2025-09-29T02:19:01.120785] [INFO ] [MAIN ] MMI: Loaded 15452 primary data records. [2025-09-29T02:19:01.220524] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:01.249485] [INFO ] [MAIN ] MMC: Generated 1820 derivative records from 52551 primary records. [2025-09-29T02:19:01.253166] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-29T02:19:01.354307] [DEBUG] [LOCAL ] MMC: Derivative data saved (1820 records). [2025-09-29T02:19:01.480721] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-29T02:19:01.486161] [INFO ] [MAIN ] Derivative Progress: 1289/2211 symbols completed. MMC took 1.7s. Estimated remaining: 6m 30s. Rate: 142.0 symbols/min [2025-09-29T02:19:01.515097] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:01.515895] [INFO ] [MAIN ] MMI: Generated 1820 derivative records from 15452 primary records. [2025-09-29T02:19:01.515987] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-29T02:19:01.532988] [DEBUG] [LOCAL ] MMI: Derivative data saved (1820 records). [2025-09-29T02:19:01.533198] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-29T02:19:01.536418] [INFO ] [MAIN ] Derivative Progress: 1290/2211 symbols completed. MMI took 0.5s. Estimated remaining: 6m 29s. Rate: 142.1 symbols/min [2025-09-29T02:19:01.537266] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:01.537414] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:01.537128] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:01.564695] [DEBUG] [LOCAL ] MMT: Loaded 10987 existing records from primary storage. [2025-09-29T02:19:01.565116] [INFO ] [MAIN ] MMT: Loaded 10987 primary data records. [2025-09-29T02:19:01.711937] [DEBUG] [LOCAL ] MMS: Loaded 34398 existing records from primary storage. [2025-09-29T02:19:01.741767] [INFO ] [MAIN ] MMS: Loaded 34398 primary data records. [2025-09-29T02:19:02.149544] [DEBUG] [LOCAL ] MMM: Loaded 53995 existing records from primary storage. [2025-09-29T02:19:02.168578] [INFO ] [MAIN ] MMM: Loaded 53995 primary data records. [2025-09-29T02:19:02.789118] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:02.790472] [INFO ] [MAIN ] MMT: Generated 1820 derivative records from 10987 primary records. [2025-09-29T02:19:02.790877] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-29T02:19:02.809457] [DEBUG] [LOCAL ] MMT: Derivative data saved (1820 records). [2025-09-29T02:19:02.810753] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-29T02:19:02.814739] [INFO ] [MAIN ] Derivative Progress: 1291/2211 symbols completed. MMT took 1.3s. Estimated remaining: 6m 29s. Rate: 141.9 symbols/min [2025-09-29T02:19:02.815225] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:02.831006] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:02.832884] [INFO ] [MAIN ] MMS: Generated 1820 derivative records from 34398 primary records. [2025-09-29T02:19:02.833353] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-29T02:19:02.868009] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:02.873268] [INFO ] [MAIN ] MMM: Generated 1820 derivative records from 53995 primary records. [2025-09-29T02:19:02.873582] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-29T02:19:02.873415] [DEBUG] [LOCAL ] MMS: Derivative data saved (1820 records). [2025-09-29T02:19:02.874382] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-29T02:19:02.877591] [INFO ] [MAIN ] Derivative Progress: 1292/2211 symbols completed. MMS took 1.3s. Estimated remaining: 6m 28s. Rate: 142.0 symbols/min [2025-09-29T02:19:02.878082] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:02.900279] [DEBUG] [LOCAL ] MMU: Loaded 17156 existing records from primary storage. [2025-09-29T02:19:02.901420] [INFO ] [MAIN ] MMU: Loaded 17156 primary data records. [2025-09-29T02:19:02.915304] [DEBUG] [LOCAL ] MMM: Derivative data saved (1820 records). [2025-09-29T02:19:02.942315] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-29T02:19:02.953600] [INFO ] [MAIN ] Derivative Progress: 1293/2211 symbols completed. MMM took 1.4s. Estimated remaining: 6m 28s. Rate: 142.1 symbols/min [2025-09-29T02:19:02.984309] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:03.120306] [DEBUG] [LOCAL ] MNR: Loaded 24918 existing records from primary storage. [2025-09-29T02:19:03.265174] [INFO ] [MAIN ] MNR: Loaded 24918 primary data records. [2025-09-29T02:19:03.447620] [DEBUG] [LOCAL ] MNSO: Loaded 45049 existing records from primary storage. [2025-09-29T02:19:03.449059] [INFO ] [MAIN ] MNSO: Loaded 45049 primary data records. [2025-09-29T02:19:03.889839] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:04.019696] [INFO ] [MAIN ] MMU: Generated 1820 derivative records from 17156 primary records. [2025-09-29T02:19:04.020286] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-29T02:19:04.045732] [DEBUG] [LOCAL ] MMU: Derivative data saved (1820 records). [2025-09-29T02:19:04.046250] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-29T02:19:04.049399] [INFO ] [MAIN ] Derivative Progress: 1294/2211 symbols completed. MMU took 1.2s. Estimated remaining: 6m 28s. Rate: 141.9 symbols/min [2025-09-29T02:19:04.050282] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:04.073238] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:04.075056] [INFO ] [MAIN ] MNR: Generated 1820 derivative records from 24918 primary records. [2025-09-29T02:19:04.075527] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-29T02:19:04.097430] [DEBUG] [LOCAL ] MNR: Derivative data saved (1820 records). [2025-09-29T02:19:04.111297] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-29T02:19:04.111216] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:04.115206] [INFO ] [MAIN ] Derivative Progress: 1295/2211 symbols completed. MNR took 1.2s. Estimated remaining: 6m 27s. Rate: 142.0 symbols/min [2025-09-29T02:19:04.115481] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:04.112318] [INFO ] [MAIN ] MNSO: Generated 1820 derivative records from 45049 primary records. [2025-09-29T02:19:04.116149] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-29T02:19:04.146402] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1820 records). [2025-09-29T02:19:04.146905] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-29T02:19:04.150265] [INFO ] [MAIN ] Derivative Progress: 1296/2211 symbols completed. MNSO took 1.2s. Estimated remaining: 6m 26s. Rate: 142.1 symbols/min [2025-09-29T02:19:04.150725] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:04.173178] [DEBUG] [LOCAL ] MOD: Loaded 46169 existing records from primary storage. [2025-09-29T02:19:04.173694] [INFO ] [MAIN ] MOD: Loaded 46169 primary data records. [2025-09-29T02:19:04.366307] [DEBUG] [LOCAL ] MODG: Loaded 52353 existing records from primary storage. [2025-09-29T02:19:04.377040] [INFO ] [MAIN ] MODG: Loaded 52353 primary data records. [2025-09-29T02:19:04.664041] [DEBUG] [LOCAL ] MOH: Loaded 42444 existing records from primary storage. [2025-09-29T02:19:04.698755] [INFO ] [MAIN ] MOH: Loaded 42444 primary data records. [2025-09-29T02:19:05.357354] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:19:05.361110] [INFO ] [MAIN ] MOD: Generated 1819 derivative records from 46169 primary records. [2025-09-29T02:19:05.361584] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-29T02:19:05.380265] [DEBUG] [LOCAL ] MOD: Derivative data saved (1819 records). [2025-09-29T02:19:05.381593] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-29T02:19:05.384757] [INFO ] [MAIN ] Derivative Progress: 1297/2211 symbols completed. MOD took 1.3s. Estimated remaining: 6m 26s. Rate: 141.9 symbols/min [2025-09-29T02:19:05.386238] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:05.403576] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:05.405576] [INFO ] [MAIN ] MODG: Generated 1820 derivative records from 52353 primary records. [2025-09-29T02:19:05.405968] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-29T02:19:05.447098] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:05.448960] [INFO ] [MAIN ] MOH: Generated 1820 derivative records from 42444 primary records. [2025-09-29T02:19:05.447862] [DEBUG] [LOCAL ] MODG: Derivative data saved (1820 records). [2025-09-29T02:19:05.449138] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-29T02:19:05.449238] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-29T02:19:05.453758] [INFO ] [MAIN ] Derivative Progress: 1298/2211 symbols completed. MODG took 1.3s. Estimated remaining: 6m 26s. Rate: 142.0 symbols/min [2025-09-29T02:19:05.466226] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:05.470806] [DEBUG] [LOCAL ] MOH: Derivative data saved (1820 records). [2025-09-29T02:19:05.485499] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-29T02:19:05.488472] [INFO ] [MAIN ] Derivative Progress: 1299/2211 symbols completed. MOH took 1.3s. Estimated remaining: 6m 25s. Rate: 142.1 symbols/min [2025-09-29T02:19:05.488969] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:05.514554] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-09-29T02:19:05.514978] [INFO ] [MAIN ] MOS: Loaded 54284 primary data records. [2025-09-29T02:19:05.652008] [DEBUG] [LOCAL ] MOV: Loaded 22417 existing records from primary storage. [2025-09-29T02:19:05.657827] [INFO ] [MAIN ] MOV: Loaded 22417 primary data records. [2025-09-29T02:19:06.028775] [DEBUG] [LOCAL ] MP: Loaded 54444 existing records from primary storage. [2025-09-29T02:19:06.040965] [INFO ] [MAIN ] MP: Loaded 54444 primary data records. [2025-09-29T02:19:06.614989] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:06.618926] [INFO ] [MAIN ] MOS: Generated 1820 derivative records from 54284 primary records. [2025-09-29T02:19:06.620198] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-29T02:19:06.648898] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:06.652639] [INFO ] [MAIN ] MOV: Generated 1820 derivative records from 22417 primary records. [2025-09-29T02:19:06.654432] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-29T02:19:06.654289] [DEBUG] [LOCAL ] MOS: Derivative data saved (1820 records). [2025-09-29T02:19:06.656314] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-29T02:19:06.668459] [INFO ] [MAIN ] Derivative Progress: 1300/2211 symbols completed. MOS took 1.3s. Estimated remaining: 6m 25s. Rate: 141.9 symbols/min [2025-09-29T02:19:06.671889] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:06.678530] [DEBUG] [LOCAL ] MOV: Derivative data saved (1820 records). [2025-09-29T02:19:06.678910] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-29T02:19:06.681731] [INFO ] [MAIN ] Derivative Progress: 1301/2211 symbols completed. MOV took 1.2s. Estimated remaining: 6m 25s. Rate: 142.0 symbols/min [2025-09-29T02:19:06.682352] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:06.689175] [DEBUG] [LOCAL ] MPA: Loaded 5268 existing records from primary storage. [2025-09-29T02:19:06.692317] [INFO ] [MAIN ] MPA: Loaded 5268 primary data records. [2025-09-29T02:19:06.768092] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:06.779291] [INFO ] [MAIN ] MP: Generated 1820 derivative records from 54444 primary records. [2025-09-29T02:19:06.784586] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-29T02:19:06.886893] [DEBUG] [LOCAL ] MP: Derivative data saved (1820 records). [2025-09-29T02:19:06.887101] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-29T02:19:06.890610] [INFO ] [MAIN ] Derivative Progress: 1302/2211 symbols completed. MP took 1.4s. Estimated remaining: 6m 24s. Rate: 142.0 symbols/min [2025-09-29T02:19:06.899974] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:07.106778] [DEBUG] [LOCAL ] MPC: Loaded 52889 existing records from primary storage. [2025-09-29T02:19:07.107321] [INFO ] [MAIN ] MPC: Loaded 52889 primary data records. [2025-09-29T02:19:07.371611] [DEBUG] [LOCAL ] MPLX: Loaded 51491 existing records from primary storage. [2025-09-29T02:19:07.528123] [INFO ] [MAIN ] MPLX: Loaded 51491 primary data records. [2025-09-29T02:19:07.556323] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:07.582397] [INFO ] [MAIN ] MPA: Generated 1820 derivative records from 5268 primary records. [2025-09-29T02:19:07.614366] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-29T02:19:07.697407] [DEBUG] [LOCAL ] MPA: Derivative data saved (1820 records). [2025-09-29T02:19:07.697860] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-29T02:19:07.706850] [INFO ] [MAIN ] Derivative Progress: 1303/2211 symbols completed. MPA took 1.0s. Estimated remaining: 6m 24s. Rate: 141.9 symbols/min [2025-09-29T02:19:07.931259] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:07.933141] [INFO ] [MAIN ] MPC: Generated 1820 derivative records from 52889 primary records. [2025-09-29T02:19:07.933417] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-29T02:19:07.953105] [DEBUG] [LOCAL ] MPC: Derivative data saved (1820 records). [2025-09-29T02:19:07.953305] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-29T02:19:07.956987] [INFO ] [MAIN ] Derivative Progress: 1304/2211 symbols completed. MPC took 1.3s. Estimated remaining: 6m 23s. Rate: 142.0 symbols/min [2025-09-29T02:19:07.975048] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:07.975836] [INFO ] [MAIN ] MPLX: Generated 1820 derivative records from 51491 primary records. [2025-09-29T02:19:07.975926] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-29T02:19:07.991907] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1820 records). [2025-09-29T02:19:07.992008] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-29T02:19:07.995093] [INFO ] [MAIN ] Derivative Progress: 1305/2211 symbols completed. MPLX took 1.1s. Estimated remaining: 6m 23s. Rate: 142.1 symbols/min [2025-09-29T02:19:07.995628] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:07.995736] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:07.995856] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:08.007084] [DEBUG] [LOCAL ] MPX: Loaded 4213 existing records from primary storage. [2025-09-29T02:19:08.011017] [DEBUG] [LOCAL ] MPV: Loaded 5098 existing records from primary storage. [2025-09-29T02:19:08.010694] [INFO ] [MAIN ] MPX: Loaded 4213 primary data records. [2025-09-29T02:19:08.011200] [INFO ] [MAIN ] MPV: Loaded 5098 primary data records. [2025-09-29T02:19:08.709614] [DEBUG] [LOCAL ] MPW: Loaded 54275 existing records from primary storage. [2025-09-29T02:19:08.710360] [INFO ] [MAIN ] MPW: Loaded 54275 primary data records. [2025-09-29T02:19:09.101497] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:09.103764] [INFO ] [MAIN ] MPV: Generated 1820 derivative records from 5098 primary records. [2025-09-29T02:19:09.104171] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-29T02:19:09.117895] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:09.132416] [INFO ] [MAIN ] MPX: Generated 1820 derivative records from 4213 primary records. [2025-09-29T02:19:09.132890] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-29T02:19:09.138074] [DEBUG] [LOCAL ] MPV: Derivative data saved (1820 records). [2025-09-29T02:19:09.146065] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-29T02:19:09.148977] [INFO ] [MAIN ] Derivative Progress: 1306/2211 symbols completed. MPV took 1.2s. Estimated remaining: 6m 23s. Rate: 141.9 symbols/min [2025-09-29T02:19:09.155783] [DEBUG] [LOCAL ] MPX: Derivative data saved (1820 records). [2025-09-29T02:19:09.156313] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:09.157153] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-29T02:19:09.160116] [INFO ] [MAIN ] Derivative Progress: 1307/2211 symbols completed. MPX took 1.2s. Estimated remaining: 6m 22s. Rate: 142.0 symbols/min [2025-09-29T02:19:09.160482] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:09.177888] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:09.178681] [INFO ] [MAIN ] MPW: Generated 1820 derivative records from 54275 primary records. [2025-09-29T02:19:09.180973] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-29T02:19:09.203937] [DEBUG] [LOCAL ] MQT: Loaded 8523 existing records from primary storage. [2025-09-29T02:19:09.204924] [INFO ] [MAIN ] MQT: Loaded 8523 primary data records. [2025-09-29T02:19:09.254668] [DEBUG] [LOCAL ] MPW: Derivative data saved (1820 records). [2025-09-29T02:19:09.248384] [DEBUG] [LOCAL ] MQY: Loaded 16979 existing records from primary storage. [2025-09-29T02:19:09.262676] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-29T02:19:09.268345] [INFO ] [MAIN ] Derivative Progress: 1308/2211 symbols completed. MPW took 1.3s. Estimated remaining: 6m 21s. Rate: 142.1 symbols/min [2025-09-29T02:19:09.273751] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:09.291473] [INFO ] [MAIN ] MQY: Loaded 16979 primary data records. [2025-09-29T02:19:09.800055] [DEBUG] [LOCAL ] MRC: Loaded 38128 existing records from primary storage. [2025-09-29T02:19:09.916750] [INFO ] [MAIN ] MRC: Loaded 38128 primary data records. [2025-09-29T02:19:10.290179] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:10.291365] [INFO ] [MAIN ] MQT: Generated 1820 derivative records from 8523 primary records. [2025-09-29T02:19:10.291969] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-29T02:19:10.311305] [DEBUG] [LOCAL ] MQT: Derivative data saved (1820 records). [2025-09-29T02:19:10.313886] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-29T02:19:10.316454] [INFO ] [MAIN ] Derivative Progress: 1309/2211 symbols completed. MQT took 1.2s. Estimated remaining: 6m 21s. Rate: 141.9 symbols/min [2025-09-29T02:19:10.316803] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:10.332140] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:10.333478] [INFO ] [MAIN ] MQY: Generated 1820 derivative records from 16979 primary records. [2025-09-29T02:19:10.333560] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-29T02:19:10.354086] [DEBUG] [LOCAL ] MQY: Derivative data saved (1820 records). [2025-09-29T02:19:10.367218] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-29T02:19:10.367547] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:10.373329] [INFO ] [MAIN ] MRC: Generated 1820 derivative records from 38128 primary records. [2025-09-29T02:19:10.371967] [INFO ] [MAIN ] Derivative Progress: 1310/2211 symbols completed. MQY took 1.2s. Estimated remaining: 6m 21s. Rate: 142.0 symbols/min [2025-09-29T02:19:10.374191] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:10.373995] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-29T02:19:10.395734] [DEBUG] [LOCAL ] MRC: Derivative data saved (1820 records). [2025-09-29T02:19:10.396083] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-29T02:19:10.400136] [INFO ] [MAIN ] Derivative Progress: 1311/2211 symbols completed. MRC took 1.1s. Estimated remaining: 6m 20s. Rate: 142.1 symbols/min [2025-09-29T02:19:10.400454] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:10.440365] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-29T02:19:10.444493] [INFO ] [MAIN ] MRK: Loaded 54569 primary data records. [2025-09-29T02:19:10.556510] [DEBUG] [LOCAL ] MSA: Loaded 18988 existing records from primary storage. [2025-09-29T02:19:10.597493] [INFO ] [MAIN ] MSA: Loaded 18988 primary data records. [2025-09-29T02:19:10.785612] [DEBUG] [LOCAL ] MS: Loaded 54472 existing records from primary storage. [2025-09-29T02:19:10.951209] [INFO ] [MAIN ] MS: Loaded 54472 primary data records. [2025-09-29T02:19:11.544101] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:11.546319] [INFO ] [MAIN ] MRK: Generated 1820 derivative records from 54569 primary records. [2025-09-29T02:19:11.546792] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-29T02:19:11.570017] [DEBUG] [LOCAL ] MRK: Derivative data saved (1820 records). [2025-09-29T02:19:11.585104] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:11.585531] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-29T02:19:11.586502] [INFO ] [MAIN ] MSA: Generated 1820 derivative records from 18988 primary records. [2025-09-29T02:19:11.590416] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-29T02:19:11.589954] [INFO ] [MAIN ] Derivative Progress: 1312/2211 symbols completed. MRK took 1.3s. Estimated remaining: 6m 20s. Rate: 141.9 symbols/min [2025-09-29T02:19:11.591828] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:11.625247] [DEBUG] [LOCAL ] MSA: Derivative data saved (1820 records). [2025-09-29T02:19:11.630629] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:11.635317] [DEBUG] [LOCAL ] MSB: Loaded 7895 existing records from primary storage. [2025-09-29T02:19:11.636172] [INFO ] [MAIN ] MS: Generated 1820 derivative records from 54472 primary records. [2025-09-29T02:19:11.636472] [INFO ] [MAIN ] MSB: Loaded 7895 primary data records. [2025-09-29T02:19:11.636560] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-29T02:19:11.634942] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-29T02:19:11.686772] [INFO ] [MAIN ] Derivative Progress: 1313/2211 symbols completed. MSA took 1.3s. Estimated remaining: 6m 19s. Rate: 142.0 symbols/min [2025-09-29T02:19:11.739998] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:11.814152] [DEBUG] [LOCAL ] MS: Derivative data saved (1820 records). [2025-09-29T02:19:11.860830] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-29T02:19:11.910505] [INFO ] [MAIN ] Derivative Progress: 1314/2211 symbols completed. MS took 1.5s. Estimated remaining: 6m 19s. Rate: 142.1 symbols/min [2025-09-29T02:19:12.029540] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:12.072317] [DEBUG] [LOCAL ] MSD: Loaded 15775 existing records from primary storage. [2025-09-29T02:19:12.073882] [DEBUG] [LOCAL ] MSCI: Loaded 35351 existing records from primary storage. [2025-09-29T02:19:12.074157] [INFO ] [MAIN ] MSD: Loaded 15775 primary data records. [2025-09-29T02:19:12.074330] [INFO ] [MAIN ] MSCI: Loaded 35351 primary data records. [2025-09-29T02:19:12.369337] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:12.485925] [INFO ] [MAIN ] MSB: Generated 1820 derivative records from 7895 primary records. [2025-09-29T02:19:12.737871] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-29T02:19:12.759541] [DEBUG] [LOCAL ] MSB: Derivative data saved (1820 records). [2025-09-29T02:19:12.762136] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-29T02:19:12.764785] [INFO ] [MAIN ] Derivative Progress: 1315/2211 symbols completed. MSB took 1.2s. Estimated remaining: 6m 19s. Rate: 142.0 symbols/min [2025-09-29T02:19:12.765666] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:12.795026] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:12.808034] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:12.808864] [INFO ] [MAIN ] MSCI: Generated 1820 derivative records from 35351 primary records. [2025-09-29T02:19:12.809593] [INFO ] [MAIN ] MSD: Generated 1820 derivative records from 15775 primary records. [2025-09-29T02:19:12.809675] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-29T02:19:12.809791] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-29T02:19:12.839757] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1820 records). [2025-09-29T02:19:12.850324] [DEBUG] [LOCAL ] MSD: Derivative data saved (1820 records). [2025-09-29T02:19:12.850398] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-29T02:19:12.850524] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-29T02:19:12.853758] [INFO ] [MAIN ] Derivative Progress: 1316/2211 symbols completed. MSCI took 1.1s. Estimated remaining: 6m 18s. Rate: 142.0 symbols/min [2025-09-29T02:19:12.857840] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:12.857904] [INFO ] [MAIN ] Derivative Progress: 1317/2211 symbols completed. MSD took 0.8s. Estimated remaining: 6m 17s. Rate: 142.1 symbols/min [2025-09-29T02:19:12.858215] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:12.875128] [DEBUG] [LOCAL ] MSDL: Loaded 38645 existing records from primary storage. [2025-09-29T02:19:12.875488] [INFO ] [MAIN ] MSDL: Loaded 38645 primary data records. [2025-09-29T02:19:13.009413] [DEBUG] [LOCAL ] MSGS: Loaded 17318 existing records from primary storage. [2025-09-29T02:19:13.030790] [INFO ] [MAIN ] MSGS: Loaded 17318 primary data records. [2025-09-29T02:19:13.115598] [DEBUG] [LOCAL ] MSGE: Loaded 27513 existing records from primary storage. [2025-09-29T02:19:13.195053] [INFO ] [MAIN ] MSGE: Loaded 27513 primary data records. [2025-09-29T02:19:13.987066] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:13.988074] [INFO ] [MAIN ] MSDL: Generated 1820 derivative records from 38645 primary records. [2025-09-29T02:19:13.988201] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-29T02:19:14.009317] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1820 records). [2025-09-29T02:19:14.012795] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-29T02:19:14.015512] [INFO ] [MAIN ] Derivative Progress: 1318/2211 symbols completed. MSDL took 1.2s. Estimated remaining: 6m 17s. Rate: 142.0 symbols/min [2025-09-29T02:19:14.029800] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:14.030669] [INFO ] [MAIN ] MSGS: Generated 1820 derivative records from 17318 primary records. [2025-09-29T02:19:14.030870] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-29T02:19:14.050342] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1820 records). [2025-09-29T02:19:14.063422] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-29T02:19:14.063816] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:14.067968] [INFO ] [MAIN ] Derivative Progress: 1319/2211 symbols completed. MSGS took 1.2s. Estimated remaining: 6m 17s. Rate: 142.1 symbols/min [2025-09-29T02:19:14.064575] [INFO ] [MAIN ] MSGE: Generated 1820 derivative records from 27513 primary records. [2025-09-29T02:19:14.068177] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-29T02:19:14.084380] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1820 records). [2025-09-29T02:19:14.084493] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-29T02:19:14.087516] [INFO ] [MAIN ] Derivative Progress: 1320/2211 symbols completed. MSGE took 1.2s. Estimated remaining: 6m 16s. Rate: 142.2 symbols/min [2025-09-29T02:19:14.087982] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:14.088057] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:14.088122] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:14.175241] [DEBUG] [LOCAL ] MSM: Loaded 36004 existing records from primary storage. [2025-09-29T02:19:14.175745] [INFO ] [MAIN ] MSM: Loaded 36004 primary data records. [2025-09-29T02:19:14.191583] [DEBUG] [LOCAL ] MT: Loaded 51417 existing records from primary storage. [2025-09-29T02:19:14.256079] [INFO ] [MAIN ] MT: Loaded 51417 primary data records. [2025-09-29T02:19:14.273015] [DEBUG] [LOCAL ] MSI: Loaded 41128 existing records from primary storage. [2025-09-29T02:19:14.300486] [INFO ] [MAIN ] MSI: Loaded 41128 primary data records. [2025-09-29T02:19:15.214239] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:15.216225] [INFO ] [MAIN ] MSM: Generated 1820 derivative records from 36004 primary records. [2025-09-29T02:19:15.218230] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-29T02:19:15.244669] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:15.247996] [INFO ] [MAIN ] MSI: Generated 1820 derivative records from 41128 primary records. [2025-09-29T02:19:15.249110] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-29T02:19:15.250724] [DEBUG] [LOCAL ] MSM: Derivative data saved (1820 records). [2025-09-29T02:19:15.251051] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-29T02:19:15.253579] [INFO ] [MAIN ] Derivative Progress: 1321/2211 symbols completed. MSM took 1.2s. Estimated remaining: 6m 16s. Rate: 142.0 symbols/min [2025-09-29T02:19:15.265414] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:15.286715] [DEBUG] [LOCAL ] MSI: Derivative data saved (1820 records). [2025-09-29T02:19:15.287258] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-29T02:19:15.290907] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:15.290461] [INFO ] [MAIN ] Derivative Progress: 1322/2211 symbols completed. MSI took 1.2s. Estimated remaining: 6m 15s. Rate: 142.1 symbols/min [2025-09-29T02:19:15.292036] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:15.291903] [INFO ] [MAIN ] MT: Generated 1820 derivative records from 51417 primary records. [2025-09-29T02:19:15.292354] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-29T02:19:15.314183] [DEBUG] [LOCAL ] MT: Derivative data saved (1820 records). [2025-09-29T02:19:15.314385] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-29T02:19:15.318040] [INFO ] [MAIN ] Derivative Progress: 1323/2211 symbols completed. MT took 1.2s. Estimated remaining: 6m 15s. Rate: 142.2 symbols/min [2025-09-29T02:19:15.318355] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:15.360452] [DEBUG] [LOCAL ] MTD: Loaded 15342 existing records from primary storage. [2025-09-29T02:19:15.361887] [INFO ] [MAIN ] MTD: Loaded 15342 primary data records. [2025-09-29T02:19:15.362106] [DEBUG] [LOCAL ] MTAL: Loaded 37002 existing records from primary storage. [2025-09-29T02:19:15.385508] [INFO ] [MAIN ] MTAL: Loaded 37002 primary data records. [2025-09-29T02:19:15.652871] [DEBUG] [LOCAL ] MTB: Loaded 47562 existing records from primary storage. [2025-09-29T02:19:15.724748] [INFO ] [MAIN ] MTB: Loaded 47562 primary data records. [2025-09-29T02:19:16.473773] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:16.474748] [INFO ] [MAIN ] MTD: Generated 1820 derivative records from 15342 primary records. [2025-09-29T02:19:16.476238] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-29T02:19:16.509256] [DEBUG] [LOCAL ] MTD: Derivative data saved (1820 records). [2025-09-29T02:19:16.510270] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:16.511462] [INFO ] [MAIN ] MTAL: Generated 1820 derivative records from 37002 primary records. [2025-09-29T02:19:16.510616] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-29T02:19:16.514189] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-29T02:19:16.513930] [INFO ] [MAIN ] Derivative Progress: 1324/2211 symbols completed. MTD took 1.2s. Estimated remaining: 6m 15s. Rate: 142.0 symbols/min [2025-09-29T02:19:16.524274] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:16.535547] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1820 records). [2025-09-29T02:19:16.536053] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-29T02:19:16.539333] [INFO ] [MAIN ] Derivative Progress: 1325/2211 symbols completed. MTAL took 1.3s. Estimated remaining: 6m 14s. Rate: 142.1 symbols/min [2025-09-29T02:19:16.539756] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:16.559034] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:16.559919] [INFO ] [MAIN ] MTB: Generated 1820 derivative records from 47562 primary records. [2025-09-29T02:19:16.560118] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-29T02:19:16.577155] [DEBUG] [LOCAL ] MTB: Derivative data saved (1820 records). [2025-09-29T02:19:16.577668] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-29T02:19:16.581133] [INFO ] [MAIN ] Derivative Progress: 1326/2211 symbols completed. MTB took 1.3s. Estimated remaining: 6m 14s. Rate: 142.2 symbols/min [2025-09-29T02:19:16.581518] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:16.654154] [DEBUG] [LOCAL ] MTDR: Loaded 52316 existing records from primary storage. [2025-09-29T02:19:16.668831] [INFO ] [MAIN ] MTDR: Loaded 52316 primary data records. [2025-09-29T02:19:16.693299] [DEBUG] [LOCAL ] MTG: Loaded 52091 existing records from primary storage. [2025-09-29T02:19:16.733300] [INFO ] [MAIN ] MTG: Loaded 52091 primary data records. [2025-09-29T02:19:16.842415] [DEBUG] [LOCAL ] MTH: Loaded 44547 existing records from primary storage. [2025-09-29T02:19:16.913050] [INFO ] [MAIN ] MTH: Loaded 44547 primary data records. [2025-09-29T02:19:17.729190] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:17.732232] [INFO ] [MAIN ] MTDR: Generated 1820 derivative records from 52316 primary records. [2025-09-29T02:19:17.732503] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-29T02:19:17.757919] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:17.762280] [INFO ] [MAIN ] MTG: Generated 1820 derivative records from 52091 primary records. [2025-09-29T02:19:17.762813] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-29T02:19:17.783370] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1820 records). [2025-09-29T02:19:17.785378] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-29T02:19:17.789109] [INFO ] [MAIN ] Derivative Progress: 1327/2211 symbols completed. MTDR took 1.3s. Estimated remaining: 6m 14s. Rate: 142.0 symbols/min [2025-09-29T02:19:17.789293] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:17.791446] [DEBUG] [LOCAL ] MTG: Derivative data saved (1820 records). [2025-09-29T02:19:17.791572] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-29T02:19:17.795209] [INFO ] [MAIN ] Derivative Progress: 1328/2211 symbols completed. MTG took 1.3s. Estimated remaining: 6m 13s. Rate: 142.1 symbols/min [2025-09-29T02:19:17.796278] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:17.810513] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:17.811254] [INFO ] [MAIN ] MTH: Generated 1820 derivative records from 44547 primary records. [2025-09-29T02:19:17.811587] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-29T02:19:17.830253] [DEBUG] [LOCAL ] MTH: Derivative data saved (1820 records). [2025-09-29T02:19:17.830408] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-29T02:19:17.832967] [INFO ] [MAIN ] Derivative Progress: 1329/2211 symbols completed. MTH took 1.3s. Estimated remaining: 6m 12s. Rate: 142.2 symbols/min [2025-09-29T02:19:17.833322] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:17.849896] [DEBUG] [LOCAL ] MTRN: Loaded 18303 existing records from primary storage. [2025-09-29T02:19:17.850206] [INFO ] [MAIN ] MTRN: Loaded 18303 primary data records. [2025-09-29T02:19:18.053445] [DEBUG] [LOCAL ] MTN: Loaded 39607 existing records from primary storage. [2025-09-29T02:19:18.072733] [DEBUG] [LOCAL ] MTUS: Loaded 28984 existing records from primary storage. [2025-09-29T02:19:18.072814] [INFO ] [MAIN ] MTN: Loaded 39607 primary data records. [2025-09-29T02:19:18.097594] [INFO ] [MAIN ] MTUS: Loaded 28984 primary data records. [2025-09-29T02:19:18.972890] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:18.974303] [INFO ] [MAIN ] MTRN: Generated 1820 derivative records from 18303 primary records. [2025-09-29T02:19:18.975786] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-29T02:19:18.997007] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1820 records). [2025-09-29T02:19:18.998019] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-29T02:19:19.000670] [INFO ] [MAIN ] Derivative Progress: 1330/2211 symbols completed. MTRN took 1.2s. Estimated remaining: 6m 12s. Rate: 142.0 symbols/min [2025-09-29T02:19:19.001256] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:19.042079] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:19.043359] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:19.046217] [INFO ] [MAIN ] MTUS: Generated 1820 derivative records from 28984 primary records. [2025-09-29T02:19:19.046363] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-29T02:19:19.045273] [INFO ] [MAIN ] MTN: Generated 1820 derivative records from 39607 primary records. [2025-09-29T02:19:19.047272] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-29T02:19:19.093310] [DEBUG] [LOCAL ] MTN: Derivative data saved (1820 records). [2025-09-29T02:19:19.095883] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-29T02:19:19.100161] [INFO ] [MAIN ] Derivative Progress: 1331/2211 symbols completed. MTN took 1.3s. Estimated remaining: 6m 12s. Rate: 142.1 symbols/min [2025-09-29T02:19:19.101844] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1820 records). [2025-09-29T02:19:19.110874] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:19.111899] [DEBUG] [LOCAL ] MTW: Loaded 26888 existing records from primary storage. [2025-09-29T02:19:19.111097] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-29T02:19:19.116534] [INFO ] [MAIN ] MTW: Loaded 26888 primary data records. [2025-09-29T02:19:19.116409] [INFO ] [MAIN ] Derivative Progress: 1332/2211 symbols completed. MTUS took 1.3s. Estimated remaining: 6m 11s. Rate: 142.2 symbols/min [2025-09-29T02:19:19.122607] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:19.312789] [DEBUG] [LOCAL ] MTX: Loaded 23150 existing records from primary storage. [2025-09-29T02:19:19.348221] [INFO ] [MAIN ] MTX: Loaded 23150 primary data records. [2025-09-29T02:19:19.679043] [DEBUG] [LOCAL ] MTZ: Loaded 43922 existing records from primary storage. [2025-09-29T02:19:19.710686] [INFO ] [MAIN ] MTZ: Loaded 43922 primary data records. [2025-09-29T02:19:20.172623] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:20.188456] [INFO ] [MAIN ] MTW: Generated 1820 derivative records from 26888 primary records. [2025-09-29T02:19:20.189012] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-29T02:19:20.211513] [DEBUG] [LOCAL ] MTW: Derivative data saved (1820 records). [2025-09-29T02:19:20.213538] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-29T02:19:20.225577] [INFO ] [MAIN ] Derivative Progress: 1333/2211 symbols completed. MTW took 1.2s. Estimated remaining: 6m 11s. Rate: 142.0 symbols/min [2025-09-29T02:19:20.232493] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:20.233754] [INFO ] [MAIN ] MTX: Generated 1820 derivative records from 23150 primary records. [2025-09-29T02:19:20.233855] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-29T02:19:20.252004] [DEBUG] [LOCAL ] MTX: Derivative data saved (1820 records). [2025-09-29T02:19:20.252147] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-29T02:19:20.255107] [INFO ] [MAIN ] Derivative Progress: 1334/2211 symbols completed. MTX took 1.1s. Estimated remaining: 6m 10s. Rate: 142.1 symbols/min [2025-09-29T02:19:20.272782] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:20.273521] [INFO ] [MAIN ] MTZ: Generated 1820 derivative records from 43922 primary records. [2025-09-29T02:19:20.273616] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-29T02:19:20.290678] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1820 records). [2025-09-29T02:19:20.290782] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-29T02:19:20.294080] [INFO ] [MAIN ] Derivative Progress: 1335/2211 symbols completed. MTZ took 1.2s. Estimated remaining: 6m 10s. Rate: 142.2 symbols/min [2025-09-29T02:19:20.294687] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:20.294976] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:20.294803] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:20.326069] [DEBUG] [LOCAL ] MUE: Loaded 12092 existing records from primary storage. [2025-09-29T02:19:20.333260] [INFO ] [MAIN ] MUE: Loaded 12092 primary data records. [2025-09-29T02:19:20.346440] [DEBUG] [LOCAL ] MUA: Loaded 12391 existing records from primary storage. [2025-09-29T02:19:20.376416] [INFO ] [MAIN ] MUA: Loaded 12391 primary data records. [2025-09-29T02:19:20.408536] [DEBUG] [LOCAL ] MUC: Loaded 20721 existing records from primary storage. [2025-09-29T02:19:20.408718] [INFO ] [MAIN ] MUC: Loaded 20721 primary data records. [2025-09-29T02:19:21.442296] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:21.469226] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:21.470618] [INFO ] [MAIN ] MUC: Generated 1820 derivative records from 20721 primary records. [2025-09-29T02:19:21.471024] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:21.472204] [INFO ] [MAIN ] MUA: Generated 1820 derivative records from 12391 primary records. [2025-09-29T02:19:21.473380] [INFO ] [MAIN ] MUE: Generated 1820 derivative records from 12092 primary records. [2025-09-29T02:19:21.472395] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-29T02:19:21.473894] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-29T02:19:21.473582] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-29T02:19:21.509159] [DEBUG] [LOCAL ] MUC: Derivative data saved (1820 records). [2025-09-29T02:19:21.516590] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-29T02:19:21.525039] [DEBUG] [LOCAL ] MUE: Derivative data saved (1820 records). [2025-09-29T02:19:21.528567] [INFO ] [MAIN ] Derivative Progress: 1336/2211 symbols completed. MUC took 1.2s. Estimated remaining: 6m 10s. Rate: 142.0 symbols/min [2025-09-29T02:19:21.530480] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:21.530218] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-29T02:19:21.534815] [INFO ] [MAIN ] Derivative Progress: 1337/2211 symbols completed. MUE took 1.2s. Estimated remaining: 6m 9s. Rate: 142.1 symbols/min [2025-09-29T02:19:21.529869] [DEBUG] [LOCAL ] MUA: Derivative data saved (1820 records). [2025-09-29T02:19:21.535166] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:21.535829] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-29T02:19:21.539896] [INFO ] [MAIN ] Derivative Progress: 1338/2211 symbols completed. MUA took 1.2s. Estimated remaining: 6m 8s. Rate: 142.2 symbols/min [2025-09-29T02:19:21.540262] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:21.561295] [DEBUG] [LOCAL ] MUJ: Loaded 13473 existing records from primary storage. [2025-09-29T02:19:21.561678] [INFO ] [MAIN ] MUJ: Loaded 13473 primary data records. [2025-09-29T02:19:21.947500] [DEBUG] [LOCAL ] MUR: Loaded 53705 existing records from primary storage. [2025-09-29T02:19:21.948569] [INFO ] [MAIN ] MUR: Loaded 53705 primary data records. [2025-09-29T02:19:21.974831] [DEBUG] [LOCAL ] MUFG: Loaded 53341 existing records from primary storage. [2025-09-29T02:19:21.975185] [INFO ] [MAIN ] MUFG: Loaded 53341 primary data records. [2025-09-29T02:19:22.696032] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:22.699474] [INFO ] [MAIN ] MUJ: Generated 1820 derivative records from 13473 primary records. [2025-09-29T02:19:22.699688] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-29T02:19:22.729148] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1820 records). [2025-09-29T02:19:22.730105] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-29T02:19:22.734243] [INFO ] [MAIN ] Derivative Progress: 1339/2211 symbols completed. MUJ took 1.2s. Estimated remaining: 6m 8s. Rate: 142.0 symbols/min [2025-09-29T02:19:22.734721] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:22.756089] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:22.757206] [INFO ] [MAIN ] MUR: Generated 1820 derivative records from 53705 primary records. [2025-09-29T02:19:22.765901] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-29T02:19:22.772811] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:22.775122] [INFO ] [MAIN ] MUFG: Generated 1820 derivative records from 53341 primary records. [2025-09-29T02:19:22.787945] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-29T02:19:22.800287] [DEBUG] [LOCAL ] MUR: Derivative data saved (1820 records). [2025-09-29T02:19:22.800796] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-29T02:19:22.804103] [INFO ] [MAIN ] Derivative Progress: 1340/2211 symbols completed. MUR took 1.3s. Estimated remaining: 6m 8s. Rate: 142.1 symbols/min [2025-09-29T02:19:22.818958] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:22.831282] [DEBUG] [LOCAL ] MUSA: Loaded 25221 existing records from primary storage. [2025-09-29T02:19:22.830100] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1820 records). [2025-09-29T02:19:22.831612] [INFO ] [MAIN ] MUSA: Loaded 25221 primary data records. [2025-09-29T02:19:22.831853] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-29T02:19:22.841355] [INFO ] [MAIN ] Derivative Progress: 1341/2211 symbols completed. MUFG took 1.3s. Estimated remaining: 6m 7s. Rate: 142.2 symbols/min [2025-09-29T02:19:22.849188] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:22.983044] [DEBUG] [LOCAL ] MVF: Loaded 12921 existing records from primary storage. [2025-09-29T02:19:23.010478] [INFO ] [MAIN ] MVF: Loaded 12921 primary data records. [2025-09-29T02:19:23.322054] [DEBUG] [LOCAL ] MUX: Loaded 43253 existing records from primary storage. [2025-09-29T02:19:23.328554] [INFO ] [MAIN ] MUX: Loaded 43253 primary data records. [2025-09-29T02:19:23.903916] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:23.905411] [INFO ] [MAIN ] MUSA: Generated 1820 derivative records from 25221 primary records. [2025-09-29T02:19:23.905748] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-29T02:19:23.931225] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1820 records). [2025-09-29T02:19:23.945818] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-29T02:19:23.945757] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:23.948880] [INFO ] [MAIN ] Derivative Progress: 1342/2211 symbols completed. MUSA took 1.2s. Estimated remaining: 6m 7s. Rate: 142.0 symbols/min [2025-09-29T02:19:23.950102] [INFO ] [MAIN ] MVF: Generated 1820 derivative records from 12921 primary records. [2025-09-29T02:19:23.950464] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-29T02:19:23.950354] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:23.975265] [DEBUG] [LOCAL ] MVF: Derivative data saved (1820 records). [2025-09-29T02:19:23.975694] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-29T02:19:23.992670] [INFO ] [MAIN ] Derivative Progress: 1343/2211 symbols completed. MVF took 1.1s. Estimated remaining: 6m 6s. Rate: 142.1 symbols/min [2025-09-29T02:19:23.997371] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:23.997636] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:23.999639] [DEBUG] [LOCAL ] MVO: Loaded 9140 existing records from primary storage. [2025-09-29T02:19:23.998893] [INFO ] [MAIN ] MUX: Generated 1820 derivative records from 43253 primary records. [2025-09-29T02:19:24.000045] [INFO ] [MAIN ] MVO: Loaded 9140 primary data records. [2025-09-29T02:19:24.000363] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-29T02:19:24.140669] [DEBUG] [LOCAL ] MUX: Derivative data saved (1820 records). [2025-09-29T02:19:24.139532] [DEBUG] [LOCAL ] MVT: Loaded 10355 existing records from primary storage. [2025-09-29T02:19:24.141638] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-29T02:19:24.141172] [INFO ] [MAIN ] MVT: Loaded 10355 primary data records. [2025-09-29T02:19:24.161256] [INFO ] [MAIN ] Derivative Progress: 1344/2211 symbols completed. MUX took 1.3s. Estimated remaining: 6m 6s. Rate: 142.2 symbols/min [2025-09-29T02:19:24.242873] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:24.769139] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:24.786307] [INFO ] [MAIN ] MVO: Generated 1820 derivative records from 9140 primary records. [2025-09-29T02:19:24.787390] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-29T02:19:24.790567] [DEBUG] [LOCAL ] MWA: Loaded 47633 existing records from primary storage. [2025-09-29T02:19:24.803259] [INFO ] [MAIN ] MWA: Loaded 47633 primary data records. [2025-09-29T02:19:24.844414] [DEBUG] [LOCAL ] MVO: Derivative data saved (1820 records). [2025-09-29T02:19:24.881273] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-29T02:19:24.897740] [INFO ] [MAIN ] Derivative Progress: 1345/2211 symbols completed. MVO took 0.9s. Estimated remaining: 6m 6s. Rate: 142.1 symbols/min [2025-09-29T02:19:24.924677] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:25.162009] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:25.162943] [INFO ] [MAIN ] MVT: Generated 1820 derivative records from 10355 primary records. [2025-09-29T02:19:25.163239] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-29T02:19:25.190940] [DEBUG] [LOCAL ] MVT: Derivative data saved (1820 records). [2025-09-29T02:19:25.190476] [DEBUG] [LOCAL ] MX: Loaded 23379 existing records from primary storage. [2025-09-29T02:19:25.192184] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-29T02:19:25.192061] [INFO ] [MAIN ] MX: Loaded 23379 primary data records. [2025-09-29T02:19:25.195315] [INFO ] [MAIN ] Derivative Progress: 1346/2211 symbols completed. MVT took 1.2s. Estimated remaining: 6m 5s. Rate: 142.1 symbols/min [2025-09-29T02:19:25.195676] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:25.317724] [DEBUG] [LOCAL ] MXF: Loaded 5984 existing records from primary storage. [2025-09-29T02:19:25.318501] [INFO ] [MAIN ] MXF: Loaded 5984 primary data records. [2025-09-29T02:19:25.736842] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:25.760628] [INFO ] [MAIN ] MWA: Generated 1820 derivative records from 47633 primary records. [2025-09-29T02:19:25.765043] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-29T02:19:25.916912] [DEBUG] [LOCAL ] MWA: Derivative data saved (1820 records). [2025-09-29T02:19:25.917319] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-29T02:19:25.919894] [INFO ] [MAIN ] Derivative Progress: 1347/2211 symbols completed. MWA took 1.7s. Estimated remaining: 6m 5s. Rate: 142.0 symbols/min [2025-09-29T02:19:25.920402] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:25.940144] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:25.941493] [INFO ] [MAIN ] MX: Generated 1820 derivative records from 23379 primary records. [2025-09-29T02:19:25.941779] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-29T02:19:25.970526] [DEBUG] [LOCAL ] MX: Derivative data saved (1820 records). [2025-09-29T02:19:25.973603] [DEBUG] [LOCAL ] MYD: Loaded 13946 existing records from primary storage. [2025-09-29T02:19:25.973930] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-29T02:19:25.979462] [INFO ] [MAIN ] Derivative Progress: 1348/2211 symbols completed. MX took 1.1s. Estimated remaining: 6m 4s. Rate: 142.1 symbols/min [2025-09-29T02:19:25.979768] [INFO ] [MAIN ] MYD: Loaded 13946 primary data records. [2025-09-29T02:19:26.056568] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:26.086999] [INFO ] [MAIN ] MXF: Generated 1820 derivative records from 5984 primary records. [2025-09-29T02:19:26.119980] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-29T02:19:26.192019] [DEBUG] [LOCAL ] MXF: Derivative data saved (1820 records). [2025-09-29T02:19:26.202551] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-29T02:19:26.205430] [INFO ] [MAIN ] Derivative Progress: 1349/2211 symbols completed. MXF took 1.0s. Estimated remaining: 6m 4s. Rate: 142.2 symbols/min [2025-09-29T02:19:26.379425] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:26.380198] [INFO ] [MAIN ] MYD: Generated 1820 derivative records from 13946 primary records. [2025-09-29T02:19:26.380286] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-29T02:19:26.396123] [DEBUG] [LOCAL ] MYD: Derivative data saved (1820 records). [2025-09-29T02:19:26.396220] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-29T02:19:26.398815] [INFO ] [MAIN ] Derivative Progress: 1350/2211 symbols completed. MYD took 0.5s. Estimated remaining: 6m 3s. Rate: 142.2 symbols/min [2025-09-29T02:19:26.399469] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:26.399713] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:26.400134] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:26.424492] [DEBUG] [LOCAL ] MYN: Loaded 10324 existing records from primary storage. [2025-09-29T02:19:26.424864] [INFO ] [MAIN ] MYN: Loaded 10324 primary data records. [2025-09-29T02:19:26.463921] [DEBUG] [LOCAL ] MYI: Loaded 19636 existing records from primary storage. [2025-09-29T02:19:26.501824] [INFO ] [MAIN ] MYI: Loaded 19636 primary data records. [2025-09-29T02:19:26.568985] [DEBUG] [LOCAL ] MYE: Loaded 25346 existing records from primary storage. [2025-09-29T02:19:26.599979] [INFO ] [MAIN ] MYE: Loaded 25346 primary data records. [2025-09-29T02:19:27.505423] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:27.507634] [INFO ] [MAIN ] MYN: Generated 1820 derivative records from 10324 primary records. [2025-09-29T02:19:27.508429] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-29T02:19:27.539098] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:27.541623] [INFO ] [MAIN ] MYI: Generated 1820 derivative records from 19636 primary records. [2025-09-29T02:19:27.544075] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-29T02:19:27.548371] [DEBUG] [LOCAL ] MYN: Derivative data saved (1820 records). [2025-09-29T02:19:27.549106] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-29T02:19:27.560544] [INFO ] [MAIN ] Derivative Progress: 1351/2211 symbols completed. MYN took 1.2s. Estimated remaining: 6m 3s. Rate: 142.1 symbols/min [2025-09-29T02:19:27.584305] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:27.587257] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:27.591185] [INFO ] [MAIN ] MYE: Generated 1820 derivative records from 25346 primary records. [2025-09-29T02:19:27.593083] [DEBUG] [LOCAL ] MYI: Derivative data saved (1820 records). [2025-09-29T02:19:27.593374] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-29T02:19:27.594077] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-29T02:19:27.598528] [INFO ] [MAIN ] Derivative Progress: 1352/2211 symbols completed. MYI took 1.2s. Estimated remaining: 6m 3s. Rate: 142.2 symbols/min [2025-09-29T02:19:27.599707] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:27.625885] [DEBUG] [LOCAL ] MYE: Derivative data saved (1820 records). [2025-09-29T02:19:27.626255] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-29T02:19:27.630592] [INFO ] [MAIN ] Derivative Progress: 1353/2211 symbols completed. MYE took 1.2s. Estimated remaining: 6m 2s. Rate: 142.2 symbols/min [2025-09-29T02:19:27.631052] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:27.674992] [DEBUG] [LOCAL ] NAC: Loaded 25076 existing records from primary storage. [2025-09-29T02:19:27.687829] [INFO ] [MAIN ] NAC: Loaded 25076 primary data records. [2025-09-29T02:19:27.733461] [DEBUG] [LOCAL ] NABL: Loaded 40294 existing records from primary storage. [2025-09-29T02:19:27.812506] [INFO ] [MAIN ] NABL: Loaded 40294 primary data records. [2025-09-29T02:19:27.834267] [DEBUG] [LOCAL ] NAD: Loaded 34318 existing records from primary storage. [2025-09-29T02:19:27.852414] [INFO ] [MAIN ] NAD: Loaded 34318 primary data records. [2025-09-29T02:19:28.779256] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:28.780458] [INFO ] [MAIN ] NAC: Generated 1820 derivative records from 25076 primary records. [2025-09-29T02:19:28.781912] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-29T02:19:28.801404] [DEBUG] [LOCAL ] NAC: Derivative data saved (1820 records). [2025-09-29T02:19:28.801801] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-29T02:19:28.805076] [INFO ] [MAIN ] Derivative Progress: 1354/2211 symbols completed. NAC took 1.2s. Estimated remaining: 6m 2s. Rate: 142.1 symbols/min [2025-09-29T02:19:28.805802] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:28.841327] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:28.842309] [INFO ] [MAIN ] NAD: Generated 1820 derivative records from 34318 primary records. [2025-09-29T02:19:28.842427] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-29T02:19:28.842830] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:28.844119] [INFO ] [MAIN ] NABL: Generated 1820 derivative records from 40294 primary records. [2025-09-29T02:19:28.849189] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-29T02:19:28.849495] [DEBUG] [LOCAL ] NAN: Loaded 9084 existing records from primary storage. [2025-09-29T02:19:28.872200] [INFO ] [MAIN ] NAN: Loaded 9084 primary data records. [2025-09-29T02:19:28.878996] [DEBUG] [LOCAL ] NAD: Derivative data saved (1820 records). [2025-09-29T02:19:28.918148] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-29T02:19:28.949926] [INFO ] [MAIN ] Derivative Progress: 1355/2211 symbols completed. NAD took 1.3s. Estimated remaining: 6m 1s. Rate: 142.1 symbols/min [2025-09-29T02:19:28.950018] [DEBUG] [LOCAL ] NABL: Derivative data saved (1820 records). [2025-09-29T02:19:28.967114] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:28.967763] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-29T02:19:28.970855] [INFO ] [MAIN ] Derivative Progress: 1356/2211 symbols completed. NABL took 1.4s. Estimated remaining: 6m 1s. Rate: 142.2 symbols/min [2025-09-29T02:19:28.971055] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:29.293528] [DEBUG] [LOCAL ] NATL: Loaded 33367 existing records from primary storage. [2025-09-29T02:19:29.294802] [INFO ] [MAIN ] NATL: Loaded 33367 primary data records. [2025-09-29T02:19:29.438448] [DEBUG] [LOCAL ] NAT: Loaded 49859 existing records from primary storage. [2025-09-29T02:19:29.450438] [INFO ] [MAIN ] NAT: Loaded 49859 primary data records. [2025-09-29T02:19:29.844038] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:29.888092] [INFO ] [MAIN ] NAN: Generated 1820 derivative records from 9084 primary records. [2025-09-29T02:19:30.018368] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-29T02:19:30.039912] [DEBUG] [LOCAL ] NAN: Derivative data saved (1820 records). [2025-09-29T02:19:30.040547] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-29T02:19:30.043524] [INFO ] [MAIN ] Derivative Progress: 1357/2211 symbols completed. NAN took 1.2s. Estimated remaining: 6m 1s. Rate: 142.1 symbols/min [2025-09-29T02:19:30.044001] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:30.052485] [DEBUG] [LOCAL ] NAZ: Loaded 2703 existing records from primary storage. [2025-09-29T02:19:30.052979] [INFO ] [MAIN ] NAZ: Loaded 2703 primary data records. [2025-09-29T02:19:30.203074] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:30.229319] [INFO ] [MAIN ] NATL: Generated 1820 derivative records from 33367 primary records. [2025-09-29T02:19:30.383314] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-29T02:19:30.439253] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:30.438238] [DEBUG] [LOCAL ] NATL: Derivative data saved (1820 records). [2025-09-29T02:19:30.439773] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-29T02:19:30.440512] [INFO ] [MAIN ] NAT: Generated 1820 derivative records from 49859 primary records. [2025-09-29T02:19:30.443824] [INFO ] [MAIN ] Derivative Progress: 1358/2211 symbols completed. NATL took 1.5s. Estimated remaining: 6m 0s. Rate: 142.1 symbols/min [2025-09-29T02:19:30.444262] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:30.444564] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-29T02:19:30.466636] [DEBUG] [LOCAL ] NAT: Derivative data saved (1820 records). [2025-09-29T02:19:30.466846] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-29T02:19:30.470523] [INFO ] [MAIN ] Derivative Progress: 1359/2211 symbols completed. NAT took 1.5s. Estimated remaining: 5m 60s. Rate: 142.2 symbols/min [2025-09-29T02:19:30.477171] [DEBUG] [LOCAL ] NBB: Loaded 8967 existing records from primary storage. [2025-09-29T02:19:30.478039] [INFO ] [MAIN ] NBB: Loaded 8967 primary data records. [2025-09-29T02:19:30.477365] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:30.652515] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:30.677399] [INFO ] [MAIN ] NAZ: Generated 1820 derivative records from 2703 primary records. [2025-09-29T02:19:30.688235] [DEBUG] [LOCAL ] NBHC: Loaded 23530 existing records from primary storage. [2025-09-29T02:19:30.688411] [INFO ] [MAIN ] NBHC: Loaded 23530 primary data records. [2025-09-29T02:19:30.706039] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-29T02:19:30.971210] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1820 records). [2025-09-29T02:19:30.993733] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-29T02:19:30.996735] [INFO ] [MAIN ] Derivative Progress: 1360/2211 symbols completed. NAZ took 1.0s. Estimated remaining: 5m 59s. Rate: 142.1 symbols/min [2025-09-29T02:19:31.002420] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:31.288838] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:31.289716] [INFO ] [MAIN ] NBB: Generated 1820 derivative records from 8967 primary records. [2025-09-29T02:19:31.290777] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-29T02:19:31.304498] [DEBUG] [LOCAL ] NBR: Loaded 35286 existing records from primary storage. [2025-09-29T02:19:31.305367] [INFO ] [MAIN ] NBR: Loaded 35286 primary data records. [2025-09-29T02:19:31.362832] [DEBUG] [LOCAL ] NBB: Derivative data saved (1820 records). [2025-09-29T02:19:31.427627] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-29T02:19:31.434967] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:31.470726] [INFO ] [MAIN ] NBHC: Generated 1820 derivative records from 23530 primary records. [2025-09-29T02:19:31.473255] [INFO ] [MAIN ] Derivative Progress: 1361/2211 symbols completed. NBB took 1.0s. Estimated remaining: 5m 59s. Rate: 142.1 symbols/min [2025-09-29T02:19:31.473481] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-29T02:19:31.538401] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:31.706874] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1820 records). [2025-09-29T02:19:31.707090] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-29T02:19:31.709861] [INFO ] [MAIN ] Derivative Progress: 1362/2211 symbols completed. NBHC took 1.2s. Estimated remaining: 5m 58s. Rate: 142.2 symbols/min [2025-09-29T02:19:31.710337] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:31.717331] [DEBUG] [LOCAL ] NC: Loaded 1933 existing records from primary storage. [2025-09-29T02:19:31.717590] [INFO ] [MAIN ] NC: Loaded 1933 primary data records. [2025-09-29T02:19:31.863535] [DEBUG] [LOCAL ] NBXG: Loaded 22794 existing records from primary storage. [2025-09-29T02:19:31.904919] [INFO ] [MAIN ] NBXG: Loaded 22794 primary data records. [2025-09-29T02:19:32.401736] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:32.403317] [INFO ] [MAIN ] NBR: Generated 1820 derivative records from 35286 primary records. [2025-09-29T02:19:32.404086] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-29T02:19:32.436281] [DEBUG] [LOCAL ] NBR: Derivative data saved (1820 records). [2025-09-29T02:19:32.437089] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-29T02:19:32.454550] [INFO ] [MAIN ] Derivative Progress: 1363/2211 symbols completed. NBR took 1.5s. Estimated remaining: 5m 58s. Rate: 142.1 symbols/min [2025-09-29T02:19:32.456813] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:32.457751] [INFO ] [MAIN ] NC: Generated 1820 derivative records from 1933 primary records. [2025-09-29T02:19:32.458107] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-29T02:19:32.474790] [DEBUG] [LOCAL ] NC: Derivative data saved (1820 records). [2025-09-29T02:19:32.475325] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-29T02:19:32.478016] [INFO ] [MAIN ] Derivative Progress: 1364/2211 symbols completed. NC took 0.8s. Estimated remaining: 5m 57s. Rate: 142.2 symbols/min [2025-09-29T02:19:32.494473] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:32.495272] [INFO ] [MAIN ] NBXG: Generated 1820 derivative records from 22794 primary records. [2025-09-29T02:19:32.495362] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-29T02:19:32.512476] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1820 records). [2025-09-29T02:19:32.512682] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-29T02:19:32.516307] [INFO ] [MAIN ] Derivative Progress: 1365/2211 symbols completed. NBXG took 1.0s. Estimated remaining: 5m 57s. Rate: 142.3 symbols/min [2025-09-29T02:19:32.516959] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:32.517094] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:32.517149] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:32.547031] [DEBUG] [LOCAL ] NCA: Loaded 10178 existing records from primary storage. [2025-09-29T02:19:32.547250] [INFO ] [MAIN ] NCA: Loaded 10178 primary data records. [2025-09-29T02:19:32.641033] [DEBUG] [LOCAL ] NCDL: Loaded 21828 existing records from primary storage. [2025-09-29T02:19:32.701075] [INFO ] [MAIN ] NCDL: Loaded 21828 primary data records. [2025-09-29T02:19:32.923495] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-29T02:19:33.049223] [INFO ] [MAIN ] NCLH: Loaded 54533 primary data records. [2025-09-29T02:19:33.690871] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:33.692178] [INFO ] [MAIN ] NCA: Generated 1820 derivative records from 10178 primary records. [2025-09-29T02:19:33.692470] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-29T02:19:33.711316] [DEBUG] [LOCAL ] NCA: Derivative data saved (1820 records). [2025-09-29T02:19:33.711982] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-29T02:19:33.715808] [INFO ] [MAIN ] Derivative Progress: 1366/2211 symbols completed. NCA took 1.2s. Estimated remaining: 5m 57s. Rate: 142.1 symbols/min [2025-09-29T02:19:33.718862] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:33.733511] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:33.734343] [INFO ] [MAIN ] NCDL: Generated 1820 derivative records from 21828 primary records. [2025-09-29T02:19:33.734456] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-29T02:19:33.759146] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1820 records). [2025-09-29T02:19:33.759863] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-29T02:19:33.762971] [INFO ] [MAIN ] Derivative Progress: 1367/2211 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 56s. Rate: 142.2 symbols/min [2025-09-29T02:19:33.763265] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:33.773228] [DEBUG] [LOCAL ] NCV: Loaded 13602 existing records from primary storage. [2025-09-29T02:19:33.774034] [INFO ] [MAIN ] NCV: Loaded 13602 primary data records. [2025-09-29T02:19:33.893507] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:33.893979] [DEBUG] [LOCAL ] NCZ: Loaded 11998 existing records from primary storage. [2025-09-29T02:19:33.914446] [INFO ] [MAIN ] NCZ: Loaded 11998 primary data records. [2025-09-29T02:19:33.914322] [INFO ] [MAIN ] NCLH: Generated 1820 derivative records from 54533 primary records. [2025-09-29T02:19:33.919883] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-29T02:19:34.277476] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1820 records). [2025-09-29T02:19:34.299235] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-29T02:19:34.308831] [INFO ] [MAIN ] Derivative Progress: 1368/2211 symbols completed. NCLH took 1.8s. Estimated remaining: 5m 56s. Rate: 142.2 symbols/min [2025-09-29T02:19:34.314175] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:34.521869] [DEBUG] [LOCAL ] NDMO: Loaded 16978 existing records from primary storage. [2025-09-29T02:19:34.522515] [INFO ] [MAIN ] NDMO: Loaded 16978 primary data records. [2025-09-29T02:19:34.692030] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:34.733965] [INFO ] [MAIN ] NCV: Generated 1820 derivative records from 13602 primary records. [2025-09-29T02:19:34.907446] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-29T02:19:34.908308] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:34.909284] [INFO ] [MAIN ] NCZ: Generated 1820 derivative records from 11998 primary records. [2025-09-29T02:19:34.910210] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-29T02:19:34.945234] [DEBUG] [LOCAL ] NCV: Derivative data saved (1820 records). [2025-09-29T02:19:34.945719] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1820 records). [2025-09-29T02:19:34.946523] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-29T02:19:34.949729] [INFO ] [MAIN ] Derivative Progress: 1369/2211 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 56s. Rate: 142.1 symbols/min [2025-09-29T02:19:34.949935] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:34.946162] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-29T02:19:34.954128] [INFO ] [MAIN ] Derivative Progress: 1370/2211 symbols completed. NCV took 1.2s. Estimated remaining: 5m 55s. Rate: 142.2 symbols/min [2025-09-29T02:19:34.954528] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:34.979887] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:34.981508] [INFO ] [MAIN ] NDMO: Generated 1820 derivative records from 16978 primary records. [2025-09-29T02:19:34.981636] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-29T02:19:35.010298] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1820 records). [2025-09-29T02:19:35.010469] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-29T02:19:35.013588] [INFO ] [MAIN ] Derivative Progress: 1371/2211 symbols completed. NDMO took 0.7s. Estimated remaining: 5m 54s. Rate: 142.3 symbols/min [2025-09-29T02:19:35.015851] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:35.028292] [DEBUG] [LOCAL ] NEA: Loaded 35808 existing records from primary storage. [2025-09-29T02:19:35.044026] [INFO ] [MAIN ] NEA: Loaded 35808 primary data records. [2025-09-29T02:19:35.178698] [DEBUG] [LOCAL ] NE: Loaded 53157 existing records from primary storage. [2025-09-29T02:19:35.190131] [INFO ] [MAIN ] NE: Loaded 53157 primary data records. [2025-09-29T02:19:35.688897] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-09-29T02:19:35.724876] [INFO ] [MAIN ] NEE: Loaded 54487 primary data records. [2025-09-29T02:19:36.236148] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:36.237164] [INFO ] [MAIN ] NEA: Generated 1820 derivative records from 35808 primary records. [2025-09-29T02:19:36.237520] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-29T02:19:36.270401] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:36.272397] [INFO ] [MAIN ] NE: Generated 1820 derivative records from 53157 primary records. [2025-09-29T02:19:36.273875] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-29T02:19:36.275111] [DEBUG] [LOCAL ] NEA: Derivative data saved (1820 records). [2025-09-29T02:19:36.276039] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-29T02:19:36.279491] [INFO ] [MAIN ] Derivative Progress: 1372/2211 symbols completed. NEA took 1.3s. Estimated remaining: 5m 54s. Rate: 142.1 symbols/min [2025-09-29T02:19:36.287957] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:36.299108] [DEBUG] [LOCAL ] NE: Derivative data saved (1820 records). [2025-09-29T02:19:36.299565] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-29T02:19:36.303198] [INFO ] [MAIN ] Derivative Progress: 1373/2211 symbols completed. NE took 1.4s. Estimated remaining: 5m 54s. Rate: 142.2 symbols/min [2025-09-29T02:19:36.303483] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:36.323178] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:36.324613] [INFO ] [MAIN ] NEE: Generated 1820 derivative records from 54487 primary records. [2025-09-29T02:19:36.324891] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-29T02:19:36.342395] [DEBUG] [LOCAL ] NEE: Derivative data saved (1820 records). [2025-09-29T02:19:36.343275] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-29T02:19:36.346739] [INFO ] [MAIN ] Derivative Progress: 1374/2211 symbols completed. NEE took 1.3s. Estimated remaining: 5m 53s. Rate: 142.3 symbols/min [2025-09-29T02:19:36.347035] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:36.406047] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-09-29T02:19:36.410357] [DEBUG] [LOCAL ] NEU: Loaded 8259 existing records from primary storage. [2025-09-29T02:19:36.410480] [INFO ] [MAIN ] NEM: Loaded 54488 primary data records. [2025-09-29T02:19:36.410832] [INFO ] [MAIN ] NEU: Loaded 8259 primary data records. [2025-09-29T02:19:36.583954] [DEBUG] [LOCAL ] NET: Loaded 53808 existing records from primary storage. [2025-09-29T02:19:36.637815] [INFO ] [MAIN ] NET: Loaded 53808 primary data records. [2025-09-29T02:19:37.489129] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:37.490942] [INFO ] [MAIN ] NEU: Generated 1820 derivative records from 8259 primary records. [2025-09-29T02:19:37.491556] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-29T02:19:37.511629] [DEBUG] [LOCAL ] NEU: Derivative data saved (1820 records). [2025-09-29T02:19:37.512378] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-29T02:19:37.514851] [INFO ] [MAIN ] Derivative Progress: 1375/2211 symbols completed. NEU took 1.2s. Estimated remaining: 5m 53s. Rate: 142.1 symbols/min [2025-09-29T02:19:37.527849] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:37.530386] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:37.531501] [INFO ] [MAIN ] NEM: Generated 1820 derivative records from 54488 primary records. [2025-09-29T02:19:37.531742] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-29T02:19:37.537953] [DEBUG] [LOCAL ] NEUE: Loaded 2271 existing records from primary storage. [2025-09-29T02:19:37.567554] [DEBUG] [LOCAL ] NEM: Derivative data saved (1820 records). [2025-09-29T02:19:37.567038] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:37.567454] [INFO ] [MAIN ] NEUE: Loaded 2271 primary data records. [2025-09-29T02:19:37.568734] [INFO ] [MAIN ] NET: Generated 1820 derivative records from 53808 primary records. [2025-09-29T02:19:37.568875] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-29T02:19:37.577260] [INFO ] [MAIN ] Derivative Progress: 1376/2211 symbols completed. NEM took 1.3s. Estimated remaining: 5m 52s. Rate: 142.2 symbols/min [2025-09-29T02:19:37.577605] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:37.584712] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-29T02:19:37.688438] [DEBUG] [LOCAL ] NEXA: Loaded 4307 existing records from primary storage. [2025-09-29T02:19:37.705489] [INFO ] [MAIN ] NEXA: Loaded 4307 primary data records. [2025-09-29T02:19:37.815114] [DEBUG] [LOCAL ] NET: Derivative data saved (1820 records). [2025-09-29T02:19:37.869559] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-29T02:19:38.076868] [INFO ] [MAIN ] Derivative Progress: 1377/2211 symbols completed. NET took 1.8s. Estimated remaining: 5m 52s. Rate: 142.2 symbols/min [2025-09-29T02:19:38.077910] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:38.321534] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:38.322631] [INFO ] [MAIN ] NEUE: Generated 1820 derivative records from 2271 primary records. [2025-09-29T02:19:38.323006] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-29T02:19:38.353228] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1820 records). [2025-09-29T02:19:38.353575] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-29T02:19:38.356768] [INFO ] [MAIN ] Derivative Progress: 1378/2211 symbols completed. NEUE took 0.8s. Estimated remaining: 5m 51s. Rate: 142.2 symbols/min [2025-09-29T02:19:38.373054] [DEBUG] [LOCAL ] NFG: Loaded 39084 existing records from primary storage. [2025-09-29T02:19:38.373575] [INFO ] [MAIN ] NFG: Loaded 39084 primary data records. [2025-09-29T02:19:38.373429] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:19:38.379622] [INFO ] [MAIN ] NEXA: Generated 1819 derivative records from 4307 primary records. [2025-09-29T02:19:38.383486] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-29T02:19:38.509914] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1819 records). [2025-09-29T02:19:38.513303] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-29T02:19:38.521365] [INFO ] [MAIN ] Derivative Progress: 1379/2211 symbols completed. NEXA took 0.9s. Estimated remaining: 5m 51s. Rate: 142.3 symbols/min [2025-09-29T02:19:38.752197] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:38.752987] [INFO ] [MAIN ] NFG: Generated 1820 derivative records from 39084 primary records. [2025-09-29T02:19:38.753096] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-29T02:19:38.769549] [DEBUG] [LOCAL ] NFG: Derivative data saved (1820 records). [2025-09-29T02:19:38.769679] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-29T02:19:38.772269] [INFO ] [MAIN ] Derivative Progress: 1380/2211 symbols completed. NFG took 0.7s. Estimated remaining: 5m 50s. Rate: 142.3 symbols/min [2025-09-29T02:19:38.772763] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:38.772908] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:38.773012] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:38.813267] [DEBUG] [LOCAL ] NFJ: Loaded 20592 existing records from primary storage. [2025-09-29T02:19:38.822986] [INFO ] [MAIN ] NFJ: Loaded 20592 primary data records. [2025-09-29T02:19:38.836371] [DEBUG] [LOCAL ] NGL: Loaded 30754 existing records from primary storage. [2025-09-29T02:19:38.836536] [INFO ] [MAIN ] NGL: Loaded 30754 primary data records. [2025-09-29T02:19:39.140288] [DEBUG] [LOCAL ] NGG: Loaded 46809 existing records from primary storage. [2025-09-29T02:19:39.214188] [INFO ] [MAIN ] NGG: Loaded 46809 primary data records. [2025-09-29T02:19:39.943531] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:39.958983] [INFO ] [MAIN ] NFJ: Generated 1820 derivative records from 20592 primary records. [2025-09-29T02:19:39.957897] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:39.960629] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-29T02:19:39.962276] [INFO ] [MAIN ] NGL: Generated 1820 derivative records from 30754 primary records. [2025-09-29T02:19:39.964238] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-29T02:19:40.003664] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:39.995581] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1820 records). [2025-09-29T02:19:40.004703] [INFO ] [MAIN ] NGG: Generated 1820 derivative records from 46809 primary records. [2025-09-29T02:19:40.008705] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-29T02:19:40.003906] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-29T02:19:40.012928] [DEBUG] [LOCAL ] NGL: Derivative data saved (1820 records). [2025-09-29T02:19:40.014006] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-29T02:19:40.016782] [INFO ] [MAIN ] Derivative Progress: 1381/2211 symbols completed. NFJ took 1.2s. Estimated remaining: 5m 50s. Rate: 142.1 symbols/min [2025-09-29T02:19:40.031471] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:40.032163] [INFO ] [MAIN ] Derivative Progress: 1382/2211 symbols completed. NGL took 1.3s. Estimated remaining: 5m 50s. Rate: 142.2 symbols/min [2025-09-29T02:19:40.032763] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:40.039992] [DEBUG] [LOCAL ] NGG: Derivative data saved (1820 records). [2025-09-29T02:19:40.040267] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-29T02:19:40.043696] [INFO ] [MAIN ] Derivative Progress: 1383/2211 symbols completed. NGG took 1.3s. Estimated remaining: 5m 49s. Rate: 142.3 symbols/min [2025-09-29T02:19:40.044064] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:40.059262] [DEBUG] [LOCAL ] NGS: Loaded 11682 existing records from primary storage. [2025-09-29T02:19:40.059724] [INFO ] [MAIN ] NGS: Loaded 11682 primary data records. [2025-09-29T02:19:40.171360] [DEBUG] [LOCAL ] NGVC: Loaded 22650 existing records from primary storage. [2025-09-29T02:19:40.191366] [INFO ] [MAIN ] NGVC: Loaded 22650 primary data records. [2025-09-29T02:19:40.200476] [DEBUG] [LOCAL ] NGVT: Loaded 24631 existing records from primary storage. [2025-09-29T02:19:40.226280] [INFO ] [MAIN ] NGVT: Loaded 24631 primary data records. [2025-09-29T02:19:41.128872] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:41.130226] [INFO ] [MAIN ] NGS: Generated 1820 derivative records from 11682 primary records. [2025-09-29T02:19:41.130563] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-29T02:19:41.160097] [DEBUG] [LOCAL ] NGS: Derivative data saved (1820 records). [2025-09-29T02:19:41.165683] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-29T02:19:41.169202] [INFO ] [MAIN ] Derivative Progress: 1384/2211 symbols completed. NGS took 1.1s. Estimated remaining: 5m 49s. Rate: 142.1 symbols/min [2025-09-29T02:19:41.166061] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:41.170058] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:41.171663] [INFO ] [MAIN ] NGVC: Generated 1820 derivative records from 22650 primary records. [2025-09-29T02:19:41.172439] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-29T02:19:41.192177] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1820 records). [2025-09-29T02:19:41.194633] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-29T02:19:41.197784] [INFO ] [MAIN ] Derivative Progress: 1385/2211 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 48s. Rate: 142.2 symbols/min [2025-09-29T02:19:41.198345] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:41.214479] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:41.215559] [INFO ] [MAIN ] NGVT: Generated 1820 derivative records from 24631 primary records. [2025-09-29T02:19:41.215691] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-29T02:19:41.241097] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1820 records). [2025-09-29T02:19:41.241336] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-29T02:19:41.244164] [INFO ] [MAIN ] Derivative Progress: 1386/2211 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 48s. Rate: 142.3 symbols/min [2025-09-29T02:19:41.244465] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:41.254354] [DEBUG] [LOCAL ] NHI: Loaded 22283 existing records from primary storage. [2025-09-29T02:19:41.254697] [INFO ] [MAIN ] NHI: Loaded 22283 primary data records. [2025-09-29T02:19:41.381524] [DEBUG] [LOCAL ] NIC: Loaded 9026 existing records from primary storage. [2025-09-29T02:19:41.387174] [INFO ] [MAIN ] NIC: Loaded 9026 primary data records. [2025-09-29T02:19:41.786413] [DEBUG] [LOCAL ] NI: Loaded 54201 existing records from primary storage. [2025-09-29T02:19:41.829087] [INFO ] [MAIN ] NI: Loaded 54201 primary data records. [2025-09-29T02:19:42.455317] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:42.457243] [INFO ] [MAIN ] NHI: Generated 1820 derivative records from 22283 primary records. [2025-09-29T02:19:42.457581] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-29T02:19:42.480008] [DEBUG] [LOCAL ] NHI: Derivative data saved (1820 records). [2025-09-29T02:19:42.481616] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-29T02:19:42.485580] [INFO ] [MAIN ] Derivative Progress: 1387/2211 symbols completed. NHI took 1.3s. Estimated remaining: 5m 48s. Rate: 142.1 symbols/min [2025-09-29T02:19:42.485986] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:42.501065] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:42.502190] [INFO ] [MAIN ] NIC: Generated 1820 derivative records from 9026 primary records. [2025-09-29T02:19:42.502765] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-29T02:19:42.524975] [DEBUG] [LOCAL ] NIC: Derivative data saved (1820 records). [2025-09-29T02:19:42.526690] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-29T02:19:42.531481] [INFO ] [MAIN ] Derivative Progress: 1388/2211 symbols completed. NIC took 1.3s. Estimated remaining: 5m 47s. Rate: 142.2 symbols/min [2025-09-29T02:19:42.532029] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:42.538701] [DEBUG] [LOCAL ] NIE: Loaded 11869 existing records from primary storage. [2025-09-29T02:19:42.539357] [INFO ] [MAIN ] NIE: Loaded 11869 primary data records. [2025-09-29T02:19:42.559098] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:42.615934] [DEBUG] [LOCAL ] NIM: Loaded 4149 existing records from primary storage. [2025-09-29T02:19:42.602157] [INFO ] [MAIN ] NI: Generated 1820 derivative records from 54201 primary records. [2025-09-29T02:19:42.628006] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-09-29T02:19:42.627849] [INFO ] [MAIN ] NIM: Loaded 4149 primary data records. [2025-09-29T02:19:42.815536] [DEBUG] [LOCAL ] NI: Derivative data saved (1820 records). [2025-09-29T02:19:42.916148] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-29T02:19:42.919851] [INFO ] [MAIN ] Derivative Progress: 1389/2211 symbols completed. NI took 1.7s. Estimated remaining: 5m 47s. Rate: 142.2 symbols/min [2025-09-29T02:19:43.017995] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:43.291260] [DEBUG] [LOCAL ] NINE: Loaded 28624 existing records from primary storage. [2025-09-29T02:19:43.292182] [INFO ] [MAIN ] NINE: Loaded 28624 primary data records. [2025-09-29T02:19:43.404384] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:43.431828] [INFO ] [MAIN ] NIE: Generated 1820 derivative records from 11869 primary records. [2025-09-29T02:19:43.442893] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-29T02:19:43.489423] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:43.546440] [INFO ] [MAIN ] NIM: Generated 1820 derivative records from 4149 primary records. [2025-09-29T02:19:43.549438] [DEBUG] [LOCAL ] NIE: Derivative data saved (1820 records). [2025-09-29T02:19:43.619508] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-29T02:19:43.658596] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-29T02:19:43.676980] [INFO ] [MAIN ] Derivative Progress: 1390/2211 symbols completed. NIE took 1.2s. Estimated remaining: 5m 47s. Rate: 142.1 symbols/min [2025-09-29T02:19:43.677854] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:43.694855] [DEBUG] [LOCAL ] NIM: Derivative data saved (1820 records). [2025-09-29T02:19:43.695323] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-29T02:19:43.698234] [INFO ] [MAIN ] Derivative Progress: 1391/2211 symbols completed. NIM took 1.2s. Estimated remaining: 5m 46s. Rate: 142.2 symbols/min [2025-09-29T02:19:43.698958] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:43.725214] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:43.726120] [INFO ] [MAIN ] NINE: Generated 1820 derivative records from 28624 primary records. [2025-09-29T02:19:43.726225] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-29T02:19:43.746851] [DEBUG] [LOCAL ] NINE: Derivative data saved (1820 records). [2025-09-29T02:19:43.747027] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-29T02:19:43.749929] [INFO ] [MAIN ] Derivative Progress: 1392/2211 symbols completed. NINE took 0.7s. Estimated remaining: 5m 45s. Rate: 142.3 symbols/min [2025-09-29T02:19:43.750214] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:43.795820] [DEBUG] [LOCAL ] NJR: Loaded 38739 existing records from primary storage. [2025-09-29T02:19:43.803777] [DEBUG] [LOCAL ] NKX: Loaded 13801 existing records from primary storage. [2025-09-29T02:19:43.803389] [INFO ] [MAIN ] NJR: Loaded 38739 primary data records. [2025-09-29T02:19:43.804263] [INFO ] [MAIN ] NKX: Loaded 13801 primary data records. [2025-09-29T02:19:43.884423] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-29T02:19:43.986284] [INFO ] [MAIN ] NIO: Loaded 54582 primary data records. [2025-09-29T02:19:45.142945] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:45.144783] [INFO ] [MAIN ] NJR: Generated 1820 derivative records from 38739 primary records. [2025-09-29T02:19:45.144994] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-29T02:19:45.180811] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:45.184450] [INFO ] [MAIN ] NKX: Generated 1820 derivative records from 13801 primary records. [2025-09-29T02:19:45.184621] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-29T02:19:45.188193] [DEBUG] [LOCAL ] NJR: Derivative data saved (1820 records). [2025-09-29T02:19:45.188566] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-29T02:19:45.206048] [INFO ] [MAIN ] Derivative Progress: 1393/2211 symbols completed. NJR took 1.5s. Estimated remaining: 5m 45s. Rate: 142.1 symbols/min [2025-09-29T02:19:45.219011] [DEBUG] [LOCAL ] NKX: Derivative data saved (1820 records). [2025-09-29T02:19:45.219666] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-29T02:19:45.223488] [INFO ] [MAIN ] Derivative Progress: 1394/2211 symbols completed. NKX took 1.5s. Estimated remaining: 5m 45s. Rate: 142.2 symbols/min [2025-09-29T02:19:45.242905] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:45.243737] [INFO ] [MAIN ] NIO: Generated 1820 derivative records from 54582 primary records. [2025-09-29T02:19:45.243825] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-29T02:19:45.260221] [DEBUG] [LOCAL ] NIO: Derivative data saved (1820 records). [2025-09-29T02:19:45.260380] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-29T02:19:45.264480] [INFO ] [MAIN ] Derivative Progress: 1395/2211 symbols completed. NIO took 1.6s. Estimated remaining: 5m 44s. Rate: 142.3 symbols/min [2025-09-29T02:19:45.265002] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:45.265079] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:45.265818] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:45.294752] [DEBUG] [LOCAL ] NMAI: Loaded 13181 existing records from primary storage. [2025-09-29T02:19:45.301525] [DEBUG] [LOCAL ] NLOP: Loaded 11997 existing records from primary storage. [2025-09-29T02:19:45.301819] [INFO ] [MAIN ] NMAI: Loaded 13181 primary data records. [2025-09-29T02:19:45.301972] [INFO ] [MAIN ] NLOP: Loaded 11997 primary data records. [2025-09-29T02:19:45.738696] [DEBUG] [LOCAL ] NLY: Loaded 54358 existing records from primary storage. [2025-09-29T02:19:46.037471] [INFO ] [MAIN ] NLY: Loaded 54358 primary data records. [2025-09-29T02:19:46.500513] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:46.514993] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:46.516159] [INFO ] [MAIN ] NLOP: Generated 1820 derivative records from 11997 primary records. [2025-09-29T02:19:46.516976] [INFO ] [MAIN ] NMAI: Generated 1820 derivative records from 13181 primary records. [2025-09-29T02:19:46.517235] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-29T02:19:46.517345] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-29T02:19:46.552679] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1820 records). [2025-09-29T02:19:46.552756] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1820 records). [2025-09-29T02:19:46.555412] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-29T02:19:46.558705] [INFO ] [MAIN ] Derivative Progress: 1396/2211 symbols completed. NLOP took 1.3s. Estimated remaining: 5m 44s. Rate: 142.1 symbols/min [2025-09-29T02:19:46.559264] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:46.559499] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-29T02:19:46.575405] [INFO ] [MAIN ] Derivative Progress: 1397/2211 symbols completed. NMAI took 1.3s. Estimated remaining: 5m 44s. Rate: 142.2 symbols/min [2025-09-29T02:19:46.576157] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:46.576476] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:46.577965] [INFO ] [MAIN ] NLY: Generated 1820 derivative records from 54358 primary records. [2025-09-29T02:19:46.578240] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-29T02:19:46.597969] [DEBUG] [LOCAL ] NLY: Derivative data saved (1820 records). [2025-09-29T02:19:46.602245] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-29T02:19:46.605237] [INFO ] [MAIN ] Derivative Progress: 1398/2211 symbols completed. NLY took 1.3s. Estimated remaining: 5m 43s. Rate: 142.3 symbols/min [2025-09-29T02:19:46.605561] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:46.610891] [DEBUG] [LOCAL ] NMG: Loaded 7913 existing records from primary storage. [2025-09-29T02:19:46.611220] [INFO ] [MAIN ] NMG: Loaded 7913 primary data records. [2025-09-29T02:19:46.663888] [DEBUG] [LOCAL ] NMCO: Loaded 16803 existing records from primary storage. [2025-09-29T02:19:46.718041] [INFO ] [MAIN ] NMCO: Loaded 16803 primary data records. [2025-09-29T02:19:46.732202] [DEBUG] [LOCAL ] NMI: Loaded 4091 existing records from primary storage. [2025-09-29T02:19:46.760750] [INFO ] [MAIN ] NMI: Loaded 4091 primary data records. [2025-09-29T02:19:47.701370] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:47.705543] [INFO ] [MAIN ] NMG: Generated 1820 derivative records from 7913 primary records. [2025-09-29T02:19:47.707367] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-29T02:19:47.743602] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:47.753127] [INFO ] [MAIN ] NMCO: Generated 1820 derivative records from 16803 primary records. [2025-09-29T02:19:47.756483] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-29T02:19:47.756119] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:47.758458] [INFO ] [MAIN ] NMI: Generated 1820 derivative records from 4091 primary records. [2025-09-29T02:19:47.757329] [DEBUG] [LOCAL ] NMG: Derivative data saved (1820 records). [2025-09-29T02:19:47.760153] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-29T02:19:47.760289] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-29T02:19:47.767706] [INFO ] [MAIN ] Derivative Progress: 1399/2211 symbols completed. NMG took 1.2s. Estimated remaining: 5m 43s. Rate: 142.1 symbols/min [2025-09-29T02:19:47.783785] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1820 records). [2025-09-29T02:19:47.783962] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-29T02:19:47.784216] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:47.801971] [INFO ] [MAIN ] Derivative Progress: 1400/2211 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 42s. Rate: 142.2 symbols/min [2025-09-29T02:19:47.805398] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:47.807457] [DEBUG] [LOCAL ] NMI: Derivative data saved (1820 records). [2025-09-29T02:19:47.807558] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-29T02:19:47.810458] [INFO ] [MAIN ] Derivative Progress: 1401/2211 symbols completed. NMI took 1.2s. Estimated remaining: 5m 42s. Rate: 142.3 symbols/min [2025-09-29T02:19:47.810984] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:47.821231] [DEBUG] [LOCAL ] NMS: Loaded 2893 existing records from primary storage. [2025-09-29T02:19:47.821547] [INFO ] [MAIN ] NMS: Loaded 2893 primary data records. [2025-09-29T02:19:47.903757] [DEBUG] [LOCAL ] NMM: Loaded 14470 existing records from primary storage. [2025-09-29T02:19:47.949348] [INFO ] [MAIN ] NMM: Loaded 14470 primary data records. [2025-09-29T02:19:48.315948] [DEBUG] [LOCAL ] NMR: Loaded 35569 existing records from primary storage. [2025-09-29T02:19:48.340371] [INFO ] [MAIN ] NMR: Loaded 35569 primary data records. [2025-09-29T02:19:48.952846] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:19:48.954268] [INFO ] [MAIN ] NMS: Generated 1818 derivative records from 2893 primary records. [2025-09-29T02:19:48.954545] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-29T02:19:48.977728] [DEBUG] [LOCAL ] NMS: Derivative data saved (1818 records). [2025-09-29T02:19:48.977963] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-29T02:19:48.982012] [INFO ] [MAIN ] Derivative Progress: 1402/2211 symbols completed. NMS took 1.2s. Estimated remaining: 5m 42s. Rate: 142.1 symbols/min [2025-09-29T02:19:48.985021] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:49.001453] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:49.002666] [INFO ] [MAIN ] NMM: Generated 1820 derivative records from 14470 primary records. [2025-09-29T02:19:49.002922] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-29T02:19:49.007192] [DEBUG] [LOCAL ] NMT: Loaded 2884 existing records from primary storage. [2025-09-29T02:19:49.007594] [INFO ] [MAIN ] NMT: Loaded 2884 primary data records. [2025-09-29T02:19:49.067672] [DEBUG] [LOCAL ] NMM: Derivative data saved (1820 records). [2025-09-29T02:19:49.081629] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-29T02:19:49.093127] [INFO ] [MAIN ] Derivative Progress: 1403/2211 symbols completed. NMM took 1.3s. Estimated remaining: 5m 41s. Rate: 142.2 symbols/min [2025-09-29T02:19:49.134726] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:49.139959] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:49.160439] [INFO ] [MAIN ] NMR: Generated 1820 derivative records from 35569 primary records. [2025-09-29T02:19:49.160635] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-29T02:19:49.394842] [DEBUG] [LOCAL ] NMR: Derivative data saved (1820 records). [2025-09-29T02:19:49.395247] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-29T02:19:49.399125] [INFO ] [MAIN ] Derivative Progress: 1404/2211 symbols completed. NMR took 1.6s. Estimated remaining: 5m 41s. Rate: 142.2 symbols/min [2025-09-29T02:19:49.399604] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:49.410670] [DEBUG] [LOCAL ] NMZ: Loaded 21872 existing records from primary storage. [2025-09-29T02:19:49.412282] [INFO ] [MAIN ] NMZ: Loaded 21872 primary data records. [2025-09-29T02:19:49.543003] [DEBUG] [LOCAL ] NNI: Loaded 10159 existing records from primary storage. [2025-09-29T02:19:49.553877] [INFO ] [MAIN ] NNI: Loaded 10159 primary data records. [2025-09-29T02:19:49.985073] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:50.124459] [INFO ] [MAIN ] NMT: Generated 1820 derivative records from 2884 primary records. [2025-09-29T02:19:50.129381] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-29T02:19:50.152949] [DEBUG] [LOCAL ] NMT: Derivative data saved (1820 records). [2025-09-29T02:19:50.153979] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-29T02:19:50.157293] [INFO ] [MAIN ] Derivative Progress: 1405/2211 symbols completed. NMT took 1.2s. Estimated remaining: 5m 40s. Rate: 142.1 symbols/min [2025-09-29T02:19:50.157947] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:50.178894] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:50.181093] [INFO ] [MAIN ] NMZ: Generated 1820 derivative records from 21872 primary records. [2025-09-29T02:19:50.181915] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-29T02:19:50.203746] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1820 records). [2025-09-29T02:19:50.217267] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-29T02:19:50.221033] [INFO ] [MAIN ] Derivative Progress: 1406/2211 symbols completed. NMZ took 1.1s. Estimated remaining: 5m 40s. Rate: 142.2 symbols/min [2025-09-29T02:19:50.221292] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:50.221831] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:50.223185] [INFO ] [MAIN ] NNI: Generated 1820 derivative records from 10159 primary records. [2025-09-29T02:19:50.223431] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-29T02:19:50.255299] [DEBUG] [LOCAL ] NNY: Loaded 5750 existing records from primary storage. [2025-09-29T02:19:50.256757] [INFO ] [MAIN ] NNY: Loaded 5750 primary data records. [2025-09-29T02:19:50.262702] [DEBUG] [LOCAL ] NNI: Derivative data saved (1820 records). [2025-09-29T02:19:50.319192] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-29T02:19:50.369567] [INFO ] [MAIN ] Derivative Progress: 1407/2211 symbols completed. NNI took 1.0s. Estimated remaining: 5m 39s. Rate: 142.3 symbols/min [2025-09-29T02:19:50.392853] [DEBUG] [LOCAL ] NNN: Loaded 49151 existing records from primary storage. [2025-09-29T02:19:50.393174] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:50.393486] [INFO ] [MAIN ] NNN: Loaded 49151 primary data records. [2025-09-29T02:19:50.760121] [DEBUG] [LOCAL ] NOA: Loaded 16497 existing records from primary storage. [2025-09-29T02:19:50.771704] [INFO ] [MAIN ] NOA: Loaded 16497 primary data records. [2025-09-29T02:19:51.392207] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:51.395697] [INFO ] [MAIN ] NNY: Generated 1820 derivative records from 5750 primary records. [2025-09-29T02:19:51.396119] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-29T02:19:51.413756] [DEBUG] [LOCAL ] NNY: Derivative data saved (1820 records). [2025-09-29T02:19:51.414371] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-29T02:19:51.416797] [INFO ] [MAIN ] Derivative Progress: 1408/2211 symbols completed. NNY took 1.2s. Estimated remaining: 5m 39s. Rate: 142.1 symbols/min [2025-09-29T02:19:51.435780] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:51.436553] [INFO ] [MAIN ] NNN: Generated 1820 derivative records from 49151 primary records. [2025-09-29T02:19:51.437018] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-29T02:19:51.456610] [DEBUG] [LOCAL ] NNN: Derivative data saved (1820 records). [2025-09-29T02:19:51.458050] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-29T02:19:51.462347] [INFO ] [MAIN ] Derivative Progress: 1409/2211 symbols completed. NNN took 1.3s. Estimated remaining: 5m 38s. Rate: 142.2 symbols/min [2025-09-29T02:19:51.477055] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:51.477894] [INFO ] [MAIN ] NOA: Generated 1820 derivative records from 16497 primary records. [2025-09-29T02:19:51.477991] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-29T02:19:51.494291] [DEBUG] [LOCAL ] NOA: Derivative data saved (1820 records). [2025-09-29T02:19:51.494403] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-29T02:19:51.497874] [INFO ] [MAIN ] Derivative Progress: 1410/2211 symbols completed. NOA took 1.1s. Estimated remaining: 5m 38s. Rate: 142.3 symbols/min [2025-09-29T02:19:51.498558] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:51.498688] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:51.499008] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:51.532243] [DEBUG] [LOCAL ] NOAH: Loaded 20358 existing records from primary storage. [2025-09-29T02:19:51.532423] [INFO ] [MAIN ] NOAH: Loaded 20358 primary data records. [2025-09-29T02:19:51.935118] [DEBUG] [LOCAL ] NOG: Loaded 51932 existing records from primary storage. [2025-09-29T02:19:51.936398] [INFO ] [MAIN ] NOG: Loaded 51932 primary data records. [2025-09-29T02:19:51.942724] [DEBUG] [LOCAL ] NOC: Loaded 43141 existing records from primary storage. [2025-09-29T02:19:51.960864] [INFO ] [MAIN ] NOC: Loaded 43141 primary data records. [2025-09-29T02:19:52.650010] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:52.651560] [INFO ] [MAIN ] NOAH: Generated 1820 derivative records from 20358 primary records. [2025-09-29T02:19:52.652573] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-29T02:19:52.671671] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1820 records). [2025-09-29T02:19:52.671926] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-29T02:19:52.675317] [INFO ] [MAIN ] Derivative Progress: 1411/2211 symbols completed. NOAH took 1.2s. Estimated remaining: 5m 38s. Rate: 142.1 symbols/min [2025-09-29T02:19:52.676234] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:52.699574] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:52.701626] [INFO ] [MAIN ] NOG: Generated 1820 derivative records from 51932 primary records. [2025-09-29T02:19:52.703012] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-29T02:19:52.730100] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:52.732625] [INFO ] [MAIN ] NOC: Generated 1820 derivative records from 43141 primary records. [2025-09-29T02:19:52.735886] [DEBUG] [LOCAL ] NOG: Derivative data saved (1820 records). [2025-09-29T02:19:52.736073] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-29T02:19:52.736702] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-29T02:19:52.740027] [INFO ] [MAIN ] Derivative Progress: 1412/2211 symbols completed. NOG took 1.2s. Estimated remaining: 5m 37s. Rate: 142.2 symbols/min [2025-09-29T02:19:52.740232] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:52.772023] [DEBUG] [LOCAL ] NOC: Derivative data saved (1820 records). [2025-09-29T02:19:52.772230] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-29T02:19:52.775556] [INFO ] [MAIN ] Derivative Progress: 1413/2211 symbols completed. NOC took 1.3s. Estimated remaining: 5m 36s. Rate: 142.3 symbols/min [2025-09-29T02:19:52.775905] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:52.805265] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-29T02:19:52.805637] [INFO ] [MAIN ] NOK: Loaded 54401 primary data records. [2025-09-29T02:19:52.967937] [DEBUG] [LOCAL ] NOMD: Loaded 42016 existing records from primary storage. [2025-09-29T02:19:53.037238] [INFO ] [MAIN ] NOMD: Loaded 42016 primary data records. [2025-09-29T02:19:53.231238] [DEBUG] [LOCAL ] NOTE: Loaded 43143 existing records from primary storage. [2025-09-29T02:19:53.298322] [INFO ] [MAIN ] NOTE: Loaded 43143 primary data records. [2025-09-29T02:19:53.932381] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:53.933627] [INFO ] [MAIN ] NOK: Generated 1820 derivative records from 54401 primary records. [2025-09-29T02:19:53.934188] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-29T02:19:53.952911] [DEBUG] [LOCAL ] NOK: Derivative data saved (1820 records). [2025-09-29T02:19:53.953259] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-29T02:19:53.956602] [INFO ] [MAIN ] Derivative Progress: 1414/2211 symbols completed. NOK took 1.3s. Estimated remaining: 5m 37s. Rate: 142.1 symbols/min [2025-09-29T02:19:53.958564] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:53.977898] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:53.979293] [INFO ] [MAIN ] NOMD: Generated 1820 derivative records from 42016 primary records. [2025-09-29T02:19:53.979556] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-29T02:19:54.001597] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1820 records). [2025-09-29T02:19:54.001868] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-29T02:19:54.004936] [INFO ] [MAIN ] Derivative Progress: 1415/2211 symbols completed. NOMD took 1.3s. Estimated remaining: 5m 36s. Rate: 142.2 symbols/min [2025-09-29T02:19:54.005313] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:54.021333] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:54.022329] [INFO ] [MAIN ] NOTE: Generated 1820 derivative records from 43143 primary records. [2025-09-29T02:19:54.022438] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-29T02:19:54.039062] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1820 records). [2025-09-29T02:19:54.039215] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-29T02:19:54.044044] [INFO ] [MAIN ] Derivative Progress: 1416/2211 symbols completed. NOTE took 1.3s. Estimated remaining: 5m 35s. Rate: 142.3 symbols/min [2025-09-29T02:19:54.044431] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:54.093956] [DEBUG] [LOCAL ] NOV: Loaded 53961 existing records from primary storage. [2025-09-29T02:19:54.094350] [INFO ] [MAIN ] NOV: Loaded 53961 primary data records. [2025-09-29T02:19:54.176226] [DEBUG] [LOCAL ] NPCT: Loaded 17114 existing records from primary storage. [2025-09-29T02:19:54.188124] [INFO ] [MAIN ] NPCT: Loaded 17114 primary data records. [2025-09-29T02:19:54.265127] [DEBUG] [LOCAL ] NOW: Loaded 49444 existing records from primary storage. [2025-09-29T02:19:54.293439] [INFO ] [MAIN ] NOW: Loaded 49444 primary data records. [2025-09-29T02:19:55.197017] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:55.198531] [INFO ] [MAIN ] NOV: Generated 1820 derivative records from 53961 primary records. [2025-09-29T02:19:55.199097] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-29T02:19:55.221493] [DEBUG] [LOCAL ] NOV: Derivative data saved (1820 records). [2025-09-29T02:19:55.237399] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:55.236836] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-29T02:19:55.241916] [INFO ] [MAIN ] Derivative Progress: 1417/2211 symbols completed. NOV took 1.3s. Estimated remaining: 5m 35s. Rate: 142.1 symbols/min [2025-09-29T02:19:55.243501] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:55.243306] [INFO ] [MAIN ] NOW: Generated 1820 derivative records from 49444 primary records. [2025-09-29T02:19:55.243923] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-09-29T02:19:55.276056] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:55.282462] [DEBUG] [LOCAL ] NOW: Derivative data saved (1820 records). [2025-09-29T02:19:55.281074] [INFO ] [MAIN ] NPCT: Generated 1820 derivative records from 17114 primary records. [2025-09-29T02:19:55.282694] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-29T02:19:55.282794] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-29T02:19:55.291425] [DEBUG] [LOCAL ] NPFD: Loaded 9814 existing records from primary storage. [2025-09-29T02:19:55.286293] [INFO ] [MAIN ] Derivative Progress: 1418/2211 symbols completed. NOW took 1.3s. Estimated remaining: 5m 35s. Rate: 142.2 symbols/min [2025-09-29T02:19:55.292568] [INFO ] [MAIN ] NPFD: Loaded 9814 primary data records. [2025-09-29T02:19:55.292963] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:55.386315] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1820 records). [2025-09-29T02:19:55.401428] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-29T02:19:55.409915] [INFO ] [MAIN ] Derivative Progress: 1419/2211 symbols completed. NPCT took 1.4s. Estimated remaining: 5m 34s. Rate: 142.3 symbols/min [2025-09-29T02:19:55.418401] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:55.457040] [DEBUG] [LOCAL ] NPK: Loaded 8120 existing records from primary storage. [2025-09-29T02:19:55.514624] [INFO ] [MAIN ] NPK: Loaded 8120 primary data records. [2025-09-29T02:19:55.775027] [DEBUG] [LOCAL ] NPO: Loaded 13019 existing records from primary storage. [2025-09-29T02:19:55.784021] [INFO ] [MAIN ] NPO: Loaded 13019 primary data records. [2025-09-29T02:19:56.408482] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:56.409636] [INFO ] [MAIN ] NPFD: Generated 1820 derivative records from 9814 primary records. [2025-09-29T02:19:56.411192] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-29T02:19:56.432539] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1820 records). [2025-09-29T02:19:56.432870] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-29T02:19:56.436473] [INFO ] [MAIN ] Derivative Progress: 1420/2211 symbols completed. NPFD took 1.2s. Estimated remaining: 5m 34s. Rate: 142.1 symbols/min [2025-09-29T02:19:56.436942] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:56.459556] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:56.460930] [INFO ] [MAIN ] NPK: Generated 1820 derivative records from 8120 primary records. [2025-09-29T02:19:56.461451] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-29T02:19:56.467023] [DEBUG] [LOCAL ] NPV: Loaded 5070 existing records from primary storage. [2025-09-29T02:19:56.467247] [INFO ] [MAIN ] NPV: Loaded 5070 primary data records. [2025-09-29T02:19:56.546874] [DEBUG] [LOCAL ] NPK: Derivative data saved (1820 records). [2025-09-29T02:19:56.581081] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-29T02:19:56.599091] [INFO ] [MAIN ] Derivative Progress: 1421/2211 symbols completed. NPK took 1.3s. Estimated remaining: 5m 33s. Rate: 142.2 symbols/min [2025-09-29T02:19:56.605324] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:56.655976] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:56.682760] [INFO ] [MAIN ] NPO: Generated 1820 derivative records from 13019 primary records. [2025-09-29T02:19:56.715900] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-29T02:19:56.865948] [DEBUG] [LOCAL ] NPO: Derivative data saved (1820 records). [2025-09-29T02:19:56.866201] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-29T02:19:56.870245] [INFO ] [MAIN ] Derivative Progress: 1422/2211 symbols completed. NPO took 1.5s. Estimated remaining: 5m 33s. Rate: 142.2 symbols/min [2025-09-29T02:19:56.870468] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:56.906980] [DEBUG] [LOCAL ] NPWR: Loaded 43857 existing records from primary storage. [2025-09-29T02:19:56.908687] [INFO ] [MAIN ] NPWR: Loaded 43857 primary data records. [2025-09-29T02:19:56.913099] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-09-29T02:19:56.923711] [INFO ] [MAIN ] NQP: Loaded 9406 primary data records. [2025-09-29T02:19:57.333972] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:57.671105] [INFO ] [MAIN ] NPV: Generated 1820 derivative records from 5070 primary records. [2025-09-29T02:19:57.672225] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-29T02:19:57.693820] [DEBUG] [LOCAL ] NPV: Derivative data saved (1820 records). [2025-09-29T02:19:57.694442] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-29T02:19:57.696806] [INFO ] [MAIN ] Derivative Progress: 1423/2211 symbols completed. NPV took 1.3s. Estimated remaining: 5m 33s. Rate: 142.1 symbols/min [2025-09-29T02:19:57.750368] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:57.750747] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:57.752447] [INFO ] [MAIN ] NQP: Generated 1820 derivative records from 9406 primary records. [2025-09-29T02:19:57.751696] [INFO ] [MAIN ] NPWR: Generated 1820 derivative records from 43857 primary records. [2025-09-29T02:19:57.752971] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-29T02:19:57.752850] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-29T02:19:57.791370] [DEBUG] [LOCAL ] NQP: Derivative data saved (1820 records). [2025-09-29T02:19:57.795907] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-29T02:19:57.795788] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1820 records). [2025-09-29T02:19:57.799377] [INFO ] [MAIN ] Derivative Progress: 1424/2211 symbols completed. NQP took 0.9s. Estimated remaining: 5m 32s. Rate: 142.2 symbols/min [2025-09-29T02:19:57.799635] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-29T02:19:57.803064] [INFO ] [MAIN ] Derivative Progress: 1425/2211 symbols completed. NPWR took 1.2s. Estimated remaining: 5m 31s. Rate: 142.3 symbols/min [2025-09-29T02:19:57.803678] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:57.804213] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:57.803831] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:57.822164] [DEBUG] [LOCAL ] NREF: Loaded 7957 existing records from primary storage. [2025-09-29T02:19:57.822771] [INFO ] [MAIN ] NREF: Loaded 7957 primary data records. [2025-09-29T02:19:57.982124] [DEBUG] [LOCAL ] NRDY: Loaded 33402 existing records from primary storage. [2025-09-29T02:19:57.982537] [INFO ] [MAIN ] NRDY: Loaded 33402 primary data records. [2025-09-29T02:19:58.207043] [DEBUG] [LOCAL ] NRG: Loaded 53697 existing records from primary storage. [2025-09-29T02:19:58.250344] [INFO ] [MAIN ] NRG: Loaded 53697 primary data records. [2025-09-29T02:19:58.950924] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:58.953203] [INFO ] [MAIN ] NREF: Generated 1820 derivative records from 7957 primary records. [2025-09-29T02:19:58.954139] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-29T02:19:58.976592] [DEBUG] [LOCAL ] NREF: Derivative data saved (1820 records). [2025-09-29T02:19:58.989836] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-29T02:19:58.990263] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:58.993857] [INFO ] [MAIN ] Derivative Progress: 1426/2211 symbols completed. NREF took 1.2s. Estimated remaining: 5m 31s. Rate: 142.1 symbols/min [2025-09-29T02:19:58.991289] [INFO ] [MAIN ] NRDY: Generated 1820 derivative records from 33402 primary records. [2025-09-29T02:19:58.994193] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-29T02:19:58.995558] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:59.012975] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1820 records). [2025-09-29T02:19:59.013404] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-29T02:19:59.017208] [INFO ] [MAIN ] Derivative Progress: 1427/2211 symbols completed. NRDY took 1.2s. Estimated remaining: 5m 31s. Rate: 142.2 symbols/min [2025-09-29T02:19:59.020374] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:59.034919] [DEBUG] [MAIN ] NRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:59.035789] [INFO ] [MAIN ] NRG: Generated 1820 derivative records from 53697 primary records. [2025-09-29T02:19:59.035906] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-09-29T02:19:59.067457] [DEBUG] [LOCAL ] NRG: Derivative data saved (1820 records). [2025-09-29T02:19:59.067675] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-09-29T02:19:59.070308] [INFO ] [MAIN ] Derivative Progress: 1428/2211 symbols completed. NRG took 1.3s. Estimated remaining: 5m 30s. Rate: 142.3 symbols/min [2025-09-29T02:19:59.070704] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:59.082723] [DEBUG] [LOCAL ] NRK: Loaded 19991 existing records from primary storage. [2025-09-29T02:19:59.082962] [INFO ] [MAIN ] NRK: Loaded 19991 primary data records. [2025-09-29T02:19:59.108886] [DEBUG] [LOCAL ] NRP: Loaded 4114 existing records from primary storage. [2025-09-29T02:19:59.151027] [INFO ] [MAIN ] NRP: Loaded 4114 primary data records. [2025-09-29T02:19:59.174495] [DEBUG] [LOCAL ] NRGV: Loaded 43716 existing records from primary storage. [2025-09-29T02:19:59.187831] [INFO ] [MAIN ] NRGV: Loaded 43716 primary data records. [2025-09-29T02:20:00.198711] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:00.200340] [INFO ] [MAIN ] NRK: Generated 1820 derivative records from 19991 primary records. [2025-09-29T02:20:00.199000] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:00.200702] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-29T02:20:00.201364] [INFO ] [MAIN ] NRP: Generated 1820 derivative records from 4114 primary records. [2025-09-29T02:20:00.202569] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-29T02:20:00.222157] [DEBUG] [LOCAL ] NRK: Derivative data saved (1820 records). [2025-09-29T02:20:00.222536] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-29T02:20:00.236325] [INFO ] [MAIN ] Derivative Progress: 1429/2211 symbols completed. NRK took 1.2s. Estimated remaining: 5m 30s. Rate: 142.1 symbols/min [2025-09-29T02:20:00.236946] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:00.255562] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:00.257800] [INFO ] [MAIN ] NRGV: Generated 1820 derivative records from 43716 primary records. [2025-09-29T02:20:00.256890] [DEBUG] [LOCAL ] NRP: Derivative data saved (1820 records). [2025-09-29T02:20:00.258137] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-29T02:20:00.258065] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-29T02:20:00.261265] [INFO ] [MAIN ] Derivative Progress: 1430/2211 symbols completed. NRP took 1.2s. Estimated remaining: 5m 30s. Rate: 142.2 symbols/min [2025-09-29T02:20:00.262382] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:00.276133] [DEBUG] [LOCAL ] NRT: Loaded 4994 existing records from primary storage. [2025-09-29T02:20:00.276429] [INFO ] [MAIN ] NRT: Loaded 4994 primary data records. [2025-09-29T02:20:00.325994] [DEBUG] [LOCAL ] NRUC: Loaded 3136 existing records from primary storage. [2025-09-29T02:20:00.360285] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1820 records). [2025-09-29T02:20:00.374596] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-29T02:20:00.385078] [INFO ] [MAIN ] NRUC: Loaded 3136 primary data records. [2025-09-29T02:20:00.410931] [INFO ] [MAIN ] Derivative Progress: 1431/2211 symbols completed. NRGV took 1.4s. Estimated remaining: 5m 29s. Rate: 142.3 symbols/min [2025-09-29T02:20:00.496750] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:01.044704] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:01.047396] [INFO ] [MAIN ] NRT: Generated 1820 derivative records from 4994 primary records. [2025-09-29T02:20:01.047852] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-29T02:20:01.058781] [DEBUG] [LOCAL ] NSA: Loaded 45528 existing records from primary storage. [2025-09-29T02:20:01.062919] [INFO ] [MAIN ] NSA: Loaded 45528 primary data records. [2025-09-29T02:20:01.071930] [DEBUG] [LOCAL ] NRT: Derivative data saved (1820 records). [2025-09-29T02:20:01.103618] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-29T02:20:01.148232] [INFO ] [MAIN ] Derivative Progress: 1432/2211 symbols completed. NRT took 0.9s. Estimated remaining: 5m 29s. Rate: 142.2 symbols/min [2025-09-29T02:20:01.175462] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:01.194615] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:01.209510] [INFO ] [MAIN ] NRUC: Generated 1820 derivative records from 3136 primary records. [2025-09-29T02:20:01.226697] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-29T02:20:01.457259] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1820 records). [2025-09-29T02:20:01.457906] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-29T02:20:01.461137] [INFO ] [MAIN ] Derivative Progress: 1433/2211 symbols completed. NRUC took 1.2s. Estimated remaining: 5m 28s. Rate: 142.2 symbols/min [2025-09-29T02:20:01.462471] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:01.512347] [DEBUG] [LOCAL ] NSC: Loaded 49879 existing records from primary storage. [2025-09-29T02:20:01.537197] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:01.539001] [INFO ] [MAIN ] NSA: Generated 1820 derivative records from 45528 primary records. [2025-09-29T02:20:01.537515] [INFO ] [MAIN ] NSC: Loaded 49879 primary data records. [2025-09-29T02:20:01.539360] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-29T02:20:01.657076] [DEBUG] [LOCAL ] NSA: Derivative data saved (1820 records). [2025-09-29T02:20:01.650571] [DEBUG] [LOCAL ] NSP: Loaded 35480 existing records from primary storage. [2025-09-29T02:20:01.686746] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-29T02:20:01.700739] [INFO ] [MAIN ] NSP: Loaded 35480 primary data records. [2025-09-29T02:20:01.704268] [INFO ] [MAIN ] Derivative Progress: 1434/2211 symbols completed. NSA took 1.2s. Estimated remaining: 5m 28s. Rate: 142.3 symbols/min [2025-09-29T02:20:01.720845] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:02.169464] [DEBUG] [LOCAL ] NTB: Loaded 20927 existing records from primary storage. [2025-09-29T02:20:02.323706] [INFO ] [MAIN ] NTB: Loaded 20927 primary data records. [2025-09-29T02:20:02.717739] [DEBUG] [MAIN ] NSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:02.720463] [INFO ] [MAIN ] NSC: Generated 1820 derivative records from 49879 primary records. [2025-09-29T02:20:02.720773] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-09-29T02:20:02.749920] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:02.753457] [INFO ] [MAIN ] NSP: Generated 1820 derivative records from 35480 primary records. [2025-09-29T02:20:02.753841] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-29T02:20:02.764543] [DEBUG] [LOCAL ] NSC: Derivative data saved (1820 records). [2025-09-29T02:20:02.773770] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-09-29T02:20:02.776682] [INFO ] [MAIN ] Derivative Progress: 1435/2211 symbols completed. NSC took 1.6s. Estimated remaining: 5m 28s. Rate: 142.1 symbols/min [2025-09-29T02:20:02.777171] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:02.773829] [DEBUG] [LOCAL ] NSP: Derivative data saved (1820 records). [2025-09-29T02:20:02.777741] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-29T02:20:02.781269] [INFO ] [MAIN ] Derivative Progress: 1436/2211 symbols completed. NSP took 1.3s. Estimated remaining: 5m 27s. Rate: 142.2 symbols/min [2025-09-29T02:20:02.781871] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:02.803445] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:02.804342] [INFO ] [MAIN ] NTB: Generated 1820 derivative records from 20927 primary records. [2025-09-29T02:20:02.804430] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-29T02:20:02.821852] [DEBUG] [LOCAL ] NTB: Derivative data saved (1820 records). [2025-09-29T02:20:02.822028] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-29T02:20:02.825096] [INFO ] [MAIN ] Derivative Progress: 1437/2211 symbols completed. NTB took 1.1s. Estimated remaining: 5m 26s. Rate: 142.3 symbols/min [2025-09-29T02:20:02.825407] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:02.894961] [DEBUG] [LOCAL ] NTR: Loaded 53356 existing records from primary storage. [2025-09-29T02:20:02.895523] [INFO ] [MAIN ] NTR: Loaded 53356 primary data records. [2025-09-29T02:20:02.914449] [DEBUG] [LOCAL ] NTST: Loaded 44211 existing records from primary storage. [2025-09-29T02:20:02.943528] [INFO ] [MAIN ] NTST: Loaded 44211 primary data records. [2025-09-29T02:20:03.313720] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-29T02:20:03.437163] [INFO ] [MAIN ] NU: Loaded 54526 primary data records. [2025-09-29T02:20:03.985786] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:03.999266] [INFO ] [MAIN ] NTST: Generated 1820 derivative records from 44211 primary records. [2025-09-29T02:20:04.000442] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:04.002550] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-29T02:20:04.002446] [INFO ] [MAIN ] NTR: Generated 1820 derivative records from 53356 primary records. [2025-09-29T02:20:04.002859] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-29T02:20:04.042370] [DEBUG] [LOCAL ] NTST: Derivative data saved (1820 records). [2025-09-29T02:20:04.042842] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-29T02:20:04.041218] [DEBUG] [LOCAL ] NTR: Derivative data saved (1820 records). [2025-09-29T02:20:04.046489] [INFO ] [MAIN ] Derivative Progress: 1438/2211 symbols completed. NTST took 1.3s. Estimated remaining: 5m 26s. Rate: 142.1 symbols/min [2025-09-29T02:20:04.043167] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-29T02:20:04.050510] [INFO ] [MAIN ] Derivative Progress: 1439/2211 symbols completed. NTR took 1.3s. Estimated remaining: 5m 26s. Rate: 142.2 symbols/min [2025-09-29T02:20:04.069446] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:04.070533] [INFO ] [MAIN ] NU: Generated 1820 derivative records from 54526 primary records. [2025-09-29T02:20:04.070677] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-29T02:20:04.089177] [DEBUG] [LOCAL ] NU: Derivative data saved (1820 records). [2025-09-29T02:20:04.089348] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-29T02:20:04.093253] [INFO ] [MAIN ] Derivative Progress: 1440/2211 symbols completed. NU took 1.3s. Estimated remaining: 5m 25s. Rate: 142.3 symbols/min [2025-09-29T02:20:04.094117] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:04.093982] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:04.094250] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:04.153964] [DEBUG] [LOCAL ] NUV: Loaded 23576 existing records from primary storage. [2025-09-29T02:20:04.154351] [INFO ] [MAIN ] NUV: Loaded 23576 primary data records. [2025-09-29T02:20:04.279441] [DEBUG] [LOCAL ] NUS: Loaded 37005 existing records from primary storage. [2025-09-29T02:20:04.300506] [DEBUG] [LOCAL ] NUVB: Loaded 51998 existing records from primary storage. [2025-09-29T02:20:04.306777] [INFO ] [MAIN ] NUVB: Loaded 51998 primary data records. [2025-09-29T02:20:04.300946] [INFO ] [MAIN ] NUS: Loaded 37005 primary data records. [2025-09-29T02:20:05.261022] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:05.262410] [INFO ] [MAIN ] NUV: Generated 1820 derivative records from 23576 primary records. [2025-09-29T02:20:05.262528] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-29T02:20:05.307569] [DEBUG] [LOCAL ] NUV: Derivative data saved (1820 records). [2025-09-29T02:20:05.312887] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-29T02:20:05.307431] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:05.313690] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:05.314709] [INFO ] [MAIN ] NUVB: Generated 1820 derivative records from 51998 primary records. [2025-09-29T02:20:05.318742] [INFO ] [MAIN ] NUS: Generated 1820 derivative records from 37005 primary records. [2025-09-29T02:20:05.318958] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-29T02:20:05.317572] [INFO ] [MAIN ] Derivative Progress: 1441/2211 symbols completed. NUV took 1.2s. Estimated remaining: 5m 25s. Rate: 142.1 symbols/min [2025-09-29T02:20:05.319700] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-29T02:20:05.321144] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:05.355577] [DEBUG] [LOCAL ] NUS: Derivative data saved (1820 records). [2025-09-29T02:20:05.358081] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-29T02:20:05.365489] [INFO ] [MAIN ] Derivative Progress: 1442/2211 symbols completed. NUS took 1.3s. Estimated remaining: 5m 24s. Rate: 142.2 symbols/min [2025-09-29T02:20:05.357921] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1820 records). [2025-09-29T02:20:05.366487] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:05.366729] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-29T02:20:05.370913] [INFO ] [MAIN ] Derivative Progress: 1443/2211 symbols completed. NUVB took 1.3s. Estimated remaining: 5m 24s. Rate: 142.3 symbols/min [2025-09-29T02:20:05.366263] [DEBUG] [LOCAL ] NUW: Loaded 7512 existing records from primary storage. [2025-09-29T02:20:05.371401] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:05.371543] [INFO ] [MAIN ] NUW: Loaded 7512 primary data records. [2025-09-29T02:20:05.719170] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-09-29T02:20:05.734907] [DEBUG] [LOCAL ] NVGS: Loaded 31403 existing records from primary storage. [2025-09-29T02:20:05.735369] [INFO ] [MAIN ] NVGS: Loaded 31403 primary data records. [2025-09-29T02:20:05.735217] [INFO ] [MAIN ] NVG: Loaded 27703 primary data records. [2025-09-29T02:20:06.505553] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:06.508272] [INFO ] [MAIN ] NUW: Generated 1820 derivative records from 7512 primary records. [2025-09-29T02:20:06.509597] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-29T02:20:06.530847] [DEBUG] [LOCAL ] NUW: Derivative data saved (1820 records). [2025-09-29T02:20:06.531249] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-29T02:20:06.535239] [INFO ] [MAIN ] Derivative Progress: 1444/2211 symbols completed. NUW took 1.2s. Estimated remaining: 5m 24s. Rate: 142.1 symbols/min [2025-09-29T02:20:06.535871] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:06.558969] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:20:06.572339] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:06.574132] [INFO ] [MAIN ] NVGS: Generated 1819 derivative records from 31403 primary records. [2025-09-29T02:20:06.574280] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-29T02:20:06.573282] [INFO ] [MAIN ] NVG: Generated 1820 derivative records from 27703 primary records. [2025-09-29T02:20:06.574829] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-29T02:20:06.610703] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1819 records). [2025-09-29T02:20:06.609249] [DEBUG] [LOCAL ] NVG: Derivative data saved (1820 records). [2025-09-29T02:20:06.611022] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-29T02:20:06.614288] [INFO ] [MAIN ] Derivative Progress: 1445/2211 symbols completed. NVG took 1.2s. Estimated remaining: 5m 23s. Rate: 142.2 symbols/min [2025-09-29T02:20:06.611088] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-29T02:20:06.617590] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:06.617887] [INFO ] [MAIN ] Derivative Progress: 1446/2211 symbols completed. NVGS took 1.2s. Estimated remaining: 5m 23s. Rate: 142.3 symbols/min [2025-09-29T02:20:06.618463] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:06.662970] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-29T02:20:06.671256] [DEBUG] [LOCAL ] NVR: Loaded 19323 existing records from primary storage. [2025-09-29T02:20:06.671516] [INFO ] [MAIN ] NVO: Loaded 54564 primary data records. [2025-09-29T02:20:06.680774] [INFO ] [MAIN ] NVR: Loaded 19323 primary data records. [2025-09-29T02:20:06.908615] [DEBUG] [LOCAL ] NVRI: Loaded 39367 existing records from primary storage. [2025-09-29T02:20:06.932030] [INFO ] [MAIN ] NVRI: Loaded 39367 primary data records. [2025-09-29T02:20:07.747461] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:20:07.763118] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:07.762469] [INFO ] [MAIN ] NVR: Generated 1819 derivative records from 19323 primary records. [2025-09-29T02:20:07.764101] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-29T02:20:07.764882] [INFO ] [MAIN ] NVO: Generated 1820 derivative records from 54564 primary records. [2025-09-29T02:20:07.766094] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-29T02:20:07.802444] [DEBUG] [LOCAL ] NVR: Derivative data saved (1819 records). [2025-09-29T02:20:07.801294] [DEBUG] [LOCAL ] NVO: Derivative data saved (1820 records). [2025-09-29T02:20:07.802962] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-29T02:20:07.803055] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-29T02:20:07.806329] [INFO ] [MAIN ] Derivative Progress: 1447/2211 symbols completed. NVR took 1.2s. Estimated remaining: 5m 23s. Rate: 142.1 symbols/min [2025-09-29T02:20:07.811686] [INFO ] [MAIN ] Derivative Progress: 1448/2211 symbols completed. NVO took 1.3s. Estimated remaining: 5m 22s. Rate: 142.2 symbols/min [2025-09-29T02:20:07.811551] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:07.812298] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:07.838325] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:07.839536] [INFO ] [MAIN ] NVRI: Generated 1820 derivative records from 39367 primary records. [2025-09-29T02:20:07.839879] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-29T02:20:07.863299] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1820 records). [2025-09-29T02:20:07.863524] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-29T02:20:07.868001] [INFO ] [MAIN ] Derivative Progress: 1449/2211 symbols completed. NVRI took 1.2s. Estimated remaining: 5m 21s. Rate: 142.3 symbols/min [2025-09-29T02:20:07.868577] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:07.934319] [DEBUG] [LOCAL ] NVST: Loaded 52381 existing records from primary storage. [2025-09-29T02:20:07.934617] [INFO ] [MAIN ] NVST: Loaded 52381 primary data records. [2025-09-29T02:20:08.049830] [DEBUG] [LOCAL ] NVS: Loaded 52338 existing records from primary storage. [2025-09-29T02:20:08.088523] [INFO ] [MAIN ] NVS: Loaded 52338 primary data records. [2025-09-29T02:20:08.279685] [DEBUG] [LOCAL ] NVT: Loaded 52330 existing records from primary storage. [2025-09-29T02:20:08.280088] [INFO ] [MAIN ] NVT: Loaded 52330 primary data records. [2025-09-29T02:20:09.102319] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:09.103957] [INFO ] [MAIN ] NVST: Generated 1820 derivative records from 52381 primary records. [2025-09-29T02:20:09.104423] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-29T02:20:09.132792] [DEBUG] [LOCAL ] NVST: Derivative data saved (1820 records). [2025-09-29T02:20:09.158295] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:09.158403] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-29T02:20:09.162191] [INFO ] [MAIN ] Derivative Progress: 1450/2211 symbols completed. NVST took 1.3s. Estimated remaining: 5m 21s. Rate: 142.1 symbols/min [2025-09-29T02:20:09.162465] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:09.163533] [INFO ] [MAIN ] NVT: Generated 1820 derivative records from 52330 primary records. [2025-09-29T02:20:09.159092] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:09.164843] [INFO ] [MAIN ] NVS: Generated 1820 derivative records from 52338 primary records. [2025-09-29T02:20:09.165010] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-29T02:20:09.165472] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-29T02:20:09.199123] [DEBUG] [LOCAL ] NVT: Derivative data saved (1820 records). [2025-09-29T02:20:09.198744] [DEBUG] [LOCAL ] NVS: Derivative data saved (1820 records). [2025-09-29T02:20:09.199406] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-29T02:20:09.202470] [INFO ] [MAIN ] Derivative Progress: 1451/2211 symbols completed. NVS took 1.4s. Estimated remaining: 5m 21s. Rate: 142.2 symbols/min [2025-09-29T02:20:09.199472] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-29T02:20:09.206547] [INFO ] [MAIN ] Derivative Progress: 1452/2211 symbols completed. NVT took 1.3s. Estimated remaining: 5m 20s. Rate: 142.3 symbols/min [2025-09-29T02:20:09.206290] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:09.206777] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:09.263050] [DEBUG] [LOCAL ] NWN: Loaded 27222 existing records from primary storage. [2025-09-29T02:20:09.278375] [INFO ] [MAIN ] NWN: Loaded 27222 primary data records. [2025-09-29T02:20:09.281436] [DEBUG] [LOCAL ] NWG: Loaded 52318 existing records from primary storage. [2025-09-29T02:20:09.303407] [INFO ] [MAIN ] NWG: Loaded 52318 primary data records. [2025-09-29T02:20:09.345479] [DEBUG] [LOCAL ] NX: Loaded 33894 existing records from primary storage. [2025-09-29T02:20:09.374689] [INFO ] [MAIN ] NX: Loaded 33894 primary data records. [2025-09-29T02:20:10.325960] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:10.334544] [INFO ] [MAIN ] NWN: Generated 1820 derivative records from 27222 primary records. [2025-09-29T02:20:10.340009] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-29T02:20:10.340318] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:10.341695] [INFO ] [MAIN ] NWG: Generated 1820 derivative records from 52318 primary records. [2025-09-29T02:20:10.341823] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-29T02:20:10.375209] [DEBUG] [LOCAL ] NWN: Derivative data saved (1820 records). [2025-09-29T02:20:10.377947] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-29T02:20:10.378104] [DEBUG] [LOCAL ] NWG: Derivative data saved (1820 records). [2025-09-29T02:20:10.378371] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-29T02:20:10.381236] [INFO ] [MAIN ] Derivative Progress: 1453/2211 symbols completed. NWN took 1.2s. Estimated remaining: 5m 20s. Rate: 142.1 symbols/min [2025-09-29T02:20:10.385054] [INFO ] [MAIN ] Derivative Progress: 1454/2211 symbols completed. NWG took 1.2s. Estimated remaining: 5m 19s. Rate: 142.2 symbols/min [2025-09-29T02:20:10.400891] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:10.401579] [INFO ] [MAIN ] NX: Generated 1820 derivative records from 33894 primary records. [2025-09-29T02:20:10.401727] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-29T02:20:10.418446] [DEBUG] [LOCAL ] NX: Derivative data saved (1820 records). [2025-09-29T02:20:10.418632] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-29T02:20:10.421955] [INFO ] [MAIN ] Derivative Progress: 1455/2211 symbols completed. NX took 1.2s. Estimated remaining: 5m 19s. Rate: 142.3 symbols/min [2025-09-29T02:20:10.422474] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:10.422605] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:10.422733] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:10.441203] [DEBUG] [LOCAL ] NXC: Loaded 4313 existing records from primary storage. [2025-09-29T02:20:10.441557] [INFO ] [MAIN ] NXC: Loaded 4313 primary data records. [2025-09-29T02:20:10.542026] [DEBUG] [LOCAL ] NXDT: Loaded 16531 existing records from primary storage. [2025-09-29T02:20:10.567204] [INFO ] [MAIN ] NXDT: Loaded 16531 primary data records. [2025-09-29T02:20:10.987498] [DEBUG] [LOCAL ] NXE: Loaded 53762 existing records from primary storage. [2025-09-29T02:20:11.000232] [INFO ] [MAIN ] NXE: Loaded 53762 primary data records. [2025-09-29T02:20:11.597891] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:11.599001] [INFO ] [MAIN ] NXC: Generated 1820 derivative records from 4313 primary records. [2025-09-29T02:20:11.599244] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-29T02:20:11.620110] [DEBUG] [LOCAL ] NXC: Derivative data saved (1820 records). [2025-09-29T02:20:11.633882] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-29T02:20:11.636736] [INFO ] [MAIN ] Derivative Progress: 1456/2211 symbols completed. NXC took 1.2s. Estimated remaining: 5m 19s. Rate: 142.1 symbols/min [2025-09-29T02:20:11.637118] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:11.637664] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:11.639289] [INFO ] [MAIN ] NXDT: Generated 1820 derivative records from 16531 primary records. [2025-09-29T02:20:11.639776] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-29T02:20:11.676262] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:11.675577] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1820 records). [2025-09-29T02:20:11.676603] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-29T02:20:11.677546] [INFO ] [MAIN ] NXE: Generated 1820 derivative records from 53762 primary records. [2025-09-29T02:20:11.680433] [INFO ] [MAIN ] Derivative Progress: 1457/2211 symbols completed. NXDT took 1.3s. Estimated remaining: 5m 18s. Rate: 142.2 symbols/min [2025-09-29T02:20:11.680949] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:11.680808] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-29T02:20:11.688563] [DEBUG] [LOCAL ] NXG: Loaded 10647 existing records from primary storage. [2025-09-29T02:20:11.700598] [INFO ] [MAIN ] NXG: Loaded 10647 primary data records. [2025-09-29T02:20:11.769991] [DEBUG] [LOCAL ] NXE: Derivative data saved (1820 records). [2025-09-29T02:20:11.822568] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-29T02:20:11.839905] [DEBUG] [LOCAL ] NXJ: Loaded 15066 existing records from primary storage. [2025-09-29T02:20:11.840167] [INFO ] [MAIN ] NXJ: Loaded 15066 primary data records. [2025-09-29T02:20:11.844226] [INFO ] [MAIN ] Derivative Progress: 1458/2211 symbols completed. NXE took 1.4s. Estimated remaining: 5m 18s. Rate: 142.3 symbols/min [2025-09-29T02:20:11.866987] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:12.183730] [DEBUG] [LOCAL ] NXN: Loaded 2376 existing records from primary storage. [2025-09-29T02:20:12.230316] [INFO ] [MAIN ] NXN: Loaded 2376 primary data records. [2025-09-29T02:20:12.740332] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:12.742906] [INFO ] [MAIN ] NXG: Generated 1820 derivative records from 10647 primary records. [2025-09-29T02:20:12.743432] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-29T02:20:12.766517] [DEBUG] [LOCAL ] NXG: Derivative data saved (1820 records). [2025-09-29T02:20:12.781379] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-29T02:20:12.782113] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:12.787215] [INFO ] [MAIN ] NXJ: Generated 1820 derivative records from 15066 primary records. [2025-09-29T02:20:12.785839] [INFO ] [MAIN ] Derivative Progress: 1459/2211 symbols completed. NXG took 1.1s. Estimated remaining: 5m 17s. Rate: 142.1 symbols/min [2025-09-29T02:20:12.787534] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:12.787620] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-29T02:20:12.807609] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1820 records). [2025-09-29T02:20:12.808232] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-29T02:20:12.811934] [INFO ] [MAIN ] Derivative Progress: 1460/2211 symbols completed. NXJ took 1.1s. Estimated remaining: 5m 17s. Rate: 142.2 symbols/min [2025-09-29T02:20:12.815987] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:12.826154] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-09-29T02:20:12.839245] [INFO ] [MAIN ] NXP: Loaded 12465 primary data records. [2025-09-29T02:20:12.839772] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:12.873677] [INFO ] [MAIN ] NXN: Generated 1820 derivative records from 2376 primary records. [2025-09-29T02:20:12.900978] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-29T02:20:13.006098] [DEBUG] [LOCAL ] NXRT: Loaded 19307 existing records from primary storage. [2025-09-29T02:20:13.022725] [INFO ] [MAIN ] NXRT: Loaded 19307 primary data records. [2025-09-29T02:20:13.326910] [DEBUG] [LOCAL ] NXN: Derivative data saved (1820 records). [2025-09-29T02:20:13.379919] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-29T02:20:13.402894] [INFO ] [MAIN ] Derivative Progress: 1461/2211 symbols completed. NXN took 1.5s. Estimated remaining: 5m 16s. Rate: 142.2 symbols/min [2025-09-29T02:20:13.434221] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:13.658465] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:13.660120] [INFO ] [MAIN ] NXP: Generated 1820 derivative records from 12465 primary records. [2025-09-29T02:20:13.660322] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-29T02:20:13.684323] [DEBUG] [LOCAL ] NXP: Derivative data saved (1820 records). [2025-09-29T02:20:13.684771] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-29T02:20:13.687166] [INFO ] [MAIN ] Derivative Progress: 1462/2211 symbols completed. NXP took 0.9s. Estimated remaining: 5m 16s. Rate: 142.2 symbols/min [2025-09-29T02:20:13.687631] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:13.721756] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:13.722846] [INFO ] [MAIN ] NXRT: Generated 1820 derivative records from 19307 primary records. [2025-09-29T02:20:13.723087] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-29T02:20:13.765232] [DEBUG] [LOCAL ] NYT: Loaded 50645 existing records from primary storage. [2025-09-29T02:20:13.765982] [INFO ] [MAIN ] NYT: Loaded 50645 primary data records. [2025-09-29T02:20:13.803165] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1820 records). [2025-09-29T02:20:13.862075] [DEBUG] [LOCAL ] NZF: Loaded 29361 existing records from primary storage. [2025-09-29T02:20:13.853917] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-29T02:20:13.870944] [INFO ] [MAIN ] Derivative Progress: 1463/2211 symbols completed. NXRT took 1.1s. Estimated remaining: 5m 15s. Rate: 142.3 symbols/min [2025-09-29T02:20:13.862284] [INFO ] [MAIN ] NZF: Loaded 29361 primary data records. [2025-09-29T02:20:13.876510] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:14.502059] [DEBUG] [LOCAL ] OBDC: Loaded 52426 existing records from primary storage. [2025-09-29T02:20:14.504317] [INFO ] [MAIN ] OBDC: Loaded 52426 primary data records. [2025-09-29T02:20:14.671751] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:14.683272] [INFO ] [MAIN ] NYT: Generated 1820 derivative records from 50645 primary records. [2025-09-29T02:20:14.699466] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-29T02:20:14.895992] [DEBUG] [LOCAL ] NYT: Derivative data saved (1820 records). [2025-09-29T02:20:14.897307] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-29T02:20:14.903023] [INFO ] [MAIN ] Derivative Progress: 1464/2211 symbols completed. NYT took 1.5s. Estimated remaining: 5m 15s. Rate: 142.1 symbols/min [2025-09-29T02:20:14.904357] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:14.919742] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:14.921256] [INFO ] [MAIN ] NZF: Generated 1820 derivative records from 29361 primary records. [2025-09-29T02:20:14.921768] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-29T02:20:14.958355] [DEBUG] [LOCAL ] NZF: Derivative data saved (1820 records). [2025-09-29T02:20:14.958660] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-29T02:20:14.959918] [DEBUG] [LOCAL ] OBK: Loaded 16512 existing records from primary storage. [2025-09-29T02:20:14.966171] [INFO ] [MAIN ] OBK: Loaded 16512 primary data records. [2025-09-29T02:20:14.965810] [INFO ] [MAIN ] Derivative Progress: 1465/2211 symbols completed. NZF took 1.3s. Estimated remaining: 5m 15s. Rate: 142.2 symbols/min [2025-09-29T02:20:14.966660] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:15.148549] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:15.193210] [INFO ] [MAIN ] OBDC: Generated 1820 derivative records from 52426 primary records. [2025-09-29T02:20:15.347820] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-29T02:20:15.394117] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1820 records). [2025-09-29T02:20:15.410293] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-29T02:20:15.415726] [INFO ] [MAIN ] Derivative Progress: 1466/2211 symbols completed. OBDC took 1.5s. Estimated remaining: 5m 14s. Rate: 142.2 symbols/min [2025-09-29T02:20:15.417517] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:15.420320] [DEBUG] [LOCAL ] OC: Loaded 45369 existing records from primary storage. [2025-09-29T02:20:15.421686] [INFO ] [MAIN ] OC: Loaded 45369 primary data records. [2025-09-29T02:20:15.523072] [DEBUG] [LOCAL ] OCFT: Loaded 8916 existing records from primary storage. [2025-09-29T02:20:15.549605] [INFO ] [MAIN ] OCFT: Loaded 8916 primary data records. [2025-09-29T02:20:15.901168] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:15.909305] [INFO ] [MAIN ] OBK: Generated 1820 derivative records from 16512 primary records. [2025-09-29T02:20:15.919749] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-29T02:20:16.135968] [DEBUG] [LOCAL ] OBK: Derivative data saved (1820 records). [2025-09-29T02:20:16.136385] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-29T02:20:16.139703] [INFO ] [MAIN ] Derivative Progress: 1467/2211 symbols completed. OBK took 1.2s. Estimated remaining: 5m 14s. Rate: 142.2 symbols/min [2025-09-29T02:20:16.141066] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:16.160111] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-29T02:20:16.160633] [INFO ] [MAIN ] ODC: Loaded 8633 primary data records. [2025-09-29T02:20:16.223735] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:16.268480] [INFO ] [MAIN ] OC: Generated 1820 derivative records from 45369 primary records. [2025-09-29T02:20:16.302302] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-29T02:20:16.389432] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:16.422050] [INFO ] [MAIN ] OCFT: Generated 1820 derivative records from 8916 primary records. [2025-09-29T02:20:16.440859] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-29T02:20:16.553713] [DEBUG] [LOCAL ] OC: Derivative data saved (1820 records). [2025-09-29T02:20:16.555933] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-29T02:20:16.564009] [INFO ] [MAIN ] Derivative Progress: 1468/2211 symbols completed. OC took 1.6s. Estimated remaining: 5m 14s. Rate: 142.2 symbols/min [2025-09-29T02:20:16.580717] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1820 records). [2025-09-29T02:20:16.581038] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-29T02:20:16.584698] [INFO ] [MAIN ] Derivative Progress: 1469/2211 symbols completed. OCFT took 1.2s. Estimated remaining: 5m 13s. Rate: 142.2 symbols/min [2025-09-29T02:20:16.606618] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:16.607541] [INFO ] [MAIN ] ODC: Generated 1820 derivative records from 8633 primary records. [2025-09-29T02:20:16.607631] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-29T02:20:16.624073] [DEBUG] [LOCAL ] ODC: Derivative data saved (1820 records). [2025-09-29T02:20:16.624212] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-29T02:20:16.627214] [INFO ] [MAIN ] Derivative Progress: 1470/2211 symbols completed. ODC took 0.5s. Estimated remaining: 5m 12s. Rate: 142.3 symbols/min [2025-09-29T02:20:16.627925] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:16.628103] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:16.628195] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:16.672480] [DEBUG] [LOCAL ] OFG: Loaded 22393 existing records from primary storage. [2025-09-29T02:20:16.674012] [INFO ] [MAIN ] OFG: Loaded 22393 primary data records. [2025-09-29T02:20:16.675058] [DEBUG] [LOCAL ] ODV: Loaded 26258 existing records from primary storage. [2025-09-29T02:20:16.707083] [INFO ] [MAIN ] ODV: Loaded 26258 primary data records. [2025-09-29T02:20:16.957372] [DEBUG] [LOCAL ] OEC: Loaded 37689 existing records from primary storage. [2025-09-29T02:20:16.994258] [INFO ] [MAIN ] OEC: Loaded 37689 primary data records. [2025-09-29T02:20:17.796045] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:17.797569] [INFO ] [MAIN ] OFG: Generated 1820 derivative records from 22393 primary records. [2025-09-29T02:20:17.810726] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-29T02:20:17.812636] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:17.814412] [INFO ] [MAIN ] ODV: Generated 1820 derivative records from 26258 primary records. [2025-09-29T02:20:17.831078] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-29T02:20:17.832473] [DEBUG] [LOCAL ] OFG: Derivative data saved (1820 records). [2025-09-29T02:20:17.841528] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-29T02:20:17.847301] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:17.864142] [INFO ] [MAIN ] OEC: Generated 1820 derivative records from 37689 primary records. [2025-09-29T02:20:17.862778] [INFO ] [MAIN ] Derivative Progress: 1471/2211 symbols completed. OFG took 1.2s. Estimated remaining: 5m 12s. Rate: 142.1 symbols/min [2025-09-29T02:20:17.865637] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-29T02:20:17.865882] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:17.870308] [DEBUG] [LOCAL ] ODV: Derivative data saved (1820 records). [2025-09-29T02:20:17.871768] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-29T02:20:17.878084] [INFO ] [MAIN ] Derivative Progress: 1472/2211 symbols completed. ODV took 1.2s. Estimated remaining: 5m 12s. Rate: 142.2 symbols/min [2025-09-29T02:20:17.892704] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:17.894717] [DEBUG] [LOCAL ] OEC: Derivative data saved (1820 records). [2025-09-29T02:20:17.895265] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-29T02:20:17.898013] [INFO ] [MAIN ] Derivative Progress: 1473/2211 symbols completed. OEC took 1.3s. Estimated remaining: 5m 11s. Rate: 142.3 symbols/min [2025-09-29T02:20:17.898379] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:17.985300] [DEBUG] [LOCAL ] OGE: Loaded 47046 existing records from primary storage. [2025-09-29T02:20:17.985592] [INFO ] [MAIN ] OGE: Loaded 47046 primary data records. [2025-09-29T02:20:17.986724] [DEBUG] [LOCAL ] OGS: Loaded 34591 existing records from primary storage. [2025-09-29T02:20:18.000051] [INFO ] [MAIN ] OGS: Loaded 34591 primary data records. [2025-09-29T02:20:18.191967] [DEBUG] [LOCAL ] OGN: Loaded 53882 existing records from primary storage. [2025-09-29T02:20:18.244892] [INFO ] [MAIN ] OGN: Loaded 53882 primary data records. [2025-09-29T02:20:18.999800] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:19.001235] [INFO ] [MAIN ] OGE: Generated 1820 derivative records from 47046 primary records. [2025-09-29T02:20:19.001507] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-29T02:20:19.109610] [DEBUG] [LOCAL ] OGE: Derivative data saved (1820 records). [2025-09-29T02:20:19.112570] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-29T02:20:19.119922] [INFO ] [MAIN ] Derivative Progress: 1474/2211 symbols completed. OGE took 1.3s. Estimated remaining: 5m 11s. Rate: 142.1 symbols/min [2025-09-29T02:20:19.133061] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:19.134283] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:19.135823] [INFO ] [MAIN ] OGS: Generated 1820 derivative records from 34591 primary records. [2025-09-29T02:20:19.136063] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-29T02:20:19.156073] [DEBUG] [LOCAL ] OGS: Derivative data saved (1820 records). [2025-09-29T02:20:19.156267] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-29T02:20:19.159562] [INFO ] [MAIN ] Derivative Progress: 1475/2211 symbols completed. OGS took 1.3s. Estimated remaining: 5m 10s. Rate: 142.2 symbols/min [2025-09-29T02:20:19.159882] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:19.180462] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:19.181390] [INFO ] [MAIN ] OGN: Generated 1820 derivative records from 53882 primary records. [2025-09-29T02:20:19.181500] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-29T02:20:19.198912] [DEBUG] [LOCAL ] OGN: Derivative data saved (1820 records). [2025-09-29T02:20:19.199114] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-29T02:20:19.202325] [INFO ] [MAIN ] Derivative Progress: 1476/2211 symbols completed. OGN took 1.3s. Estimated remaining: 5m 10s. Rate: 142.3 symbols/min [2025-09-29T02:20:19.202537] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:19.254528] [DEBUG] [LOCAL ] OHI: Loaded 52824 existing records from primary storage. [2025-09-29T02:20:19.254883] [INFO ] [MAIN ] OHI: Loaded 52824 primary data records. [2025-09-29T02:20:19.333527] [DEBUG] [LOCAL ] OIA: Loaded 14218 existing records from primary storage. [2025-09-29T02:20:19.357178] [INFO ] [MAIN ] OIA: Loaded 14218 primary data records. [2025-09-29T02:20:19.456772] [DEBUG] [LOCAL ] OI: Loaded 48011 existing records from primary storage. [2025-09-29T02:20:19.515804] [INFO ] [MAIN ] OI: Loaded 48011 primary data records. [2025-09-29T02:20:20.353453] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:20.357309] [INFO ] [MAIN ] OHI: Generated 1820 derivative records from 52824 primary records. [2025-09-29T02:20:20.357986] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-29T02:20:20.373270] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:20.386052] [INFO ] [MAIN ] OIA: Generated 1820 derivative records from 14218 primary records. [2025-09-29T02:20:20.386395] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-29T02:20:20.407180] [DEBUG] [LOCAL ] OIA: Derivative data saved (1820 records). [2025-09-29T02:20:20.405920] [DEBUG] [LOCAL ] OHI: Derivative data saved (1820 records). [2025-09-29T02:20:20.407711] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-29T02:20:20.407536] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-29T02:20:20.410268] [INFO ] [MAIN ] Derivative Progress: 1477/2211 symbols completed. OHI took 1.3s. Estimated remaining: 5m 10s. Rate: 142.1 symbols/min [2025-09-29T02:20:20.410631] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:20.413707] [INFO ] [MAIN ] Derivative Progress: 1478/2211 symbols completed. OIA took 1.2s. Estimated remaining: 5m 9s. Rate: 142.2 symbols/min [2025-09-29T02:20:20.414710] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:20.431441] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:20.432270] [INFO ] [MAIN ] OI: Generated 1820 derivative records from 48011 primary records. [2025-09-29T02:20:20.432510] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-29T02:20:20.450330] [DEBUG] [LOCAL ] OI: Derivative data saved (1820 records). [2025-09-29T02:20:20.450492] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-29T02:20:20.455145] [INFO ] [MAIN ] Derivative Progress: 1479/2211 symbols completed. OI took 1.3s. Estimated remaining: 5m 9s. Rate: 142.3 symbols/min [2025-09-29T02:20:20.456525] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:20.513393] [DEBUG] [LOCAL ] OII: Loaded 43406 existing records from primary storage. [2025-09-29T02:20:20.513847] [INFO ] [MAIN ] OII: Loaded 43406 primary data records. [2025-09-29T02:20:20.537828] [DEBUG] [LOCAL ] OIS: Loaded 41135 existing records from primary storage. [2025-09-29T02:20:20.567593] [INFO ] [MAIN ] OIS: Loaded 41135 primary data records. [2025-09-29T02:20:20.914468] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-29T02:20:21.021703] [INFO ] [MAIN ] OKE: Loaded 54316 primary data records. [2025-09-29T02:20:21.591852] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:21.593823] [INFO ] [MAIN ] OII: Generated 1820 derivative records from 43406 primary records. [2025-09-29T02:20:21.594457] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-29T02:20:21.617312] [DEBUG] [LOCAL ] OII: Derivative data saved (1820 records). [2025-09-29T02:20:21.617710] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-29T02:20:21.620277] [INFO ] [MAIN ] Derivative Progress: 1480/2211 symbols completed. OII took 1.2s. Estimated remaining: 5m 9s. Rate: 142.2 symbols/min [2025-09-29T02:20:21.620870] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:21.636480] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:21.637709] [INFO ] [MAIN ] OIS: Generated 1820 derivative records from 41135 primary records. [2025-09-29T02:20:21.638024] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-29T02:20:21.658924] [DEBUG] [LOCAL ] OIS: Derivative data saved (1820 records). [2025-09-29T02:20:21.672167] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-29T02:20:21.675504] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:21.674971] [INFO ] [MAIN ] Derivative Progress: 1481/2211 symbols completed. OIS took 1.3s. Estimated remaining: 5m 8s. Rate: 142.2 symbols/min [2025-09-29T02:20:21.675887] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:21.677075] [INFO ] [MAIN ] OKE: Generated 1820 derivative records from 54316 primary records. [2025-09-29T02:20:21.677257] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-29T02:20:21.694681] [DEBUG] [LOCAL ] OKE: Derivative data saved (1820 records). [2025-09-29T02:20:21.694947] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-29T02:20:21.697685] [INFO ] [MAIN ] Derivative Progress: 1482/2211 symbols completed. OKE took 1.2s. Estimated remaining: 5m 7s. Rate: 142.3 symbols/min [2025-09-29T02:20:21.698097] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:21.730882] [DEBUG] [LOCAL ] OLP: Loaded 9963 existing records from primary storage. [2025-09-29T02:20:21.731187] [INFO ] [MAIN ] OLP: Loaded 9963 primary data records. [2025-09-29T02:20:21.882389] [DEBUG] [LOCAL ] OKLO: Loaded 54599 existing records from primary storage. [2025-09-29T02:20:21.888295] [INFO ] [MAIN ] OKLO: Loaded 54599 primary data records. [2025-09-29T02:20:22.087088] [DEBUG] [LOCAL ] OLN: Loaded 52512 existing records from primary storage. [2025-09-29T02:20:22.278003] [INFO ] [MAIN ] OLN: Loaded 52512 primary data records. [2025-09-29T02:20:22.838448] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:22.840182] [INFO ] [MAIN ] OLP: Generated 1820 derivative records from 9963 primary records. [2025-09-29T02:20:22.840687] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-29T02:20:22.862745] [DEBUG] [LOCAL ] OLP: Derivative data saved (1820 records). [2025-09-29T02:20:22.865355] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-29T02:20:22.869040] [INFO ] [MAIN ] Derivative Progress: 1483/2211 symbols completed. OLP took 1.2s. Estimated remaining: 5m 7s. Rate: 142.2 symbols/min [2025-09-29T02:20:22.889411] [DEBUG] [MAIN ] OKLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:22.890999] [INFO ] [MAIN ] OKLO: Generated 1820 derivative records from 54599 primary records. [2025-09-29T02:20:22.891258] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-09-29T02:20:22.913941] [DEBUG] [LOCAL ] OKLO: Derivative data saved (1820 records). [2025-09-29T02:20:22.914334] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-09-29T02:20:22.918063] [INFO ] [MAIN ] Derivative Progress: 1484/2211 symbols completed. OKLO took 1.3s. Estimated remaining: 5m 7s. Rate: 142.2 symbols/min [2025-09-29T02:20:22.931822] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:22.932752] [INFO ] [MAIN ] OLN: Generated 1820 derivative records from 52512 primary records. [2025-09-29T02:20:22.932848] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-29T02:20:22.949685] [DEBUG] [LOCAL ] OLN: Derivative data saved (1820 records). [2025-09-29T02:20:22.949849] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-29T02:20:22.953457] [INFO ] [MAIN ] Derivative Progress: 1485/2211 symbols completed. OLN took 1.3s. Estimated remaining: 5m 6s. Rate: 142.3 symbols/min [2025-09-29T02:20:22.954021] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:22.954150] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:22.954194] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:23.050328] [DEBUG] [LOCAL ] OMI: Loaded 46583 existing records from primary storage. [2025-09-29T02:20:23.051284] [DEBUG] [LOCAL ] OMF: Loaded 46898 existing records from primary storage. [2025-09-29T02:20:23.051480] [INFO ] [MAIN ] OMI: Loaded 46583 primary data records. [2025-09-29T02:20:23.051781] [INFO ] [MAIN ] OMF: Loaded 46898 primary data records. [2025-09-29T02:20:23.276724] [DEBUG] [LOCAL ] OMC: Loaded 54068 existing records from primary storage. [2025-09-29T02:20:23.293063] [INFO ] [MAIN ] OMC: Loaded 54068 primary data records. [2025-09-29T02:20:24.225976] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:24.227945] [INFO ] [MAIN ] OMI: Generated 1820 derivative records from 46583 primary records. [2025-09-29T02:20:24.228685] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-29T02:20:24.245760] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:24.258453] [INFO ] [MAIN ] OMF: Generated 1820 derivative records from 46898 primary records. [2025-09-29T02:20:24.263636] [DEBUG] [LOCAL ] OMI: Derivative data saved (1820 records). [2025-09-29T02:20:24.263791] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-29T02:20:24.263867] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-29T02:20:24.266739] [INFO ] [MAIN ] Derivative Progress: 1486/2211 symbols completed. OMI took 1.3s. Estimated remaining: 5m 6s. Rate: 142.1 symbols/min [2025-09-29T02:20:24.267938] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:24.292004] [DEBUG] [LOCAL ] OMF: Derivative data saved (1820 records). [2025-09-29T02:20:24.293560] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-29T02:20:24.296472] [INFO ] [MAIN ] Derivative Progress: 1487/2211 symbols completed. OMF took 1.3s. Estimated remaining: 5m 5s. Rate: 142.2 symbols/min [2025-09-29T02:20:24.311480] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:24.309559] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:24.316317] [DEBUG] [LOCAL ] ONIT: Loaded 7871 existing records from primary storage. [2025-09-29T02:20:24.317241] [INFO ] [MAIN ] OMC: Generated 1820 derivative records from 54068 primary records. [2025-09-29T02:20:24.317560] [INFO ] [MAIN ] ONIT: Loaded 7871 primary data records. [2025-09-29T02:20:24.317726] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-29T02:20:24.540224] [DEBUG] [LOCAL ] OMC: Derivative data saved (1820 records). [2025-09-29T02:20:24.579943] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-29T02:20:24.582488] [DEBUG] [LOCAL ] ONL: Loaded 31806 existing records from primary storage. [2025-09-29T02:20:24.606806] [INFO ] [MAIN ] Derivative Progress: 1488/2211 symbols completed. OMC took 1.7s. Estimated remaining: 5m 5s. Rate: 142.2 symbols/min [2025-09-29T02:20:24.610559] [INFO ] [MAIN ] ONL: Loaded 31806 primary data records. [2025-09-29T02:20:24.610827] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:25.118470] [DEBUG] [LOCAL ] ONON: Loaded 54392 existing records from primary storage. [2025-09-29T02:20:25.120179] [INFO ] [MAIN ] ONON: Loaded 54392 primary data records. [2025-09-29T02:20:25.262830] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:25.290390] [INFO ] [MAIN ] ONIT: Generated 1820 derivative records from 7871 primary records. [2025-09-29T02:20:25.325902] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-29T02:20:25.499926] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1820 records). [2025-09-29T02:20:25.501302] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-29T02:20:25.504381] [INFO ] [MAIN ] Derivative Progress: 1489/2211 symbols completed. ONIT took 1.2s. Estimated remaining: 5m 5s. Rate: 142.1 symbols/min [2025-09-29T02:20:25.505130] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:25.529426] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:25.530819] [INFO ] [MAIN ] ONL: Generated 1820 derivative records from 31806 primary records. [2025-09-29T02:20:25.531490] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-29T02:20:25.562408] [DEBUG] [LOCAL ] ONL: Derivative data saved (1820 records). [2025-09-29T02:20:25.562924] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-29T02:20:25.565860] [INFO ] [MAIN ] Derivative Progress: 1490/2211 symbols completed. ONL took 1.3s. Estimated remaining: 5m 4s. Rate: 142.2 symbols/min [2025-09-29T02:20:25.566630] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:25.583412] [DEBUG] [LOCAL ] ONTF: Loaded 23187 existing records from primary storage. [2025-09-29T02:20:25.584160] [INFO ] [MAIN ] ONTF: Loaded 23187 primary data records. [2025-09-29T02:20:25.612216] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:25.639191] [INFO ] [MAIN ] ONON: Generated 1820 derivative records from 54392 primary records. [2025-09-29T02:20:25.682269] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-29T02:20:25.770524] [DEBUG] [LOCAL ] ONON: Derivative data saved (1820 records). [2025-09-29T02:20:25.820426] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-29T02:20:25.824344] [INFO ] [MAIN ] Derivative Progress: 1491/2211 symbols completed. ONON took 1.2s. Estimated remaining: 5m 4s. Rate: 142.3 symbols/min [2025-09-29T02:20:25.846763] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:25.990550] [DEBUG] [LOCAL ] ONTO: Loaded 47339 existing records from primary storage. [2025-09-29T02:20:25.990924] [INFO ] [MAIN ] ONTO: Loaded 47339 primary data records. [2025-09-29T02:20:26.130561] [DEBUG] [LOCAL ] OOMA: Loaded 19260 existing records from primary storage. [2025-09-29T02:20:26.135813] [INFO ] [MAIN ] OOMA: Loaded 19260 primary data records. [2025-09-29T02:20:26.764853] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:26.766223] [INFO ] [MAIN ] ONTF: Generated 1820 derivative records from 23187 primary records. [2025-09-29T02:20:26.766533] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-29T02:20:26.788103] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1820 records). [2025-09-29T02:20:26.788728] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-29T02:20:26.791521] [INFO ] [MAIN ] Derivative Progress: 1492/2211 symbols completed. ONTF took 1.3s. Estimated remaining: 5m 4s. Rate: 142.1 symbols/min [2025-09-29T02:20:26.792493] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:26.813767] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:26.815308] [INFO ] [MAIN ] ONTO: Generated 1820 derivative records from 47339 primary records. [2025-09-29T02:20:26.815471] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-29T02:20:26.839773] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1820 records). [2025-09-29T02:20:26.843043] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-29T02:20:26.845911] [INFO ] [MAIN ] Derivative Progress: 1493/2211 symbols completed. ONTO took 1.3s. Estimated remaining: 5m 3s. Rate: 142.2 symbols/min [2025-09-29T02:20:26.853679] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:26.863961] [DEBUG] [LOCAL ] OPAD: Loaded 20793 existing records from primary storage. [2025-09-29T02:20:26.869964] [INFO ] [MAIN ] OPAD: Loaded 20793 primary data records. [2025-09-29T02:20:26.870333] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:26.895785] [INFO ] [MAIN ] OOMA: Generated 1820 derivative records from 19260 primary records. [2025-09-29T02:20:26.908197] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-29T02:20:27.075253] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1820 records). [2025-09-29T02:20:27.122451] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-29T02:20:27.236918] [INFO ] [MAIN ] Derivative Progress: 1494/2211 symbols completed. OOMA took 1.4s. Estimated remaining: 5m 2s. Rate: 142.2 symbols/min [2025-09-29T02:20:27.267635] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:27.271902] [DEBUG] [LOCAL ] OPFI: Loaded 47258 existing records from primary storage. [2025-09-29T02:20:27.272767] [INFO ] [MAIN ] OPFI: Loaded 47258 primary data records. [2025-09-29T02:20:27.382459] [DEBUG] [LOCAL ] OPP: Loaded 11678 existing records from primary storage. [2025-09-29T02:20:27.396121] [INFO ] [MAIN ] OPP: Loaded 11678 primary data records. [2025-09-29T02:20:27.989125] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:27.991324] [INFO ] [MAIN ] OPAD: Generated 1820 derivative records from 20793 primary records. [2025-09-29T02:20:27.991793] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-29T02:20:28.011049] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1820 records). [2025-09-29T02:20:28.012589] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-29T02:20:28.015214] [INFO ] [MAIN ] Derivative Progress: 1495/2211 symbols completed. OPAD took 1.2s. Estimated remaining: 5m 2s. Rate: 142.1 symbols/min [2025-09-29T02:20:28.015564] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:28.037977] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:28.046606] [INFO ] [MAIN ] OPFI: Generated 1820 derivative records from 47258 primary records. [2025-09-29T02:20:28.051708] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-29T02:20:28.052052] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:28.052899] [INFO ] [MAIN ] OPP: Generated 1820 derivative records from 11678 primary records. [2025-09-29T02:20:28.052995] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-29T02:20:28.086892] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1820 records). [2025-09-29T02:20:28.087127] [DEBUG] [LOCAL ] OPP: Derivative data saved (1820 records). [2025-09-29T02:20:28.087450] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-29T02:20:28.087348] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-29T02:20:28.100340] [INFO ] [MAIN ] Derivative Progress: 1496/2211 symbols completed. OPP took 0.8s. Estimated remaining: 5m 2s. Rate: 142.2 symbols/min [2025-09-29T02:20:28.103893] [INFO ] [MAIN ] Derivative Progress: 1497/2211 symbols completed. OPFI took 1.2s. Estimated remaining: 5m 1s. Rate: 142.3 symbols/min [2025-09-29T02:20:28.103809] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:28.104224] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:28.128320] [DEBUG] [LOCAL ] OR: Loaded 46786 existing records from primary storage. [2025-09-29T02:20:28.128682] [INFO ] [MAIN ] OR: Loaded 46786 primary data records. [2025-09-29T02:20:28.347860] [DEBUG] [LOCAL ] ORA: Loaded 33001 existing records from primary storage. [2025-09-29T02:20:28.493372] [INFO ] [MAIN ] ORA: Loaded 33001 primary data records. [2025-09-29T02:20:28.587999] [DEBUG] [LOCAL ] ORC: Loaded 53083 existing records from primary storage. [2025-09-29T02:20:28.626940] [INFO ] [MAIN ] ORC: Loaded 53083 primary data records. [2025-09-29T02:20:29.281300] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:29.283537] [INFO ] [MAIN ] OR: Generated 1820 derivative records from 46786 primary records. [2025-09-29T02:20:29.283629] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-29T02:20:29.304321] [DEBUG] [LOCAL ] OR: Derivative data saved (1820 records). [2025-09-29T02:20:29.305613] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-29T02:20:29.309455] [INFO ] [MAIN ] Derivative Progress: 1498/2211 symbols completed. OR took 1.3s. Estimated remaining: 5m 1s. Rate: 142.1 symbols/min [2025-09-29T02:20:29.330185] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:29.331845] [INFO ] [MAIN ] ORA: Generated 1820 derivative records from 33001 primary records. [2025-09-29T02:20:29.332248] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-29T02:20:29.350622] [DEBUG] [LOCAL ] ORA: Derivative data saved (1820 records). [2025-09-29T02:20:29.350945] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-29T02:20:29.354856] [INFO ] [MAIN ] Derivative Progress: 1499/2211 symbols completed. ORA took 1.3s. Estimated remaining: 5m 0s. Rate: 142.2 symbols/min [2025-09-29T02:20:29.370584] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:29.371378] [INFO ] [MAIN ] ORC: Generated 1820 derivative records from 53083 primary records. [2025-09-29T02:20:29.371467] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-29T02:20:29.387238] [DEBUG] [LOCAL ] ORC: Derivative data saved (1820 records). [2025-09-29T02:20:29.387353] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-29T02:20:29.391696] [INFO ] [MAIN ] Derivative Progress: 1500/2211 symbols completed. ORC took 1.3s. Estimated remaining: 4m 60s. Rate: 142.3 symbols/min [2025-09-29T02:20:29.392239] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:29.392355] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:29.392438] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:29.432600] [DEBUG] [LOCAL ] ORN: Loaded 31979 existing records from primary storage. [2025-09-29T02:20:29.432996] [INFO ] [MAIN ] ORN: Loaded 31979 primary data records. [2025-09-29T02:20:29.828213] [DEBUG] [LOCAL ] OTIS: Loaded 53481 existing records from primary storage. [2025-09-29T02:20:29.828568] [INFO ] [MAIN ] OTIS: Loaded 53481 primary data records. [2025-09-29T02:20:29.835155] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-09-29T02:20:29.854995] [INFO ] [MAIN ] OSCR: Loaded 54502 primary data records. [2025-09-29T02:20:30.548800] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:30.549782] [INFO ] [MAIN ] ORN: Generated 1820 derivative records from 31979 primary records. [2025-09-29T02:20:30.550522] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-29T02:20:30.573491] [DEBUG] [LOCAL ] ORN: Derivative data saved (1820 records). [2025-09-29T02:20:30.574110] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-29T02:20:30.578560] [INFO ] [MAIN ] Derivative Progress: 1501/2211 symbols completed. ORN took 1.2s. Estimated remaining: 4m 60s. Rate: 142.1 symbols/min [2025-09-29T02:20:30.580675] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:30.602530] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:30.603486] [INFO ] [MAIN ] OTIS: Generated 1820 derivative records from 53481 primary records. [2025-09-29T02:20:30.603803] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-29T02:20:30.636668] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:30.641000] [INFO ] [MAIN ] OSCR: Generated 1820 derivative records from 54502 primary records. [2025-09-29T02:20:30.639637] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1820 records). [2025-09-29T02:20:30.641216] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-29T02:20:30.641317] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-29T02:20:30.645279] [INFO ] [MAIN ] Derivative Progress: 1502/2211 symbols completed. OTIS took 1.3s. Estimated remaining: 4m 59s. Rate: 142.2 symbols/min [2025-09-29T02:20:30.645726] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:30.678751] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1820 records). [2025-09-29T02:20:30.678954] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-29T02:20:30.683287] [INFO ] [MAIN ] Derivative Progress: 1503/2211 symbols completed. OSCR took 1.3s. Estimated remaining: 4m 59s. Rate: 142.3 symbols/min [2025-09-29T02:20:30.683705] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:30.709763] [DEBUG] [LOCAL ] OUT: Loaded 48630 existing records from primary storage. [2025-09-29T02:20:30.710788] [INFO ] [MAIN ] OUT: Loaded 48630 primary data records. [2025-09-29T02:20:31.152378] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-09-29T02:20:31.171629] [INFO ] [MAIN ] OVV: Loaded 54295 primary data records. [2025-09-29T02:20:31.224691] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-09-29T02:20:31.263368] [INFO ] [MAIN ] OWL: Loaded 54335 primary data records. [2025-09-29T02:20:31.909347] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:31.911304] [INFO ] [MAIN ] OUT: Generated 1820 derivative records from 48630 primary records. [2025-09-29T02:20:31.911819] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-29T02:20:31.934752] [DEBUG] [LOCAL ] OUT: Derivative data saved (1820 records). [2025-09-29T02:20:31.935190] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-29T02:20:31.938998] [INFO ] [MAIN ] Derivative Progress: 1504/2211 symbols completed. OUT took 1.4s. Estimated remaining: 4m 58s. Rate: 142.1 symbols/min [2025-09-29T02:20:31.939500] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:31.961757] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:31.965927] [INFO ] [MAIN ] OVV: Generated 1820 derivative records from 54295 primary records. [2025-09-29T02:20:31.966039] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-29T02:20:31.984514] [DEBUG] [LOCAL ] OWLT: Loaded 9099 existing records from primary storage. [2025-09-29T02:20:31.990157] [DEBUG] [LOCAL ] OVV: Derivative data saved (1820 records). [2025-09-29T02:20:31.991279] [INFO ] [MAIN ] OWLT: Loaded 9099 primary data records. [2025-09-29T02:20:31.991506] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-29T02:20:31.999620] [INFO ] [MAIN ] Derivative Progress: 1505/2211 symbols completed. OVV took 1.4s. Estimated remaining: 4m 58s. Rate: 142.2 symbols/min [2025-09-29T02:20:32.020725] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:32.104779] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:32.126359] [INFO ] [MAIN ] OWL: Generated 1820 derivative records from 54335 primary records. [2025-09-29T02:20:32.136369] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-29T02:20:32.374111] [DEBUG] [LOCAL ] OWL: Derivative data saved (1820 records). [2025-09-29T02:20:32.374567] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-29T02:20:32.378055] [INFO ] [MAIN ] Derivative Progress: 1506/2211 symbols completed. OWL took 1.7s. Estimated remaining: 4m 57s. Rate: 142.2 symbols/min [2025-09-29T02:20:32.378534] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:32.399367] [DEBUG] [LOCAL ] OXM: Loaded 33928 existing records from primary storage. [2025-09-29T02:20:32.400782] [INFO ] [MAIN ] OXM: Loaded 33928 primary data records. [2025-09-29T02:20:32.781139] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:32.794439] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-29T02:20:32.796035] [INFO ] [MAIN ] OWLT: Generated 1820 derivative records from 9099 primary records. [2025-09-29T02:20:32.796421] [INFO ] [MAIN ] PAAS: Loaded 54383 primary data records. [2025-09-29T02:20:32.796869] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-29T02:20:32.931025] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1820 records). [2025-09-29T02:20:32.946474] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-29T02:20:32.964481] [INFO ] [MAIN ] Derivative Progress: 1507/2211 symbols completed. OWLT took 1.0s. Estimated remaining: 4m 57s. Rate: 142.2 symbols/min [2025-09-29T02:20:33.034638] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:33.236191] [DEBUG] [LOCAL ] PAC: Loaded 11725 existing records from primary storage. [2025-09-29T02:20:33.237726] [INFO ] [MAIN ] PAC: Loaded 11725 primary data records. [2025-09-29T02:20:33.302686] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:33.341046] [INFO ] [MAIN ] OXM: Generated 1820 derivative records from 33928 primary records. [2025-09-29T02:20:33.379636] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-29T02:20:33.520145] [DEBUG] [LOCAL ] OXM: Derivative data saved (1820 records). [2025-09-29T02:20:33.660508] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:33.659936] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-29T02:20:33.663633] [INFO ] [MAIN ] Derivative Progress: 1508/2211 symbols completed. OXM took 1.6s. Estimated remaining: 4m 57s. Rate: 142.1 symbols/min [2025-09-29T02:20:33.663859] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:33.665202] [INFO ] [MAIN ] PAAS: Generated 1820 derivative records from 54383 primary records. [2025-09-29T02:20:33.666214] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-29T02:20:33.686092] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1820 records). [2025-09-29T02:20:33.687049] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-29T02:20:33.690811] [INFO ] [MAIN ] Derivative Progress: 1509/2211 symbols completed. PAAS took 1.3s. Estimated remaining: 4m 56s. Rate: 142.2 symbols/min [2025-09-29T02:20:33.691156] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:33.725728] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:33.726755] [INFO ] [MAIN ] PAC: Generated 1820 derivative records from 11725 primary records. [2025-09-29T02:20:33.737131] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-29T02:20:33.755897] [DEBUG] [LOCAL ] PACK: Loaded 32471 existing records from primary storage. [2025-09-29T02:20:33.760274] [INFO ] [MAIN ] PACK: Loaded 32471 primary data records. [2025-09-29T02:20:33.777432] [DEBUG] [LOCAL ] PAC: Derivative data saved (1820 records). [2025-09-29T02:20:33.818531] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-29T02:20:33.863070] [INFO ] [MAIN ] Derivative Progress: 1510/2211 symbols completed. PAC took 0.8s. Estimated remaining: 4m 56s. Rate: 142.2 symbols/min [2025-09-29T02:20:33.896546] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:33.874711] [DEBUG] [LOCAL ] PACS: Loaded 34761 existing records from primary storage. [2025-09-29T02:20:33.897348] [INFO ] [MAIN ] PACS: Loaded 34761 primary data records. [2025-09-29T02:20:34.366783] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-29T02:20:34.458458] [INFO ] [MAIN ] PAG: Loaded 22217 primary data records. [2025-09-29T02:20:34.831968] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:34.835515] [INFO ] [MAIN ] PACK: Generated 1820 derivative records from 32471 primary records. [2025-09-29T02:20:34.843683] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-29T02:20:34.850776] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:34.863224] [INFO ] [MAIN ] PACS: Generated 1820 derivative records from 34761 primary records. [2025-09-29T02:20:34.868114] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-29T02:20:34.871537] [DEBUG] [LOCAL ] PACK: Derivative data saved (1820 records). [2025-09-29T02:20:34.872709] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-29T02:20:34.875304] [INFO ] [MAIN ] Derivative Progress: 1511/2211 symbols completed. PACK took 1.2s. Estimated remaining: 4m 56s. Rate: 142.1 symbols/min [2025-09-29T02:20:34.875758] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:34.898405] [DEBUG] [LOCAL ] PACS: Derivative data saved (1820 records). [2025-09-29T02:20:34.899795] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-29T02:20:34.903779] [INFO ] [MAIN ] Derivative Progress: 1512/2211 symbols completed. PACS took 1.2s. Estimated remaining: 4m 55s. Rate: 142.2 symbols/min [2025-09-29T02:20:34.917951] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:34.918628] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:34.920503] [INFO ] [MAIN ] PAG: Generated 1820 derivative records from 22217 primary records. [2025-09-29T02:20:34.920890] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-29T02:20:34.948193] [DEBUG] [LOCAL ] PAI: Loaded 2758 existing records from primary storage. [2025-09-29T02:20:34.949425] [DEBUG] [LOCAL ] PAG: Derivative data saved (1820 records). [2025-09-29T02:20:34.949987] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-29T02:20:34.952850] [INFO ] [MAIN ] Derivative Progress: 1513/2211 symbols completed. PAG took 1.1s. Estimated remaining: 4m 54s. Rate: 142.3 symbols/min [2025-09-29T02:20:34.949847] [INFO ] [MAIN ] PAI: Loaded 2758 primary data records. [2025-09-29T02:20:35.176438] [DEBUG] [LOCAL ] PAGS: Loaded 53447 existing records from primary storage. [2025-09-29T02:20:35.194429] [INFO ] [MAIN ] PAGS: Loaded 53447 primary data records. [2025-09-29T02:20:35.748829] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:35.750610] [INFO ] [MAIN ] PAI: Generated 1820 derivative records from 2758 primary records. [2025-09-29T02:20:35.750749] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-29T02:20:35.767630] [DEBUG] [LOCAL ] PAI: Derivative data saved (1820 records). [2025-09-29T02:20:35.768183] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-29T02:20:35.770355] [INFO ] [MAIN ] Derivative Progress: 1514/2211 symbols completed. PAI took 0.9s. Estimated remaining: 4m 54s. Rate: 142.2 symbols/min [2025-09-29T02:20:35.788522] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:35.789307] [INFO ] [MAIN ] PAGS: Generated 1820 derivative records from 53447 primary records. [2025-09-29T02:20:35.789394] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-29T02:20:35.805380] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1820 records). [2025-09-29T02:20:35.805522] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-29T02:20:35.808618] [INFO ] [MAIN ] Derivative Progress: 1515/2211 symbols completed. PAGS took 0.9s. Estimated remaining: 4m 53s. Rate: 142.3 symbols/min [2025-09-29T02:20:35.809361] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:35.809464] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:35.809528] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:35.857598] [DEBUG] [LOCAL ] PAM: Loaded 28420 existing records from primary storage. [2025-09-29T02:20:35.858154] [INFO ] [MAIN ] PAM: Loaded 28420 primary data records. [2025-09-29T02:20:35.984609] [DEBUG] [LOCAL ] PAR: Loaded 33188 existing records from primary storage. [2025-09-29T02:20:36.013538] [INFO ] [MAIN ] PAR: Loaded 33188 primary data records. [2025-09-29T02:20:36.071505] [DEBUG] [LOCAL ] PARR: Loaded 49062 existing records from primary storage. [2025-09-29T02:20:36.163682] [INFO ] [MAIN ] PARR: Loaded 49062 primary data records. [2025-09-29T02:20:36.998170] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:36.999718] [INFO ] [MAIN ] PAM: Generated 1820 derivative records from 28420 primary records. [2025-09-29T02:20:37.000206] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-29T02:20:37.037221] [DEBUG] [LOCAL ] PAM: Derivative data saved (1820 records). [2025-09-29T02:20:37.037421] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-29T02:20:37.035584] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:37.038401] [INFO ] [MAIN ] PAR: Generated 1820 derivative records from 33188 primary records. [2025-09-29T02:20:37.041346] [INFO ] [MAIN ] Derivative Progress: 1516/2211 symbols completed. PAM took 1.2s. Estimated remaining: 4m 53s. Rate: 142.1 symbols/min [2025-09-29T02:20:37.041521] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-29T02:20:37.042183] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:37.062239] [DEBUG] [LOCAL ] PAR: Derivative data saved (1820 records). [2025-09-29T02:20:37.062937] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-29T02:20:37.066209] [INFO ] [MAIN ] Derivative Progress: 1517/2211 symbols completed. PAR took 1.3s. Estimated remaining: 4m 53s. Rate: 142.2 symbols/min [2025-09-29T02:20:37.066813] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:37.086032] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:37.087105] [INFO ] [MAIN ] PARR: Generated 1820 derivative records from 49062 primary records. [2025-09-29T02:20:37.087218] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-29T02:20:37.118267] [DEBUG] [LOCAL ] PARR: Derivative data saved (1820 records). [2025-09-29T02:20:37.118521] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-29T02:20:37.122192] [INFO ] [MAIN ] Derivative Progress: 1518/2211 symbols completed. PARR took 1.3s. Estimated remaining: 4m 52s. Rate: 142.3 symbols/min [2025-09-29T02:20:37.122712] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:37.137589] [DEBUG] [LOCAL ] PAXS: Loaded 21210 existing records from primary storage. [2025-09-29T02:20:37.137927] [INFO ] [MAIN ] PAXS: Loaded 21210 primary data records. [2025-09-29T02:20:37.345734] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-09-29T02:20:37.381215] [INFO ] [MAIN ] PATH: Loaded 54457 primary data records. [2025-09-29T02:20:37.447286] [DEBUG] [LOCAL ] PAY: Loaded 38892 existing records from primary storage. [2025-09-29T02:20:37.529760] [INFO ] [MAIN ] PAY: Loaded 38892 primary data records. [2025-09-29T02:20:38.554789] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:38.555673] [INFO ] [MAIN ] PAXS: Generated 1820 derivative records from 21210 primary records. [2025-09-29T02:20:38.555807] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-29T02:20:38.575262] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1820 records). [2025-09-29T02:20:38.577502] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-29T02:20:38.581744] [INFO ] [MAIN ] Derivative Progress: 1519/2211 symbols completed. PAXS took 1.5s. Estimated remaining: 4m 52s. Rate: 142.0 symbols/min [2025-09-29T02:20:38.584168] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:38.597150] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:38.598430] [INFO ] [MAIN ] PAY: Generated 1820 derivative records from 38892 primary records. [2025-09-29T02:20:38.598690] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-29T02:20:38.612272] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:38.613145] [INFO ] [MAIN ] PATH: Generated 1820 derivative records from 54457 primary records. [2025-09-29T02:20:38.613264] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-29T02:20:38.653273] [DEBUG] [LOCAL ] PAY: Derivative data saved (1820 records). [2025-09-29T02:20:38.652766] [DEBUG] [LOCAL ] PATH: Derivative data saved (1820 records). [2025-09-29T02:20:38.653450] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-29T02:20:38.657093] [INFO ] [MAIN ] Derivative Progress: 1520/2211 symbols completed. PAY took 1.5s. Estimated remaining: 4m 52s. Rate: 142.1 symbols/min [2025-09-29T02:20:38.653615] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-29T02:20:38.657548] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:38.661197] [INFO ] [MAIN ] Derivative Progress: 1521/2211 symbols completed. PATH took 1.6s. Estimated remaining: 4m 51s. Rate: 142.2 symbols/min [2025-09-29T02:20:38.661995] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:38.697151] [DEBUG] [LOCAL ] PAYC: Loaded 36903 existing records from primary storage. [2025-09-29T02:20:38.697390] [INFO ] [MAIN ] PAYC: Loaded 36903 primary data records. [2025-09-29T02:20:39.064046] [DEBUG] [LOCAL ] PB: Loaded 42025 existing records from primary storage. [2025-09-29T02:20:39.075837] [DEBUG] [LOCAL ] PBA: Loaded 49665 existing records from primary storage. [2025-09-29T02:20:39.074313] [INFO ] [MAIN ] PB: Loaded 42025 primary data records. [2025-09-29T02:20:39.076112] [INFO ] [MAIN ] PBA: Loaded 49665 primary data records. [2025-09-29T02:20:39.768965] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:39.771181] [INFO ] [MAIN ] PAYC: Generated 1820 derivative records from 36903 primary records. [2025-09-29T02:20:39.771476] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-29T02:20:39.793587] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1820 records). [2025-09-29T02:20:39.794110] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-29T02:20:39.797343] [INFO ] [MAIN ] Derivative Progress: 1522/2211 symbols completed. PAYC took 1.2s. Estimated remaining: 4m 51s. Rate: 142.1 symbols/min [2025-09-29T02:20:39.797891] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:39.821622] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:39.835987] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:39.836560] [INFO ] [MAIN ] PB: Generated 1820 derivative records from 42025 primary records. [2025-09-29T02:20:39.837776] [INFO ] [MAIN ] PBA: Generated 1820 derivative records from 49665 primary records. [2025-09-29T02:20:39.838079] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-29T02:20:39.837993] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-29T02:20:39.871432] [DEBUG] [LOCAL ] PBA: Derivative data saved (1820 records). [2025-09-29T02:20:39.872510] [DEBUG] [LOCAL ] PB: Derivative data saved (1820 records). [2025-09-29T02:20:39.873015] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-29T02:20:39.872928] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-29T02:20:39.876242] [INFO ] [MAIN ] Derivative Progress: 1523/2211 symbols completed. PB took 1.2s. Estimated remaining: 4m 50s. Rate: 142.1 symbols/min [2025-09-29T02:20:39.879986] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:39.880107] [INFO ] [MAIN ] Derivative Progress: 1524/2211 symbols completed. PBA took 1.2s. Estimated remaining: 4m 50s. Rate: 142.2 symbols/min [2025-09-29T02:20:39.880584] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:39.924568] [DEBUG] [LOCAL ] PBF: Loaded 53866 existing records from primary storage. [2025-09-29T02:20:39.924958] [INFO ] [MAIN ] PBF: Loaded 53866 primary data records. [2025-09-29T02:20:40.047515] [DEBUG] [LOCAL ] PBH: Loaded 32156 existing records from primary storage. [2025-09-29T02:20:40.077548] [INFO ] [MAIN ] PBH: Loaded 32156 primary data records. [2025-09-29T02:20:40.300543] [DEBUG] [LOCAL ] PBI: Loaded 50788 existing records from primary storage. [2025-09-29T02:20:40.314826] [INFO ] [MAIN ] PBI: Loaded 50788 primary data records. [2025-09-29T02:20:41.077151] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:41.078487] [INFO ] [MAIN ] PBF: Generated 1820 derivative records from 53866 primary records. [2025-09-29T02:20:41.078909] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-29T02:20:41.097433] [DEBUG] [LOCAL ] PBF: Derivative data saved (1820 records). [2025-09-29T02:20:41.098036] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-29T02:20:41.100917] [INFO ] [MAIN ] Derivative Progress: 1525/2211 symbols completed. PBF took 1.3s. Estimated remaining: 4m 50s. Rate: 142.0 symbols/min [2025-09-29T02:20:41.101314] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:41.120944] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:41.121871] [INFO ] [MAIN ] PBH: Generated 1820 derivative records from 32156 primary records. [2025-09-29T02:20:41.121972] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-29T02:20:41.143165] [DEBUG] [LOCAL ] PBH: Derivative data saved (1820 records). [2025-09-29T02:20:41.143583] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-29T02:20:41.161002] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:41.160505] [INFO ] [MAIN ] Derivative Progress: 1526/2211 symbols completed. PBH took 1.3s. Estimated remaining: 4m 49s. Rate: 142.1 symbols/min [2025-09-29T02:20:41.162136] [INFO ] [MAIN ] PBI: Generated 1820 derivative records from 50788 primary records. [2025-09-29T02:20:41.162552] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-29T02:20:41.162311] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:41.181900] [DEBUG] [LOCAL ] PBI: Derivative data saved (1820 records). [2025-09-29T02:20:41.182050] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-29T02:20:41.185011] [INFO ] [MAIN ] Derivative Progress: 1527/2211 symbols completed. PBI took 1.3s. Estimated remaining: 4m 49s. Rate: 142.2 symbols/min [2025-09-29T02:20:41.185271] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:41.205520] [DEBUG] [LOCAL ] PBT: Loaded 17533 existing records from primary storage. [2025-09-29T02:20:41.220026] [INFO ] [MAIN ] PBT: Loaded 17533 primary data records. [2025-09-29T02:20:41.252353] [DEBUG] [LOCAL ] PCF: Loaded 8720 existing records from primary storage. [2025-09-29T02:20:41.294864] [INFO ] [MAIN ] PCF: Loaded 8720 primary data records. [2025-09-29T02:20:41.449430] [DEBUG] [LOCAL ] PBR: Loaded 54492 existing records from primary storage. [2025-09-29T02:20:41.562409] [INFO ] [MAIN ] PBR: Loaded 54492 primary data records. [2025-09-29T02:20:42.385373] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:42.388108] [INFO ] [MAIN ] PBT: Generated 1820 derivative records from 17533 primary records. [2025-09-29T02:20:42.388804] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-29T02:20:42.403565] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:42.416322] [INFO ] [MAIN ] PCF: Generated 1820 derivative records from 8720 primary records. [2025-09-29T02:20:42.416553] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-29T02:20:42.422229] [DEBUG] [LOCAL ] PBT: Derivative data saved (1820 records). [2025-09-29T02:20:42.437920] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-29T02:20:42.438770] [DEBUG] [LOCAL ] PCF: Derivative data saved (1820 records). [2025-09-29T02:20:42.441826] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-29T02:20:42.441710] [INFO ] [MAIN ] Derivative Progress: 1528/2211 symbols completed. PBT took 1.3s. Estimated remaining: 4m 49s. Rate: 142.0 symbols/min [2025-09-29T02:20:42.444715] [INFO ] [MAIN ] Derivative Progress: 1529/2211 symbols completed. PCF took 1.3s. Estimated remaining: 4m 48s. Rate: 142.1 symbols/min [2025-09-29T02:20:42.457788] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:42.458400] [INFO ] [MAIN ] PBR: Generated 1820 derivative records from 54492 primary records. [2025-09-29T02:20:42.458483] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-29T02:20:42.474413] [DEBUG] [LOCAL ] PBR: Derivative data saved (1820 records). [2025-09-29T02:20:42.474500] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-29T02:20:42.477912] [INFO ] [MAIN ] Derivative Progress: 1530/2211 symbols completed. PBR took 1.4s. Estimated remaining: 4m 47s. Rate: 142.2 symbols/min [2025-09-29T02:20:42.478356] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:42.478425] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:42.478880] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:42.491266] [DEBUG] [LOCAL ] PCM: Loaded 6857 existing records from primary storage. [2025-09-29T02:20:42.491561] [INFO ] [MAIN ] PCM: Loaded 6857 primary data records. [2025-09-29T02:20:42.673491] [DEBUG] [LOCAL ] PCN: Loaded 24709 existing records from primary storage. [2025-09-29T02:20:42.722760] [INFO ] [MAIN ] PCN: Loaded 24709 primary data records. [2025-09-29T02:20:42.979467] [DEBUG] [LOCAL ] PCG: Loaded 54498 existing records from primary storage. [2025-09-29T02:20:43.029476] [INFO ] [MAIN ] PCG: Loaded 54498 primary data records. [2025-09-29T02:20:43.601858] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:43.614552] [INFO ] [MAIN ] PCM: Generated 1820 derivative records from 6857 primary records. [2025-09-29T02:20:43.615002] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-29T02:20:43.636895] [DEBUG] [LOCAL ] PCM: Derivative data saved (1820 records). [2025-09-29T02:20:43.637983] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-29T02:20:43.640555] [INFO ] [MAIN ] Derivative Progress: 1531/2211 symbols completed. PCM took 1.2s. Estimated remaining: 4m 47s. Rate: 142.0 symbols/min [2025-09-29T02:20:43.641285] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:43.665483] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:43.666410] [INFO ] [MAIN ] PCN: Generated 1820 derivative records from 24709 primary records. [2025-09-29T02:20:43.666812] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-29T02:20:43.686276] [DEBUG] [LOCAL ] PCN: Derivative data saved (1820 records). [2025-09-29T02:20:43.687887] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-29T02:20:43.691438] [INFO ] [MAIN ] Derivative Progress: 1532/2211 symbols completed. PCN took 1.2s. Estimated remaining: 4m 47s. Rate: 142.1 symbols/min [2025-09-29T02:20:43.691716] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:43.710365] [DEBUG] [MAIN ] PCG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:43.711251] [INFO ] [MAIN ] PCG: Generated 1820 derivative records from 54498 primary records. [2025-09-29T02:20:43.711594] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-09-29T02:20:43.744452] [DEBUG] [LOCAL ] PCG: Derivative data saved (1820 records). [2025-09-29T02:20:43.744760] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-09-29T02:20:43.748271] [INFO ] [MAIN ] Derivative Progress: 1533/2211 symbols completed. PCG took 1.3s. Estimated remaining: 4m 46s. Rate: 142.2 symbols/min [2025-09-29T02:20:43.755899] [DEBUG] [LOCAL ] PCQ: Loaded 12298 existing records from primary storage. [2025-09-29T02:20:43.756263] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:43.771312] [INFO ] [MAIN ] PCQ: Loaded 12298 primary data records. [2025-09-29T02:20:43.773082] [DEBUG] [LOCAL ] PCOR: Loaded 48849 existing records from primary storage. [2025-09-29T02:20:43.780707] [INFO ] [MAIN ] PCOR: Loaded 48849 primary data records. [2025-09-29T02:20:44.521576] [DEBUG] [LOCAL ] PD: Loaded 48580 existing records from primary storage. [2025-09-29T02:20:44.522051] [INFO ] [MAIN ] PD: Loaded 48580 primary data records. [2025-09-29T02:20:44.876926] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:44.882152] [INFO ] [MAIN ] PCOR: Generated 1820 derivative records from 48849 primary records. [2025-09-29T02:20:44.882805] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-29T02:20:44.897032] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:44.900005] [INFO ] [MAIN ] PCQ: Generated 1820 derivative records from 12298 primary records. [2025-09-29T02:20:44.911690] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-29T02:20:44.916035] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1820 records). [2025-09-29T02:20:44.918574] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-29T02:20:44.922084] [INFO ] [MAIN ] Derivative Progress: 1534/2211 symbols completed. PCOR took 1.3s. Estimated remaining: 4m 46s. Rate: 142.0 symbols/min [2025-09-29T02:20:44.933830] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:44.939241] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1820 records). [2025-09-29T02:20:44.939397] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-29T02:20:44.942363] [INFO ] [MAIN ] Derivative Progress: 1535/2211 symbols completed. PCQ took 1.3s. Estimated remaining: 4m 45s. Rate: 142.1 symbols/min [2025-09-29T02:20:44.942776] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:44.969411] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:44.971707] [INFO ] [MAIN ] PD: Generated 1820 derivative records from 48580 primary records. [2025-09-29T02:20:44.971822] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-29T02:20:44.989371] [DEBUG] [LOCAL ] PD: Derivative data saved (1820 records). [2025-09-29T02:20:44.989790] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-29T02:20:44.994082] [INFO ] [MAIN ] Derivative Progress: 1536/2211 symbols completed. PD took 1.2s. Estimated remaining: 4m 45s. Rate: 142.2 symbols/min [2025-09-29T02:20:44.994408] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:45.038881] [DEBUG] [LOCAL ] PDM: Loaded 40354 existing records from primary storage. [2025-09-29T02:20:45.039085] [INFO ] [MAIN ] PDM: Loaded 40354 primary data records. [2025-09-29T02:20:45.174576] [DEBUG] [LOCAL ] PDI: Loaded 50909 existing records from primary storage. [2025-09-29T02:20:45.201752] [INFO ] [MAIN ] PDI: Loaded 50909 primary data records. [2025-09-29T02:20:45.283221] [DEBUG] [LOCAL ] PDO: Loaded 32146 existing records from primary storage. [2025-09-29T02:20:45.308762] [INFO ] [MAIN ] PDO: Loaded 32146 primary data records. [2025-09-29T02:20:46.142144] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:46.146115] [INFO ] [MAIN ] PDM: Generated 1820 derivative records from 40354 primary records. [2025-09-29T02:20:46.146712] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-29T02:20:46.162172] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:46.181408] [DEBUG] [LOCAL ] PDM: Derivative data saved (1820 records). [2025-09-29T02:20:46.180296] [INFO ] [MAIN ] PDI: Generated 1820 derivative records from 50909 primary records. [2025-09-29T02:20:46.181531] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-29T02:20:46.181979] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-29T02:20:46.184635] [INFO ] [MAIN ] Derivative Progress: 1537/2211 symbols completed. PDM took 1.2s. Estimated remaining: 4m 45s. Rate: 142.0 symbols/min [2025-09-29T02:20:46.197728] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:46.199834] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:46.213068] [INFO ] [MAIN ] PDO: Generated 1820 derivative records from 32146 primary records. [2025-09-29T02:20:46.218317] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-29T02:20:46.218066] [DEBUG] [LOCAL ] PDI: Derivative data saved (1820 records). [2025-09-29T02:20:46.218497] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-29T02:20:46.222989] [INFO ] [MAIN ] Derivative Progress: 1538/2211 symbols completed. PDI took 1.3s. Estimated remaining: 4m 44s. Rate: 142.1 symbols/min [2025-09-29T02:20:46.223219] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:46.245562] [DEBUG] [LOCAL ] PDO: Derivative data saved (1820 records). [2025-09-29T02:20:46.245759] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-29T02:20:46.248937] [INFO ] [MAIN ] Derivative Progress: 1539/2211 symbols completed. PDO took 1.3s. Estimated remaining: 4m 44s. Rate: 142.2 symbols/min [2025-09-29T02:20:46.249368] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:46.263708] [DEBUG] [LOCAL ] PDS: Loaded 18297 existing records from primary storage. [2025-09-29T02:20:46.263988] [INFO ] [MAIN ] PDS: Loaded 18297 primary data records. [2025-09-29T02:20:46.387097] [DEBUG] [LOCAL ] PDT: Loaded 17549 existing records from primary storage. [2025-09-29T02:20:46.387290] [INFO ] [MAIN ] PDT: Loaded 17549 primary data records. [2025-09-29T02:20:46.400922] [DEBUG] [LOCAL ] PDX: Loaded 14514 existing records from primary storage. [2025-09-29T02:20:46.419954] [INFO ] [MAIN ] PDX: Loaded 14514 primary data records. [2025-09-29T02:20:47.400892] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:47.402276] [INFO ] [MAIN ] PDS: Generated 1820 derivative records from 18297 primary records. [2025-09-29T02:20:47.402414] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-29T02:20:47.416163] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:47.419517] [INFO ] [MAIN ] PDT: Generated 1820 derivative records from 17549 primary records. [2025-09-29T02:20:47.427921] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-29T02:20:47.458357] [DEBUG] [LOCAL ] PDS: Derivative data saved (1820 records). [2025-09-29T02:20:47.456798] [DEBUG] [LOCAL ] PDT: Derivative data saved (1820 records). [2025-09-29T02:20:47.458958] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-29T02:20:47.461660] [INFO ] [MAIN ] Derivative Progress: 1540/2211 symbols completed. PDS took 1.3s. Estimated remaining: 4m 43s. Rate: 142.0 symbols/min [2025-09-29T02:20:47.462103] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-29T02:20:47.464941] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:47.465350] [INFO ] [MAIN ] Derivative Progress: 1541/2211 symbols completed. PDT took 1.2s. Estimated remaining: 4m 43s. Rate: 142.1 symbols/min [2025-09-29T02:20:47.466072] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:47.488524] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:47.489458] [INFO ] [MAIN ] PDX: Generated 1820 derivative records from 14514 primary records. [2025-09-29T02:20:47.489621] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-29T02:20:47.506766] [DEBUG] [LOCAL ] PDX: Derivative data saved (1820 records). [2025-09-29T02:20:47.506891] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-29T02:20:47.511113] [INFO ] [MAIN ] Derivative Progress: 1542/2211 symbols completed. PDX took 1.3s. Estimated remaining: 4m 42s. Rate: 142.2 symbols/min [2025-09-29T02:20:47.511413] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:47.592283] [DEBUG] [LOCAL ] PEG: Loaded 53893 existing records from primary storage. [2025-09-29T02:20:47.594162] [INFO ] [MAIN ] PEG: Loaded 53893 primary data records. [2025-09-29T02:20:47.600840] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-09-29T02:20:47.645803] [INFO ] [MAIN ] PEB: Loaded 51448 primary data records. [2025-09-29T02:20:47.695338] [DEBUG] [LOCAL ] PEN: Loaded 30842 existing records from primary storage. [2025-09-29T02:20:47.741248] [INFO ] [MAIN ] PEN: Loaded 30842 primary data records. [2025-09-29T02:20:48.667897] [DEBUG] [MAIN ] PEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:48.669739] [INFO ] [MAIN ] PEG: Generated 1820 derivative records from 53893 primary records. [2025-09-29T02:20:48.669924] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-09-29T02:20:48.706602] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:48.708793] [INFO ] [MAIN ] PEB: Generated 1820 derivative records from 51448 primary records. [2025-09-29T02:20:48.707413] [DEBUG] [LOCAL ] PEG: Derivative data saved (1820 records). [2025-09-29T02:20:48.708943] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-29T02:20:48.710076] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-09-29T02:20:48.713528] [INFO ] [MAIN ] Derivative Progress: 1543/2211 symbols completed. PEG took 1.2s. Estimated remaining: 4m 42s. Rate: 142.0 symbols/min [2025-09-29T02:20:48.733563] [DEBUG] [LOCAL ] PEB: Derivative data saved (1820 records). [2025-09-29T02:20:48.733885] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-29T02:20:48.738176] [INFO ] [MAIN ] Derivative Progress: 1544/2211 symbols completed. PEB took 1.3s. Estimated remaining: 4m 42s. Rate: 142.1 symbols/min [2025-09-29T02:20:48.751748] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:48.752632] [INFO ] [MAIN ] PEN: Generated 1820 derivative records from 30842 primary records. [2025-09-29T02:20:48.752755] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-29T02:20:48.768530] [DEBUG] [LOCAL ] PEN: Derivative data saved (1820 records). [2025-09-29T02:20:48.768732] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-29T02:20:48.773092] [INFO ] [MAIN ] Derivative Progress: 1545/2211 symbols completed. PEN took 1.3s. Estimated remaining: 4m 41s. Rate: 142.2 symbols/min [2025-09-29T02:20:48.773738] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:48.773668] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:48.773843] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:48.786148] [DEBUG] [LOCAL ] PFD: Loaded 5199 existing records from primary storage. [2025-09-29T02:20:48.786515] [INFO ] [MAIN ] PFD: Loaded 5199 primary data records. [2025-09-29T02:20:48.893221] [DEBUG] [LOCAL ] PEO: Loaded 10999 existing records from primary storage. [2025-09-29T02:20:48.924600] [DEBUG] [LOCAL ] PERF: Loaded 14231 existing records from primary storage. [2025-09-29T02:20:48.924773] [INFO ] [MAIN ] PEO: Loaded 10999 primary data records. [2025-09-29T02:20:48.956397] [INFO ] [MAIN ] PERF: Loaded 14231 primary data records. [2025-09-29T02:20:49.912874] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:49.916343] [INFO ] [MAIN ] PFD: Generated 1820 derivative records from 5199 primary records. [2025-09-29T02:20:49.917371] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-29T02:20:49.939770] [DEBUG] [LOCAL ] PFD: Derivative data saved (1820 records). [2025-09-29T02:20:49.941610] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-29T02:20:49.944050] [INFO ] [MAIN ] Derivative Progress: 1546/2211 symbols completed. PFD took 1.2s. Estimated remaining: 4m 41s. Rate: 142.1 symbols/min [2025-09-29T02:20:49.944514] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:49.970863] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:49.972021] [INFO ] [MAIN ] PERF: Generated 1820 derivative records from 14231 primary records. [2025-09-29T02:20:49.971098] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:49.972143] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-29T02:20:49.972834] [INFO ] [MAIN ] PEO: Generated 1820 derivative records from 10999 primary records. [2025-09-29T02:20:49.972968] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-29T02:20:50.000949] [DEBUG] [LOCAL ] PEO: Derivative data saved (1820 records). [2025-09-29T02:20:50.004674] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-29T02:20:50.007384] [INFO ] [MAIN ] Derivative Progress: 1547/2211 symbols completed. PEO took 1.2s. Estimated remaining: 4m 40s. Rate: 142.1 symbols/min [2025-09-29T02:20:50.008451] [DEBUG] [LOCAL ] PERF: Derivative data saved (1820 records). [2025-09-29T02:20:50.007886] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:50.008627] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-29T02:20:50.011723] [INFO ] [MAIN ] Derivative Progress: 1548/2211 symbols completed. PERF took 1.2s. Estimated remaining: 4m 40s. Rate: 142.2 symbols/min [2025-09-29T02:20:50.012250] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:50.028481] [DEBUG] [LOCAL ] PFH: Loaded 6911 existing records from primary storage. [2025-09-29T02:20:50.028991] [INFO ] [MAIN ] PFH: Loaded 6911 primary data records. [2025-09-29T02:20:50.299063] [DEBUG] [LOCAL ] PFE: Loaded 54593 existing records from primary storage. [2025-09-29T02:20:50.442276] [INFO ] [MAIN ] PFE: Loaded 54593 primary data records. [2025-09-29T02:20:50.455727] [DEBUG] [LOCAL ] PFGC: Loaded 47650 existing records from primary storage. [2025-09-29T02:20:50.488991] [INFO ] [MAIN ] PFGC: Loaded 47650 primary data records. [2025-09-29T02:20:51.213879] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:51.215529] [INFO ] [MAIN ] PFH: Generated 1820 derivative records from 6911 primary records. [2025-09-29T02:20:51.215701] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-29T02:20:51.236312] [DEBUG] [LOCAL ] PFH: Derivative data saved (1820 records). [2025-09-29T02:20:51.236744] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-29T02:20:51.239408] [INFO ] [MAIN ] Derivative Progress: 1549/2211 symbols completed. PFH took 1.2s. Estimated remaining: 4m 40s. Rate: 142.0 symbols/min [2025-09-29T02:20:51.240561] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:51.276104] [DEBUG] [MAIN ] PFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:51.287783] [INFO ] [MAIN ] PFE: Generated 1820 derivative records from 54593 primary records. [2025-09-29T02:20:51.294364] [DEBUG] [LOCAL ] PFL: Loaded 13959 existing records from primary storage. [2025-09-29T02:20:51.294790] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:51.293933] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-09-29T02:20:51.295807] [INFO ] [MAIN ] PFL: Loaded 13959 primary data records. [2025-09-29T02:20:51.296873] [INFO ] [MAIN ] PFGC: Generated 1820 derivative records from 47650 primary records. [2025-09-29T02:20:51.305889] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-29T02:20:51.351898] [DEBUG] [LOCAL ] PFE: Derivative data saved (1820 records). [2025-09-29T02:20:51.397491] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-09-29T02:20:51.423974] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1820 records). [2025-09-29T02:20:51.427621] [INFO ] [MAIN ] Derivative Progress: 1550/2211 symbols completed. PFE took 1.5s. Estimated remaining: 4m 39s. Rate: 142.1 symbols/min [2025-09-29T02:20:51.463268] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-29T02:20:51.463405] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:51.477565] [INFO ] [MAIN ] Derivative Progress: 1551/2211 symbols completed. PFGC took 1.5s. Estimated remaining: 4m 39s. Rate: 142.2 symbols/min [2025-09-29T02:20:51.493860] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:51.714301] [DEBUG] [LOCAL ] PFN: Loaded 21992 existing records from primary storage. [2025-09-29T02:20:51.724740] [INFO ] [MAIN ] PFN: Loaded 21992 primary data records. [2025-09-29T02:20:51.870595] [DEBUG] [LOCAL ] PFLT: Loaded 44333 existing records from primary storage. [2025-09-29T02:20:51.881448] [INFO ] [MAIN ] PFLT: Loaded 44333 primary data records. [2025-09-29T02:20:51.880955] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:51.893060] [INFO ] [MAIN ] PFL: Generated 1820 derivative records from 13959 primary records. [2025-09-29T02:20:51.949173] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-29T02:20:52.250255] [DEBUG] [LOCAL ] PFL: Derivative data saved (1820 records). [2025-09-29T02:20:52.278415] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-29T02:20:52.292108] [INFO ] [MAIN ] Derivative Progress: 1552/2211 symbols completed. PFL took 1.1s. Estimated remaining: 4m 38s. Rate: 142.1 symbols/min [2025-09-29T02:20:52.321060] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:52.472552] [DEBUG] [LOCAL ] PFO: Loaded 5948 existing records from primary storage. [2025-09-29T02:20:52.473713] [INFO ] [MAIN ] PFO: Loaded 5948 primary data records. [2025-09-29T02:20:52.524006] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:52.567878] [INFO ] [MAIN ] PFN: Generated 1820 derivative records from 21992 primary records. [2025-09-29T02:20:52.601745] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-29T02:20:52.854221] [DEBUG] [LOCAL ] PFN: Derivative data saved (1820 records). [2025-09-29T02:20:52.860789] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-29T02:20:52.861323] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:52.865869] [INFO ] [MAIN ] PFLT: Generated 1820 derivative records from 44333 primary records. [2025-09-29T02:20:52.864209] [INFO ] [MAIN ] Derivative Progress: 1553/2211 symbols completed. PFN took 1.4s. Estimated remaining: 4m 38s. Rate: 142.1 symbols/min [2025-09-29T02:20:52.866247] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:52.866021] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-29T02:20:52.887692] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1820 records). [2025-09-29T02:20:52.888381] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-29T02:20:52.892546] [INFO ] [MAIN ] Derivative Progress: 1554/2211 symbols completed. PFLT took 1.4s. Estimated remaining: 4m 37s. Rate: 142.1 symbols/min [2025-09-29T02:20:52.893453] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:52.914052] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:52.915889] [INFO ] [MAIN ] PFO: Generated 1820 derivative records from 5948 primary records. [2025-09-29T02:20:52.925731] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-29T02:20:52.944144] [DEBUG] [LOCAL ] PFO: Derivative data saved (1820 records). [2025-09-29T02:20:52.954882] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-29T02:20:52.966405] [INFO ] [MAIN ] Derivative Progress: 1555/2211 symbols completed. PFO took 0.6s. Estimated remaining: 4m 37s. Rate: 142.2 symbols/min [2025-09-29T02:20:52.968176] [DEBUG] [LOCAL ] PFS: Loaded 36188 existing records from primary storage. [2025-09-29T02:20:52.968570] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:52.968675] [INFO ] [MAIN ] PFS: Loaded 36188 primary data records. [2025-09-29T02:20:53.052178] [DEBUG] [LOCAL ] PFSI: Loaded 29259 existing records from primary storage. [2025-09-29T02:20:53.076900] [INFO ] [MAIN ] PFSI: Loaded 29259 primary data records. [2025-09-29T02:20:53.618855] [DEBUG] [LOCAL ] PG: Loaded 54532 existing records from primary storage. [2025-09-29T02:20:53.739548] [INFO ] [MAIN ] PG: Loaded 54532 primary data records. [2025-09-29T02:20:54.123981] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:54.125621] [INFO ] [MAIN ] PFS: Generated 1820 derivative records from 36188 primary records. [2025-09-29T02:20:54.126199] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-29T02:20:54.141182] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:54.143774] [INFO ] [MAIN ] PFSI: Generated 1820 derivative records from 29259 primary records. [2025-09-29T02:20:54.153081] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-29T02:20:54.162281] [DEBUG] [LOCAL ] PFS: Derivative data saved (1820 records). [2025-09-29T02:20:54.162807] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-29T02:20:54.172874] [INFO ] [MAIN ] Derivative Progress: 1556/2211 symbols completed. PFS took 1.3s. Estimated remaining: 4m 37s. Rate: 142.1 symbols/min [2025-09-29T02:20:54.177630] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:54.185007] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1820 records). [2025-09-29T02:20:54.187034] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-29T02:20:54.190161] [INFO ] [MAIN ] Derivative Progress: 1557/2211 symbols completed. PFSI took 1.3s. Estimated remaining: 4m 36s. Rate: 142.1 symbols/min [2025-09-29T02:20:54.196779] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:54.197290] [DEBUG] [LOCAL ] PGP: Loaded 5515 existing records from primary storage. [2025-09-29T02:20:54.198206] [INFO ] [MAIN ] PGP: Loaded 5515 primary data records. [2025-09-29T02:20:54.276480] [DEBUG] [MAIN ] PG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:54.294049] [INFO ] [MAIN ] PG: Generated 1820 derivative records from 54532 primary records. [2025-09-29T02:20:54.314078] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-09-29T02:20:54.557691] [DEBUG] [LOCAL ] PG: Derivative data saved (1820 records). [2025-09-29T02:20:54.572857] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-09-29T02:20:54.576467] [INFO ] [MAIN ] Derivative Progress: 1558/2211 symbols completed. PG took 1.6s. Estimated remaining: 4m 36s. Rate: 142.1 symbols/min [2025-09-29T02:20:54.623948] [DEBUG] [LOCAL ] PGR: Loaded 53757 existing records from primary storage. [2025-09-29T02:20:54.624576] [INFO ] [MAIN ] PGR: Loaded 53757 primary data records. [2025-09-29T02:20:54.771757] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:54.788061] [INFO ] [MAIN ] PGP: Generated 1820 derivative records from 5515 primary records. [2025-09-29T02:20:54.813541] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-29T02:20:54.993315] [DEBUG] [LOCAL ] PGP: Derivative data saved (1820 records). [2025-09-29T02:20:54.993495] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-29T02:20:54.996061] [INFO ] [MAIN ] Derivative Progress: 1559/2211 symbols completed. PGP took 0.8s. Estimated remaining: 4m 35s. Rate: 142.1 symbols/min [2025-09-29T02:20:55.018437] [DEBUG] [MAIN ] PGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:55.019173] [INFO ] [MAIN ] PGR: Generated 1820 derivative records from 53757 primary records. [2025-09-29T02:20:55.019259] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-09-29T02:20:55.035574] [DEBUG] [LOCAL ] PGR: Derivative data saved (1820 records). [2025-09-29T02:20:55.035697] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-09-29T02:20:55.038796] [INFO ] [MAIN ] Derivative Progress: 1560/2211 symbols completed. PGR took 0.8s. Estimated remaining: 4m 35s. Rate: 142.2 symbols/min [2025-09-29T02:20:55.039398] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:55.039543] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:55.039478] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:55.051095] [DEBUG] [LOCAL ] PGZ: Loaded 5440 existing records from primary storage. [2025-09-29T02:20:55.051280] [INFO ] [MAIN ] PGZ: Loaded 5440 primary data records. [2025-09-29T02:20:55.432144] [DEBUG] [LOCAL ] PH: Loaded 39166 existing records from primary storage. [2025-09-29T02:20:55.434580] [DEBUG] [LOCAL ] PGRE: Loaded 47177 existing records from primary storage. [2025-09-29T02:20:55.435070] [INFO ] [MAIN ] PH: Loaded 39166 primary data records. [2025-09-29T02:20:55.435011] [INFO ] [MAIN ] PGRE: Loaded 47177 primary data records. [2025-09-29T02:20:56.197768] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:56.199492] [INFO ] [MAIN ] PGZ: Generated 1820 derivative records from 5440 primary records. [2025-09-29T02:20:56.200895] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-29T02:20:56.223939] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1820 records). [2025-09-29T02:20:56.224361] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-29T02:20:56.227144] [INFO ] [MAIN ] Derivative Progress: 1561/2211 symbols completed. PGZ took 1.2s. Estimated remaining: 4m 35s. Rate: 142.1 symbols/min [2025-09-29T02:20:56.229383] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:56.254342] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:56.258380] [INFO ] [MAIN ] PGRE: Generated 1820 derivative records from 47177 primary records. [2025-09-29T02:20:56.276911] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-29T02:20:56.277849] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:56.278734] [INFO ] [MAIN ] PH: Generated 1820 derivative records from 39166 primary records. [2025-09-29T02:20:56.263779] [DEBUG] [LOCAL ] PHD: Loaded 10098 existing records from primary storage. [2025-09-29T02:20:56.279239] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-29T02:20:56.280252] [INFO ] [MAIN ] PHD: Loaded 10098 primary data records. [2025-09-29T02:20:56.392597] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1820 records). [2025-09-29T02:20:56.413800] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-29T02:20:56.442222] [INFO ] [MAIN ] Derivative Progress: 1562/2211 symbols completed. PGRE took 1.4s. Estimated remaining: 4m 34s. Rate: 142.1 symbols/min [2025-09-29T02:20:56.449894] [DEBUG] [LOCAL ] PH: Derivative data saved (1820 records). [2025-09-29T02:20:56.443078] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:56.455417] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-29T02:20:56.497362] [INFO ] [MAIN ] Derivative Progress: 1563/2211 symbols completed. PH took 1.5s. Estimated remaining: 4m 33s. Rate: 142.2 symbols/min [2025-09-29T02:20:56.545956] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:56.714669] [DEBUG] [LOCAL ] PHI: Loaded 15230 existing records from primary storage. [2025-09-29T02:20:56.715510] [INFO ] [MAIN ] PHI: Loaded 15230 primary data records. [2025-09-29T02:20:56.889131] [DEBUG] [LOCAL ] PHG: Loaded 46835 existing records from primary storage. [2025-09-29T02:20:56.924626] [INFO ] [MAIN ] PHG: Loaded 46835 primary data records. [2025-09-29T02:20:56.948583] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:57.037575] [INFO ] [MAIN ] PHD: Generated 1820 derivative records from 10098 primary records. [2025-09-29T02:20:57.206301] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-29T02:20:57.288475] [DEBUG] [LOCAL ] PHD: Derivative data saved (1820 records). [2025-09-29T02:20:57.288994] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-29T02:20:57.303071] [INFO ] [MAIN ] Derivative Progress: 1564/2211 symbols completed. PHD took 1.1s. Estimated remaining: 4m 33s. Rate: 142.1 symbols/min [2025-09-29T02:20:57.313928] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:57.550342] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:57.551371] [INFO ] [MAIN ] PHI: Generated 1820 derivative records from 15230 primary records. [2025-09-29T02:20:57.560958] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-29T02:20:57.595422] [DEBUG] [LOCAL ] PHI: Derivative data saved (1820 records). [2025-09-29T02:20:57.597672] [DEBUG] [LOCAL ] PHIN: Loaded 33541 existing records from primary storage. [2025-09-29T02:20:57.597946] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-29T02:20:57.598584] [INFO ] [MAIN ] PHIN: Loaded 33541 primary data records. [2025-09-29T02:20:57.601990] [INFO ] [MAIN ] Derivative Progress: 1565/2211 symbols completed. PHI took 1.1s. Estimated remaining: 4m 33s. Rate: 142.1 symbols/min [2025-09-29T02:20:57.602697] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:57.781284] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:57.825595] [INFO ] [MAIN ] PHG: Generated 1820 derivative records from 46835 primary records. [2025-09-29T02:20:57.843258] [DEBUG] [LOCAL ] PHK: Loaded 26792 existing records from primary storage. [2025-09-29T02:20:58.017602] [INFO ] [MAIN ] PHK: Loaded 26792 primary data records. [2025-09-29T02:20:57.860883] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-29T02:20:58.173778] [DEBUG] [LOCAL ] PHG: Derivative data saved (1820 records). [2025-09-29T02:20:58.221778] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-29T02:20:58.282040] [INFO ] [MAIN ] Derivative Progress: 1566/2211 symbols completed. PHG took 1.8s. Estimated remaining: 4m 32s. Rate: 142.1 symbols/min [2025-09-29T02:20:58.386101] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:58.420099] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:58.422869] [INFO ] [MAIN ] PHIN: Generated 1820 derivative records from 33541 primary records. [2025-09-29T02:20:58.423191] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-29T02:20:58.443112] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1820 records). [2025-09-29T02:20:58.444594] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-29T02:20:58.447816] [INFO ] [MAIN ] Derivative Progress: 1567/2211 symbols completed. PHIN took 1.1s. Estimated remaining: 4m 32s. Rate: 142.1 symbols/min [2025-09-29T02:20:58.448395] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:58.469967] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:58.470915] [INFO ] [MAIN ] PHK: Generated 1820 derivative records from 26792 primary records. [2025-09-29T02:20:58.471181] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-29T02:20:58.489400] [DEBUG] [LOCAL ] PHK: Derivative data saved (1820 records). [2025-09-29T02:20:58.511600] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-29T02:20:58.515288] [INFO ] [MAIN ] Derivative Progress: 1568/2211 symbols completed. PHK took 0.9s. Estimated remaining: 4m 31s. Rate: 142.2 symbols/min [2025-09-29T02:20:58.515770] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:58.535801] [DEBUG] [LOCAL ] PHR: Loaded 38045 existing records from primary storage. [2025-09-29T02:20:58.554497] [INFO ] [MAIN ] PHR: Loaded 38045 primary data records. [2025-09-29T02:20:58.567729] [DEBUG] [LOCAL ] PHM: Loaded 52386 existing records from primary storage. [2025-09-29T02:20:58.602915] [INFO ] [MAIN ] PHM: Loaded 52386 primary data records. [2025-09-29T02:20:59.132615] [DEBUG] [LOCAL ] PII: Loaded 49815 existing records from primary storage. [2025-09-29T02:20:59.261204] [INFO ] [MAIN ] PII: Loaded 49815 primary data records. [2025-09-29T02:20:59.637884] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:59.653508] [INFO ] [MAIN ] PHR: Generated 1820 derivative records from 38045 primary records. [2025-09-29T02:20:59.654237] [DEBUG] [MAIN ] PHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:59.654420] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-29T02:20:59.655883] [INFO ] [MAIN ] PHM: Generated 1820 derivative records from 52386 primary records. [2025-09-29T02:20:59.657218] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-09-29T02:20:59.683821] [DEBUG] [LOCAL ] PHR: Derivative data saved (1820 records). [2025-09-29T02:20:59.693671] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-29T02:20:59.697083] [INFO ] [MAIN ] Derivative Progress: 1569/2211 symbols completed. PHR took 1.2s. Estimated remaining: 4m 31s. Rate: 142.0 symbols/min [2025-09-29T02:20:59.693347] [DEBUG] [LOCAL ] PHM: Derivative data saved (1820 records). [2025-09-29T02:20:59.697749] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:59.698039] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-09-29T02:20:59.701494] [INFO ] [MAIN ] Derivative Progress: 1570/2211 symbols completed. PHM took 1.3s. Estimated remaining: 4m 31s. Rate: 142.1 symbols/min [2025-09-29T02:20:59.702102] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:59.726166] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-09-29T02:20:59.730677] [INFO ] [MAIN ] PIM: Loaded 4814 primary data records. [2025-09-29T02:20:59.726472] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:59.737206] [INFO ] [MAIN ] PII: Generated 1820 derivative records from 49815 primary records. [2025-09-29T02:20:59.737398] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-29T02:20:59.827077] [DEBUG] [LOCAL ] PINE: Loaded 14365 existing records from primary storage. [2025-09-29T02:20:59.828002] [INFO ] [MAIN ] PINE: Loaded 14365 primary data records. [2025-09-29T02:20:59.869291] [DEBUG] [LOCAL ] PII: Derivative data saved (1820 records). [2025-09-29T02:20:59.891412] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-29T02:20:59.938461] [INFO ] [MAIN ] Derivative Progress: 1571/2211 symbols completed. PII took 1.4s. Estimated remaining: 4m 30s. Rate: 142.2 symbols/min [2025-09-29T02:20:59.962224] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:00.540910] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-29T02:21:00.556063] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:00.555592] [INFO ] [MAIN ] PINS: Loaded 54473 primary data records. [2025-09-29T02:21:00.557310] [INFO ] [MAIN ] PIM: Generated 1820 derivative records from 4814 primary records. [2025-09-29T02:21:00.557945] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-29T02:21:00.655078] [DEBUG] [LOCAL ] PIM: Derivative data saved (1820 records). [2025-09-29T02:21:00.669179] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-29T02:21:00.701660] [INFO ] [MAIN ] Derivative Progress: 1572/2211 symbols completed. PIM took 1.0s. Estimated remaining: 4m 30s. Rate: 142.1 symbols/min [2025-09-29T02:21:00.702817] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:00.773959] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:00.809519] [INFO ] [MAIN ] PINE: Generated 1820 derivative records from 14365 primary records. [2025-09-29T02:21:00.934380] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-29T02:21:00.959588] [DEBUG] [LOCAL ] PINE: Derivative data saved (1820 records). [2025-09-29T02:21:00.960316] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-29T02:21:00.962988] [INFO ] [MAIN ] Derivative Progress: 1573/2211 symbols completed. PINE took 1.3s. Estimated remaining: 4m 29s. Rate: 142.1 symbols/min [2025-09-29T02:21:00.970406] [DEBUG] [LOCAL ] PIPR: Loaded 15331 existing records from primary storage. [2025-09-29T02:21:00.970994] [INFO ] [MAIN ] PIPR: Loaded 15331 primary data records. [2025-09-29T02:21:01.314804] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:01.315776] [INFO ] [MAIN ] PINS: Generated 1820 derivative records from 54473 primary records. [2025-09-29T02:21:01.316685] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-29T02:21:01.335041] [DEBUG] [LOCAL ] PINS: Derivative data saved (1820 records). [2025-09-29T02:21:01.335809] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-29T02:21:01.339463] [INFO ] [MAIN ] Derivative Progress: 1574/2211 symbols completed. PINS took 1.4s. Estimated remaining: 4m 29s. Rate: 142.1 symbols/min [2025-09-29T02:21:01.361667] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:01.362550] [INFO ] [MAIN ] PIPR: Generated 1820 derivative records from 15331 primary records. [2025-09-29T02:21:01.362674] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-29T02:21:01.379036] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1820 records). [2025-09-29T02:21:01.379237] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-29T02:21:01.381759] [INFO ] [MAIN ] Derivative Progress: 1575/2211 symbols completed. PIPR took 0.7s. Estimated remaining: 4m 28s. Rate: 142.2 symbols/min [2025-09-29T02:21:01.382372] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:01.382299] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:01.382535] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:01.403035] [DEBUG] [LOCAL ] PKE: Loaded 12775 existing records from primary storage. [2025-09-29T02:21:01.403484] [INFO ] [MAIN ] PKE: Loaded 12775 primary data records. [2025-09-29T02:21:01.560768] [DEBUG] [LOCAL ] PJT: Loaded 22579 existing records from primary storage. [2025-09-29T02:21:01.618561] [INFO ] [MAIN ] PJT: Loaded 22579 primary data records. [2025-09-29T02:21:01.805032] [DEBUG] [LOCAL ] PK: Loaded 53626 existing records from primary storage. [2025-09-29T02:21:01.831319] [INFO ] [MAIN ] PK: Loaded 53626 primary data records. [2025-09-29T02:21:02.571868] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:02.574485] [INFO ] [MAIN ] PKE: Generated 1820 derivative records from 12775 primary records. [2025-09-29T02:21:02.576284] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-29T02:21:02.596300] [DEBUG] [LOCAL ] PKE: Derivative data saved (1820 records). [2025-09-29T02:21:02.598442] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-29T02:21:02.601890] [INFO ] [MAIN ] Derivative Progress: 1576/2211 symbols completed. PKE took 1.2s. Estimated remaining: 4m 28s. Rate: 142.1 symbols/min [2025-09-29T02:21:02.602835] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:02.628406] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:02.629988] [INFO ] [MAIN ] PJT: Generated 1820 derivative records from 22579 primary records. [2025-09-29T02:21:02.630250] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-29T02:21:02.645291] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:02.659639] [INFO ] [MAIN ] PK: Generated 1820 derivative records from 53626 primary records. [2025-09-29T02:21:02.662558] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-29T02:21:02.666295] [DEBUG] [LOCAL ] PJT: Derivative data saved (1820 records). [2025-09-29T02:21:02.678249] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-29T02:21:02.682926] [DEBUG] [LOCAL ] PK: Derivative data saved (1820 records). [2025-09-29T02:21:02.685758] [INFO ] [MAIN ] Derivative Progress: 1577/2211 symbols completed. PJT took 1.3s. Estimated remaining: 4m 28s. Rate: 142.1 symbols/min [2025-09-29T02:21:02.695916] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-29T02:21:02.699234] [INFO ] [MAIN ] Derivative Progress: 1578/2211 symbols completed. PK took 1.3s. Estimated remaining: 4m 27s. Rate: 142.2 symbols/min [2025-09-29T02:21:02.696121] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:02.700016] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:02.722991] [DEBUG] [LOCAL ] PKG: Loaded 39785 existing records from primary storage. [2025-09-29T02:21:02.723257] [INFO ] [MAIN ] PKG: Loaded 39785 primary data records. [2025-09-29T02:21:02.844410] [DEBUG] [LOCAL ] PKST: Loaded 19461 existing records from primary storage. [2025-09-29T02:21:02.873968] [INFO ] [MAIN ] PKST: Loaded 19461 primary data records. [2025-09-29T02:21:02.904221] [DEBUG] [LOCAL ] PKX: Loaded 25141 existing records from primary storage. [2025-09-29T02:21:02.962941] [INFO ] [MAIN ] PKX: Loaded 25141 primary data records. [2025-09-29T02:21:03.887587] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:03.895854] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:03.895395] [INFO ] [MAIN ] PKG: Generated 1820 derivative records from 39785 primary records. [2025-09-29T02:21:03.897169] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-29T02:21:03.897004] [INFO ] [MAIN ] PKST: Generated 1820 derivative records from 19461 primary records. [2025-09-29T02:21:03.899459] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-29T02:21:03.945880] [DEBUG] [LOCAL ] PKG: Derivative data saved (1820 records). [2025-09-29T02:21:03.949966] [DEBUG] [LOCAL ] PKST: Derivative data saved (1820 records). [2025-09-29T02:21:03.947120] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:03.949071] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-29T02:21:03.954995] [INFO ] [MAIN ] Derivative Progress: 1579/2211 symbols completed. PKG took 1.4s. Estimated remaining: 4m 27s. Rate: 142.0 symbols/min [2025-09-29T02:21:03.956797] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-29T02:21:03.956463] [INFO ] [MAIN ] PKX: Generated 1820 derivative records from 25141 primary records. [2025-09-29T02:21:03.964750] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:03.965376] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-29T02:21:03.964890] [INFO ] [MAIN ] Derivative Progress: 1580/2211 symbols completed. PKST took 1.3s. Estimated remaining: 4m 26s. Rate: 142.1 symbols/min [2025-09-29T02:21:03.967714] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:03.989462] [DEBUG] [LOCAL ] PKX: Derivative data saved (1820 records). [2025-09-29T02:21:03.989846] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-29T02:21:03.994352] [INFO ] [MAIN ] Derivative Progress: 1581/2211 symbols completed. PKX took 1.3s. Estimated remaining: 4m 26s. Rate: 142.2 symbols/min [2025-09-29T02:21:03.994789] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:04.086619] [DEBUG] [LOCAL ] PL: Loaded 53894 existing records from primary storage. [2025-09-29T02:21:04.088933] [INFO ] [MAIN ] PL: Loaded 53894 primary data records. [2025-09-29T02:21:04.160597] [DEBUG] [LOCAL ] PLNT: Loaded 49144 existing records from primary storage. [2025-09-29T02:21:04.190911] [INFO ] [MAIN ] PLNT: Loaded 49144 primary data records. [2025-09-29T02:21:04.404679] [DEBUG] [LOCAL ] PLD: Loaded 54226 existing records from primary storage. [2025-09-29T02:21:04.465633] [INFO ] [MAIN ] PLD: Loaded 54226 primary data records. [2025-09-29T02:21:05.275789] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:05.278852] [INFO ] [MAIN ] PL: Generated 1820 derivative records from 53894 primary records. [2025-09-29T02:21:05.279427] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-29T02:21:05.304782] [DEBUG] [LOCAL ] PL: Derivative data saved (1820 records). [2025-09-29T02:21:05.305005] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-29T02:21:05.309757] [INFO ] [MAIN ] Derivative Progress: 1582/2211 symbols completed. PL took 1.3s. Estimated remaining: 4m 26s. Rate: 142.0 symbols/min [2025-09-29T02:21:05.311974] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:05.335006] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:05.342356] [INFO ] [MAIN ] PLNT: Generated 1820 derivative records from 49144 primary records. [2025-09-29T02:21:05.341263] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:05.342601] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-29T02:21:05.343881] [INFO ] [MAIN ] PLD: Generated 1820 derivative records from 54226 primary records. [2025-09-29T02:21:05.344586] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-29T02:21:05.370388] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1820 records). [2025-09-29T02:21:05.374928] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-29T02:21:05.377830] [DEBUG] [LOCAL ] PLD: Derivative data saved (1820 records). [2025-09-29T02:21:05.387639] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-29T02:21:05.387473] [INFO ] [MAIN ] Derivative Progress: 1583/2211 symbols completed. PLNT took 1.4s. Estimated remaining: 4m 25s. Rate: 142.1 symbols/min [2025-09-29T02:21:05.391775] [INFO ] [MAIN ] Derivative Progress: 1584/2211 symbols completed. PLD took 1.4s. Estimated remaining: 4m 25s. Rate: 142.2 symbols/min [2025-09-29T02:21:05.391597] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:05.392785] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:05.406078] [DEBUG] [LOCAL ] PLOW: Loaded 20792 existing records from primary storage. [2025-09-29T02:21:05.406230] [INFO ] [MAIN ] PLOW: Loaded 20792 primary data records. [2025-09-29T02:21:05.800068] [DEBUG] [LOCAL ] PLYM: Loaded 33884 existing records from primary storage. [2025-09-29T02:21:05.802227] [INFO ] [MAIN ] PLYM: Loaded 33884 primary data records. [2025-09-29T02:21:05.874042] [DEBUG] [LOCAL ] PM: Loaded 54445 existing records from primary storage. [2025-09-29T02:21:05.904845] [INFO ] [MAIN ] PM: Loaded 54445 primary data records. [2025-09-29T02:21:06.553487] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:06.555466] [INFO ] [MAIN ] PLOW: Generated 1820 derivative records from 20792 primary records. [2025-09-29T02:21:06.555921] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-29T02:21:06.576448] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1820 records). [2025-09-29T02:21:06.577347] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-29T02:21:06.579837] [INFO ] [MAIN ] Derivative Progress: 1585/2211 symbols completed. PLOW took 1.3s. Estimated remaining: 4m 24s. Rate: 142.0 symbols/min [2025-09-29T02:21:06.581409] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:06.600567] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:06.601487] [INFO ] [MAIN ] PLYM: Generated 1820 derivative records from 33884 primary records. [2025-09-29T02:21:06.601639] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-29T02:21:06.621273] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1820 records). [2025-09-29T02:21:06.628486] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-29T02:21:06.639882] [INFO ] [MAIN ] Derivative Progress: 1586/2211 symbols completed. PLYM took 1.2s. Estimated remaining: 4m 24s. Rate: 142.1 symbols/min [2025-09-29T02:21:06.646184] [DEBUG] [MAIN ] PM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:06.646334] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:06.647435] [INFO ] [MAIN ] PM: Generated 1820 derivative records from 54445 primary records. [2025-09-29T02:21:06.647884] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-09-29T02:21:06.657097] [DEBUG] [LOCAL ] PML: Loaded 20999 existing records from primary storage. [2025-09-29T02:21:06.669706] [INFO ] [MAIN ] PML: Loaded 20999 primary data records. [2025-09-29T02:21:06.735984] [DEBUG] [LOCAL ] PM: Derivative data saved (1820 records). [2025-09-29T02:21:06.765766] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-09-29T02:21:06.801631] [DEBUG] [LOCAL ] PMM: Loaded 10760 existing records from primary storage. [2025-09-29T02:21:06.805524] [INFO ] [MAIN ] Derivative Progress: 1587/2211 symbols completed. PM took 1.4s. Estimated remaining: 4m 23s. Rate: 142.1 symbols/min [2025-09-29T02:21:06.801941] [INFO ] [MAIN ] PMM: Loaded 10760 primary data records. [2025-09-29T02:21:06.821918] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:07.228940] [DEBUG] [LOCAL ] PMO: Loaded 10547 existing records from primary storage. [2025-09-29T02:21:07.286407] [INFO ] [MAIN ] PMO: Loaded 10547 primary data records. [2025-09-29T02:21:07.787580] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:07.789775] [INFO ] [MAIN ] PML: Generated 1820 derivative records from 20999 primary records. [2025-09-29T02:21:07.790300] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-29T02:21:07.830976] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:07.833283] [DEBUG] [LOCAL ] PML: Derivative data saved (1820 records). [2025-09-29T02:21:07.834475] [INFO ] [MAIN ] PMM: Generated 1820 derivative records from 10760 primary records. [2025-09-29T02:21:07.834857] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-29T02:21:07.834790] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-29T02:21:07.837815] [INFO ] [MAIN ] Derivative Progress: 1588/2211 symbols completed. PML took 1.3s. Estimated remaining: 4m 23s. Rate: 142.0 symbols/min [2025-09-29T02:21:07.857435] [DEBUG] [LOCAL ] PMM: Derivative data saved (1820 records). [2025-09-29T02:21:07.857678] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-29T02:21:07.860741] [INFO ] [MAIN ] Derivative Progress: 1589/2211 symbols completed. PMM took 1.2s. Estimated remaining: 4m 23s. Rate: 142.1 symbols/min [2025-09-29T02:21:07.874361] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:07.875236] [INFO ] [MAIN ] PMO: Generated 1820 derivative records from 10547 primary records. [2025-09-29T02:21:07.875327] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-29T02:21:07.890508] [DEBUG] [LOCAL ] PMO: Derivative data saved (1820 records). [2025-09-29T02:21:07.890629] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-29T02:21:07.893799] [INFO ] [MAIN ] Derivative Progress: 1590/2211 symbols completed. PMO took 1.1s. Estimated remaining: 4m 22s. Rate: 142.2 symbols/min [2025-09-29T02:21:07.894434] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:07.894708] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:07.894844] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:07.910528] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-09-29T02:21:07.910775] [INFO ] [MAIN ] PNI: Loaded 6782 primary data records. [2025-09-29T02:21:08.313400] [DEBUG] [LOCAL ] PMT: Loaded 40798 existing records from primary storage. [2025-09-29T02:21:08.328944] [INFO ] [MAIN ] PMT: Loaded 40798 primary data records. [2025-09-29T02:21:08.361428] [DEBUG] [LOCAL ] PNC: Loaded 53000 existing records from primary storage. [2025-09-29T02:21:08.412342] [INFO ] [MAIN ] PNC: Loaded 53000 primary data records. [2025-09-29T02:21:09.111563] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:09.112668] [INFO ] [MAIN ] PNI: Generated 1820 derivative records from 6782 primary records. [2025-09-29T02:21:09.113026] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-29T02:21:09.131745] [DEBUG] [LOCAL ] PNI: Derivative data saved (1820 records). [2025-09-29T02:21:09.132717] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-29T02:21:09.136021] [INFO ] [MAIN ] Derivative Progress: 1591/2211 symbols completed. PNI took 1.2s. Estimated remaining: 4m 22s. Rate: 142.0 symbols/min [2025-09-29T02:21:09.136217] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:09.156112] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:09.157450] [INFO ] [MAIN ] PMT: Generated 1820 derivative records from 40798 primary records. [2025-09-29T02:21:09.157852] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-29T02:21:09.176795] [DEBUG] [LOCAL ] PMT: Derivative data saved (1820 records). [2025-09-29T02:21:09.177555] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-29T02:21:09.180357] [INFO ] [MAIN ] Derivative Progress: 1592/2211 symbols completed. PMT took 1.3s. Estimated remaining: 4m 21s. Rate: 142.1 symbols/min [2025-09-29T02:21:09.181090] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:09.209596] [DEBUG] [MAIN ] PNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:09.210753] [INFO ] [MAIN ] PNC: Generated 1820 derivative records from 53000 primary records. [2025-09-29T02:21:09.221119] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-09-29T02:21:09.223619] [DEBUG] [LOCAL ] PNNT: Loaded 33337 existing records from primary storage. [2025-09-29T02:21:09.224361] [INFO ] [MAIN ] PNNT: Loaded 33337 primary data records. [2025-09-29T02:21:09.368316] [DEBUG] [LOCAL ] PNC: Derivative data saved (1820 records). [2025-09-29T02:21:09.412483] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-09-29T02:21:09.475057] [INFO ] [MAIN ] Derivative Progress: 1593/2211 symbols completed. PNC took 1.6s. Estimated remaining: 4m 21s. Rate: 142.1 symbols/min [2025-09-29T02:21:09.602169] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:09.605321] [DEBUG] [LOCAL ] PNR: Loaded 48589 existing records from primary storage. [2025-09-29T02:21:09.605639] [INFO ] [MAIN ] PNR: Loaded 48589 primary data records. [2025-09-29T02:21:09.987576] [DEBUG] [LOCAL ] PNW: Loaded 46531 existing records from primary storage. [2025-09-29T02:21:09.988129] [INFO ] [MAIN ] PNW: Loaded 46531 primary data records. [2025-09-29T02:21:10.027191] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:10.078280] [INFO ] [MAIN ] PNNT: Generated 1820 derivative records from 33337 primary records. [2025-09-29T02:21:10.101826] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-29T02:21:10.349045] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1820 records). [2025-09-29T02:21:10.349952] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-29T02:21:10.353289] [INFO ] [MAIN ] Derivative Progress: 1594/2211 symbols completed. PNNT took 1.2s. Estimated remaining: 4m 21s. Rate: 142.0 symbols/min [2025-09-29T02:21:10.353898] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:10.384767] [DEBUG] [MAIN ] PNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:10.385974] [INFO ] [MAIN ] PNR: Generated 1820 derivative records from 48589 primary records. [2025-09-29T02:21:10.386105] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-09-29T02:21:10.406521] [DEBUG] [LOCAL ] PNR: Derivative data saved (1820 records). [2025-09-29T02:21:10.406935] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-09-29T02:21:10.410171] [INFO ] [MAIN ] Derivative Progress: 1595/2211 symbols completed. PNR took 1.2s. Estimated remaining: 4m 20s. Rate: 142.1 symbols/min [2025-09-29T02:21:10.410777] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:10.429208] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:10.430050] [INFO ] [MAIN ] PNW: Generated 1820 derivative records from 46531 primary records. [2025-09-29T02:21:10.430380] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-29T02:21:10.458915] [DEBUG] [LOCAL ] PNW: Derivative data saved (1820 records). [2025-09-29T02:21:10.476551] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-29T02:21:10.480915] [INFO ] [MAIN ] Derivative Progress: 1596/2211 symbols completed. PNW took 0.9s. Estimated remaining: 4m 20s. Rate: 142.2 symbols/min [2025-09-29T02:21:10.492337] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:10.495423] [DEBUG] [LOCAL ] POR: Loaded 47706 existing records from primary storage. [2025-09-29T02:21:10.495915] [INFO ] [MAIN ] POR: Loaded 47706 primary data records. [2025-09-29T02:21:10.602317] [DEBUG] [LOCAL ] POST: Loaded 39494 existing records from primary storage. [2025-09-29T02:21:10.644871] [INFO ] [MAIN ] POST: Loaded 39494 primary data records. [2025-09-29T02:21:11.060236] [DEBUG] [LOCAL ] PPG: Loaded 51455 existing records from primary storage. [2025-09-29T02:21:11.091431] [INFO ] [MAIN ] PPG: Loaded 51455 primary data records. [2025-09-29T02:21:11.751289] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:11.754161] [INFO ] [MAIN ] POR: Generated 1820 derivative records from 47706 primary records. [2025-09-29T02:21:11.755110] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-29T02:21:11.788625] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:11.793135] [INFO ] [MAIN ] POST: Generated 1820 derivative records from 39494 primary records. [2025-09-29T02:21:11.793965] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-29T02:21:11.796856] [DEBUG] [LOCAL ] POR: Derivative data saved (1820 records). [2025-09-29T02:21:11.797140] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-29T02:21:11.808470] [INFO ] [MAIN ] Derivative Progress: 1597/2211 symbols completed. POR took 1.5s. Estimated remaining: 4m 19s. Rate: 142.0 symbols/min [2025-09-29T02:21:11.815059] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:11.819852] [DEBUG] [LOCAL ] POST: Derivative data saved (1820 records). [2025-09-29T02:21:11.820206] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-29T02:21:11.823214] [INFO ] [MAIN ] Derivative Progress: 1598/2211 symbols completed. POST took 1.4s. Estimated remaining: 4m 19s. Rate: 142.1 symbols/min [2025-09-29T02:21:11.823731] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:11.843945] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:11.844963] [INFO ] [MAIN ] PPG: Generated 1820 derivative records from 51455 primary records. [2025-09-29T02:21:11.845221] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-29T02:21:11.865577] [DEBUG] [LOCAL ] PPG: Derivative data saved (1820 records). [2025-09-29T02:21:11.871146] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-29T02:21:11.874148] [INFO ] [MAIN ] Derivative Progress: 1599/2211 symbols completed. PPG took 1.4s. Estimated remaining: 4m 18s. Rate: 142.1 symbols/min [2025-09-29T02:21:11.874534] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:11.885456] [DEBUG] [LOCAL ] PPT: Loaded 20342 existing records from primary storage. [2025-09-29T02:21:11.885949] [INFO ] [MAIN ] PPT: Loaded 20342 primary data records. [2025-09-29T02:21:12.146730] [DEBUG] [LOCAL ] PPL: Loaded 54285 existing records from primary storage. [2025-09-29T02:21:12.298711] [INFO ] [MAIN ] PPL: Loaded 54285 primary data records. [2025-09-29T02:21:12.445423] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-29T02:21:12.446482] [INFO ] [MAIN ] PR: Loaded 54389 primary data records. [2025-09-29T02:21:13.029247] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:13.046171] [INFO ] [MAIN ] PPT: Generated 1820 derivative records from 20342 primary records. [2025-09-29T02:21:13.047566] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-29T02:21:13.070617] [DEBUG] [LOCAL ] PPT: Derivative data saved (1820 records). [2025-09-29T02:21:13.071485] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-29T02:21:13.074252] [INFO ] [MAIN ] Derivative Progress: 1600/2211 symbols completed. PPT took 1.3s. Estimated remaining: 4m 18s. Rate: 142.0 symbols/min [2025-09-29T02:21:13.075041] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:13.096562] [DEBUG] [MAIN ] PPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:13.097987] [INFO ] [MAIN ] PPL: Generated 1820 derivative records from 54285 primary records. [2025-09-29T02:21:13.098804] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-09-29T02:21:13.123360] [DEBUG] [LOCAL ] PPL: Derivative data saved (1820 records). [2025-09-29T02:21:13.124038] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-09-29T02:21:13.130368] [INFO ] [MAIN ] Derivative Progress: 1601/2211 symbols completed. PPL took 1.3s. Estimated remaining: 4m 18s. Rate: 142.1 symbols/min [2025-09-29T02:21:13.131023] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:13.161201] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:13.162190] [INFO ] [MAIN ] PR: Generated 1820 derivative records from 54389 primary records. [2025-09-29T02:21:13.162353] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-29T02:21:13.181856] [DEBUG] [LOCAL ] PR: Derivative data saved (1820 records). [2025-09-29T02:21:13.194707] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-29T02:21:13.198687] [INFO ] [MAIN ] Derivative Progress: 1602/2211 symbols completed. PR took 1.3s. Estimated remaining: 4m 17s. Rate: 142.1 symbols/min [2025-09-29T02:21:13.199043] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:13.200158] [DEBUG] [LOCAL ] PRA: Loaded 35243 existing records from primary storage. [2025-09-29T02:21:13.200957] [INFO ] [MAIN ] PRA: Loaded 35243 primary data records. [2025-09-29T02:21:13.345063] [DEBUG] [LOCAL ] PRG: Loaded 30420 existing records from primary storage. [2025-09-29T02:21:13.365992] [INFO ] [MAIN ] PRG: Loaded 30420 primary data records. [2025-09-29T02:21:13.815067] [DEBUG] [LOCAL ] PRGO: Loaded 47634 existing records from primary storage. [2025-09-29T02:21:13.855708] [INFO ] [MAIN ] PRGO: Loaded 47634 primary data records. [2025-09-29T02:21:14.380286] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:14.381332] [INFO ] [MAIN ] PRA: Generated 1820 derivative records from 35243 primary records. [2025-09-29T02:21:14.382185] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-29T02:21:14.406472] [DEBUG] [LOCAL ] PRA: Derivative data saved (1820 records). [2025-09-29T02:21:14.406969] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-29T02:21:14.410024] [INFO ] [MAIN ] Derivative Progress: 1603/2211 symbols completed. PRA took 1.3s. Estimated remaining: 4m 17s. Rate: 142.0 symbols/min [2025-09-29T02:21:14.425830] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:14.428136] [INFO ] [MAIN ] PRG: Generated 1820 derivative records from 30420 primary records. [2025-09-29T02:21:14.428614] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-29T02:21:14.447781] [DEBUG] [LOCAL ] PRG: Derivative data saved (1820 records). [2025-09-29T02:21:14.448050] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-29T02:21:14.451964] [INFO ] [MAIN ] Derivative Progress: 1604/2211 symbols completed. PRG took 1.3s. Estimated remaining: 4m 16s. Rate: 142.0 symbols/min [2025-09-29T02:21:14.467607] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:14.468367] [INFO ] [MAIN ] PRGO: Generated 1820 derivative records from 47634 primary records. [2025-09-29T02:21:14.468457] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-29T02:21:14.484886] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1820 records). [2025-09-29T02:21:14.485037] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-29T02:21:14.488721] [INFO ] [MAIN ] Derivative Progress: 1605/2211 symbols completed. PRGO took 1.3s. Estimated remaining: 4m 16s. Rate: 142.1 symbols/min [2025-09-29T02:21:14.489522] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:14.489630] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:14.489788] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:14.504414] [DEBUG] [LOCAL ] PRH: Loaded 4908 existing records from primary storage. [2025-09-29T02:21:14.504808] [INFO ] [MAIN ] PRH: Loaded 4908 primary data records. [2025-09-29T02:21:14.614764] [DEBUG] [LOCAL ] PRI: Loaded 18636 existing records from primary storage. [2025-09-29T02:21:14.656447] [INFO ] [MAIN ] PRI: Loaded 18636 primary data records. [2025-09-29T02:21:14.865331] [DEBUG] [LOCAL ] PRIM: Loaded 45072 existing records from primary storage. [2025-09-29T02:21:14.920387] [INFO ] [MAIN ] PRIM: Loaded 45072 primary data records. [2025-09-29T02:21:15.710168] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:15.714156] [INFO ] [MAIN ] PRH: Generated 1820 derivative records from 4908 primary records. [2025-09-29T02:21:15.714579] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-29T02:21:15.730363] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:15.738707] [INFO ] [MAIN ] PRI: Generated 1820 derivative records from 18636 primary records. [2025-09-29T02:21:15.747847] [DEBUG] [LOCAL ] PRH: Derivative data saved (1820 records). [2025-09-29T02:21:15.748046] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-29T02:21:15.747020] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-29T02:21:15.751789] [INFO ] [MAIN ] Derivative Progress: 1606/2211 symbols completed. PRH took 1.3s. Estimated remaining: 4m 16s. Rate: 142.0 symbols/min [2025-09-29T02:21:15.752517] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:15.776947] [DEBUG] [LOCAL ] PRI: Derivative data saved (1820 records). [2025-09-29T02:21:15.777473] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-29T02:21:15.780408] [INFO ] [MAIN ] Derivative Progress: 1607/2211 symbols completed. PRI took 1.3s. Estimated remaining: 4m 15s. Rate: 142.0 symbols/min [2025-09-29T02:21:15.780673] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:15.796533] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:15.797484] [INFO ] [MAIN ] PRIM: Generated 1820 derivative records from 45072 primary records. [2025-09-29T02:21:15.797675] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-29T02:21:15.822591] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1820 records). [2025-09-29T02:21:15.822912] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-29T02:21:15.826330] [INFO ] [MAIN ] Derivative Progress: 1608/2211 symbols completed. PRIM took 1.3s. Estimated remaining: 4m 15s. Rate: 142.1 symbols/min [2025-09-29T02:21:15.826806] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:15.847374] [DEBUG] [LOCAL ] PRLB: Loaded 20919 existing records from primary storage. [2025-09-29T02:21:15.847610] [INFO ] [MAIN ] PRLB: Loaded 20919 primary data records. [2025-09-29T02:21:15.954332] [DEBUG] [LOCAL ] PRKS: Loaded 43308 existing records from primary storage. [2025-09-29T02:21:15.975020] [INFO ] [MAIN ] PRKS: Loaded 43308 primary data records. [2025-09-29T02:21:16.231634] [DEBUG] [LOCAL ] PRM: Loaded 45298 existing records from primary storage. [2025-09-29T02:21:16.403875] [INFO ] [MAIN ] PRM: Loaded 45298 primary data records. [2025-09-29T02:21:17.017116] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:17.018873] [INFO ] [MAIN ] PRLB: Generated 1820 derivative records from 20919 primary records. [2025-09-29T02:21:17.019976] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-29T02:21:17.055848] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1820 records). [2025-09-29T02:21:17.057301] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-29T02:21:17.056208] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:17.061011] [INFO ] [MAIN ] Derivative Progress: 1609/2211 symbols completed. PRLB took 1.3s. Estimated remaining: 4m 14s. Rate: 141.9 symbols/min [2025-09-29T02:21:17.062472] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:17.062093] [INFO ] [MAIN ] PRKS: Generated 1820 derivative records from 43308 primary records. [2025-09-29T02:21:17.063195] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-29T02:21:17.082497] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1820 records). [2025-09-29T02:21:17.084596] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-29T02:21:17.088637] [INFO ] [MAIN ] Derivative Progress: 1610/2211 symbols completed. PRKS took 1.3s. Estimated remaining: 4m 14s. Rate: 142.0 symbols/min [2025-09-29T02:21:17.088949] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:17.103343] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:17.104185] [INFO ] [MAIN ] PRM: Generated 1820 derivative records from 45298 primary records. [2025-09-29T02:21:17.104315] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-29T02:21:17.121669] [DEBUG] [LOCAL ] PRM: Derivative data saved (1820 records). [2025-09-29T02:21:17.121802] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-29T02:21:17.124707] [INFO ] [MAIN ] Derivative Progress: 1611/2211 symbols completed. PRM took 1.3s. Estimated remaining: 4m 13s. Rate: 142.1 symbols/min [2025-09-29T02:21:17.125041] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:17.149513] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-29T02:21:17.150547] [INFO ] [MAIN ] PRT: Loaded 5402 primary data records. [2025-09-29T02:21:17.320881] [DEBUG] [LOCAL ] PRMB: Loaded 53928 existing records from primary storage. [2025-09-29T02:21:17.337393] [DEBUG] [LOCAL ] PRO: Loaded 38444 existing records from primary storage. [2025-09-29T02:21:17.337627] [INFO ] [MAIN ] PRMB: Loaded 53928 primary data records. [2025-09-29T02:21:17.364619] [INFO ] [MAIN ] PRO: Loaded 38444 primary data records. [2025-09-29T02:21:18.311032] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:18.312489] [INFO ] [MAIN ] PRT: Generated 1820 derivative records from 5402 primary records. [2025-09-29T02:21:18.313026] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-29T02:21:18.335867] [DEBUG] [LOCAL ] PRT: Derivative data saved (1820 records). [2025-09-29T02:21:18.336692] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-29T02:21:18.339360] [INFO ] [MAIN ] Derivative Progress: 1612/2211 symbols completed. PRT took 1.2s. Estimated remaining: 4m 13s. Rate: 141.9 symbols/min [2025-09-29T02:21:18.357619] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:18.370441] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:18.372328] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:18.371910] [INFO ] [MAIN ] PRMB: Generated 1820 derivative records from 53928 primary records. [2025-09-29T02:21:18.373501] [INFO ] [MAIN ] PRO: Generated 1820 derivative records from 38444 primary records. [2025-09-29T02:21:18.373739] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-29T02:21:18.374611] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-29T02:21:18.403296] [DEBUG] [LOCAL ] PRO: Derivative data saved (1820 records). [2025-09-29T02:21:18.404292] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-29T02:21:18.408340] [INFO ] [MAIN ] Derivative Progress: 1613/2211 symbols completed. PRO took 1.3s. Estimated remaining: 4m 13s. Rate: 142.0 symbols/min [2025-09-29T02:21:18.408949] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:18.414877] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1820 records). [2025-09-29T02:21:18.415218] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-29T02:21:18.419290] [INFO ] [MAIN ] Derivative Progress: 1614/2211 symbols completed. PRMB took 1.4s. Estimated remaining: 4m 12s. Rate: 142.1 symbols/min [2025-09-29T02:21:18.419634] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:18.431907] [DEBUG] [LOCAL ] PSBD: Loaded 7130 existing records from primary storage. [2025-09-29T02:21:18.432194] [INFO ] [MAIN ] PSBD: Loaded 7130 primary data records. [2025-09-29T02:21:18.698280] [DEBUG] [LOCAL ] PSA: Loaded 42474 existing records from primary storage. [2025-09-29T02:21:18.702121] [INFO ] [MAIN ] PSA: Loaded 42474 primary data records. [2025-09-29T02:21:18.703569] [DEBUG] [LOCAL ] PRU: Loaded 52204 existing records from primary storage. [2025-09-29T02:21:18.856353] [INFO ] [MAIN ] PRU: Loaded 52204 primary data records. [2025-09-29T02:21:19.598006] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:21:19.599705] [INFO ] [MAIN ] PSBD: Generated 1819 derivative records from 7130 primary records. [2025-09-29T02:21:19.600460] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-29T02:21:19.630594] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1819 records). [2025-09-29T02:21:19.631438] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-29T02:21:19.634573] [INFO ] [MAIN ] Derivative Progress: 1615/2211 symbols completed. PSBD took 1.2s. Estimated remaining: 4m 12s. Rate: 141.9 symbols/min [2025-09-29T02:21:19.636254] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:19.663694] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:19.680522] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:19.680109] [INFO ] [MAIN ] PRU: Generated 1820 derivative records from 52204 primary records. [2025-09-29T02:21:19.680923] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-29T02:21:19.681769] [INFO ] [MAIN ] PSA: Generated 1820 derivative records from 42474 primary records. [2025-09-29T02:21:19.687151] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-29T02:21:19.687499] [DEBUG] [LOCAL ] PSF: Loaded 6990 existing records from primary storage. [2025-09-29T02:21:19.696576] [INFO ] [MAIN ] PSF: Loaded 6990 primary data records. [2025-09-29T02:21:19.824164] [DEBUG] [LOCAL ] PRU: Derivative data saved (1820 records). [2025-09-29T02:21:19.811243] [DEBUG] [LOCAL ] PSA: Derivative data saved (1820 records). [2025-09-29T02:21:19.835749] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-29T02:21:19.838961] [INFO ] [MAIN ] Derivative Progress: 1616/2211 symbols completed. PSA took 1.4s. Estimated remaining: 4m 11s. Rate: 142.0 symbols/min [2025-09-29T02:21:19.844898] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:19.835904] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-29T02:21:19.853711] [INFO ] [MAIN ] Derivative Progress: 1617/2211 symbols completed. PRU took 1.5s. Estimated remaining: 4m 11s. Rate: 142.1 symbols/min [2025-09-29T02:21:19.864729] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:20.086799] [DEBUG] [LOCAL ] PSFE: Loaded 30702 existing records from primary storage. [2025-09-29T02:21:20.087292] [INFO ] [MAIN ] PSFE: Loaded 30702 primary data records. [2025-09-29T02:21:20.305511] [DEBUG] [LOCAL ] PSN: Loaded 46808 existing records from primary storage. [2025-09-29T02:21:20.453762] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:20.453885] [INFO ] [MAIN ] PSN: Loaded 46808 primary data records. [2025-09-29T02:21:20.512965] [INFO ] [MAIN ] PSF: Generated 1820 derivative records from 6990 primary records. [2025-09-29T02:21:20.513531] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-29T02:21:20.663985] [DEBUG] [LOCAL ] PSF: Derivative data saved (1820 records). [2025-09-29T02:21:20.708687] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-29T02:21:20.756738] [INFO ] [MAIN ] Derivative Progress: 1618/2211 symbols completed. PSF took 1.1s. Estimated remaining: 4m 11s. Rate: 142.0 symbols/min [2025-09-29T02:21:20.923820] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:20.925158] [INFO ] [MAIN ] PSFE: Generated 1820 derivative records from 30702 primary records. [2025-09-29T02:21:20.925571] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-29T02:21:20.944620] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1820 records). [2025-09-29T02:21:20.944827] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-29T02:21:20.947668] [INFO ] [MAIN ] Derivative Progress: 1619/2211 symbols completed. PSFE took 1.1s. Estimated remaining: 4m 10s. Rate: 142.0 symbols/min [2025-09-29T02:21:20.963268] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:20.964037] [INFO ] [MAIN ] PSN: Generated 1820 derivative records from 46808 primary records. [2025-09-29T02:21:20.964124] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-29T02:21:20.986449] [DEBUG] [LOCAL ] PSN: Derivative data saved (1820 records). [2025-09-29T02:21:20.986569] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-29T02:21:20.989892] [INFO ] [MAIN ] Derivative Progress: 1620/2211 symbols completed. PSN took 1.1s. Estimated remaining: 4m 10s. Rate: 142.1 symbols/min [2025-09-29T02:21:20.990561] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:20.990483] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:20.990615] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:21.062800] [DEBUG] [LOCAL ] PSQH: Loaded 35426 existing records from primary storage. [2025-09-29T02:21:21.074181] [INFO ] [MAIN ] PSQH: Loaded 35426 primary data records. [2025-09-29T02:21:21.081746] [DEBUG] [LOCAL ] PSO: Loaded 37751 existing records from primary storage. [2025-09-29T02:21:21.089163] [INFO ] [MAIN ] PSO: Loaded 37751 primary data records. [2025-09-29T02:21:21.250272] [DEBUG] [LOCAL ] PSTG: Loaded 53626 existing records from primary storage. [2025-09-29T02:21:21.250541] [INFO ] [MAIN ] PSTG: Loaded 53626 primary data records. [2025-09-29T02:21:22.175912] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:22.176411] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:22.178803] [INFO ] [MAIN ] PSO: Generated 1820 derivative records from 37751 primary records. [2025-09-29T02:21:22.178940] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-29T02:21:22.177766] [INFO ] [MAIN ] PSQH: Generated 1820 derivative records from 35426 primary records. [2025-09-29T02:21:22.180839] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-29T02:21:22.208299] [DEBUG] [LOCAL ] PSO: Derivative data saved (1820 records). [2025-09-29T02:21:22.222991] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-29T02:21:22.230165] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1820 records). [2025-09-29T02:21:22.232561] [INFO ] [MAIN ] Derivative Progress: 1621/2211 symbols completed. PSO took 1.2s. Estimated remaining: 4m 9s. Rate: 141.9 symbols/min [2025-09-29T02:21:22.233160] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:22.233508] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:22.233349] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-29T02:21:22.238117] [INFO ] [MAIN ] PSTG: Generated 1820 derivative records from 53626 primary records. [2025-09-29T02:21:22.238627] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-29T02:21:22.237022] [INFO ] [MAIN ] Derivative Progress: 1622/2211 symbols completed. PSQH took 1.2s. Estimated remaining: 4m 9s. Rate: 142.0 symbols/min [2025-09-29T02:21:22.239041] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:22.260024] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1820 records). [2025-09-29T02:21:22.260209] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-29T02:21:22.263870] [INFO ] [MAIN ] Derivative Progress: 1623/2211 symbols completed. PSTG took 1.3s. Estimated remaining: 4m 8s. Rate: 142.1 symbols/min [2025-09-29T02:21:22.265207] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:22.285254] [DEBUG] [LOCAL ] PSTL: Loaded 20585 existing records from primary storage. [2025-09-29T02:21:22.285453] [INFO ] [MAIN ] PSTL: Loaded 20585 primary data records. [2025-09-29T02:21:22.406873] [DEBUG] [LOCAL ] PTA: Loaded 15299 existing records from primary storage. [2025-09-29T02:21:22.420030] [INFO ] [MAIN ] PTA: Loaded 15299 primary data records. [2025-09-29T02:21:22.835397] [DEBUG] [LOCAL ] PSX: Loaded 53912 existing records from primary storage. [2025-09-29T02:21:22.854475] [INFO ] [MAIN ] PSX: Loaded 53912 primary data records. [2025-09-29T02:21:23.439224] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:23.440996] [INFO ] [MAIN ] PSTL: Generated 1820 derivative records from 20585 primary records. [2025-09-29T02:21:23.441495] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-29T02:21:23.462223] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1820 records). [2025-09-29T02:21:23.464239] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-29T02:21:23.466660] [INFO ] [MAIN ] Derivative Progress: 1624/2211 symbols completed. PSTL took 1.2s. Estimated remaining: 4m 8s. Rate: 141.9 symbols/min [2025-09-29T02:21:23.467447] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:23.481362] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:23.482289] [INFO ] [MAIN ] PTA: Generated 1820 derivative records from 15299 primary records. [2025-09-29T02:21:23.482821] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-29T02:21:23.505764] [DEBUG] [LOCAL ] PTA: Derivative data saved (1820 records). [2025-09-29T02:21:23.506130] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-29T02:21:23.509282] [INFO ] [MAIN ] Derivative Progress: 1625/2211 symbols completed. PTA took 1.2s. Estimated remaining: 4m 8s. Rate: 142.0 symbols/min [2025-09-29T02:21:23.523540] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:23.523973] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:23.524974] [INFO ] [MAIN ] PSX: Generated 1820 derivative records from 53912 primary records. [2025-09-29T02:21:23.525154] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-29T02:21:23.552766] [DEBUG] [LOCAL ] PSX: Derivative data saved (1820 records). [2025-09-29T02:21:23.553071] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-29T02:21:23.556570] [INFO ] [MAIN ] Derivative Progress: 1626/2211 symbols completed. PSX took 1.3s. Estimated remaining: 4m 7s. Rate: 142.1 symbols/min [2025-09-29T02:21:23.557066] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:23.572258] [DEBUG] [LOCAL ] PTY: Loaded 37902 existing records from primary storage. [2025-09-29T02:21:23.572757] [INFO ] [MAIN ] PTY: Loaded 37902 primary data records. [2025-09-29T02:21:23.838321] [DEBUG] [LOCAL ] PUK: Loaded 45565 existing records from primary storage. [2025-09-29T02:21:23.957131] [INFO ] [MAIN ] PUK: Loaded 45565 primary data records. [2025-09-29T02:21:24.007299] [DEBUG] [LOCAL ] PUMP: Loaded 50160 existing records from primary storage. [2025-09-29T02:21:24.060557] [INFO ] [MAIN ] PUMP: Loaded 50160 primary data records. [2025-09-29T02:21:24.707017] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:24.709825] [INFO ] [MAIN ] PTY: Generated 1820 derivative records from 37902 primary records. [2025-09-29T02:21:24.713278] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-29T02:21:24.742910] [DEBUG] [LOCAL ] PTY: Derivative data saved (1820 records). [2025-09-29T02:21:24.743305] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-29T02:21:24.746580] [INFO ] [MAIN ] Derivative Progress: 1627/2211 symbols completed. PTY took 1.3s. Estimated remaining: 4m 7s. Rate: 141.9 symbols/min [2025-09-29T02:21:24.747283] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:24.769818] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:24.772334] [INFO ] [MAIN ] PUK: Generated 1820 derivative records from 45565 primary records. [2025-09-29T02:21:24.772537] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-29T02:21:24.800465] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:24.802172] [INFO ] [MAIN ] PUMP: Generated 1820 derivative records from 50160 primary records. [2025-09-29T02:21:24.806524] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-29T02:21:24.806412] [DEBUG] [LOCAL ] PUK: Derivative data saved (1820 records). [2025-09-29T02:21:24.807672] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-29T02:21:24.810758] [INFO ] [MAIN ] Derivative Progress: 1628/2211 symbols completed. PUK took 1.3s. Estimated remaining: 4m 6s. Rate: 142.0 symbols/min [2025-09-29T02:21:24.811213] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:24.831017] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1820 records). [2025-09-29T02:21:24.832744] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-29T02:21:24.836403] [INFO ] [MAIN ] Derivative Progress: 1629/2211 symbols completed. PUMP took 1.3s. Estimated remaining: 4m 6s. Rate: 142.1 symbols/min [2025-09-29T02:21:24.836758] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:24.841983] [DEBUG] [LOCAL ] PVL: Loaded 4819 existing records from primary storage. [2025-09-29T02:21:24.842159] [INFO ] [MAIN ] PVL: Loaded 4819 primary data records. [2025-09-29T02:21:25.071675] [DEBUG] [LOCAL ] PVH: Loaded 51137 existing records from primary storage. [2025-09-29T02:21:25.072144] [INFO ] [MAIN ] PVH: Loaded 51137 primary data records. [2025-09-29T02:21:25.396869] [DEBUG] [LOCAL ] PWR: Loaded 48047 existing records from primary storage. [2025-09-29T02:21:25.413607] [INFO ] [MAIN ] PWR: Loaded 48047 primary data records. [2025-09-29T02:21:25.984174] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:25.985407] [INFO ] [MAIN ] PVL: Generated 1820 derivative records from 4819 primary records. [2025-09-29T02:21:25.988103] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-29T02:21:26.008976] [DEBUG] [LOCAL ] PVL: Derivative data saved (1820 records). [2025-09-29T02:21:26.009204] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-29T02:21:26.012164] [INFO ] [MAIN ] Derivative Progress: 1630/2211 symbols completed. PVL took 1.2s. Estimated remaining: 4m 6s. Rate: 141.9 symbols/min [2025-09-29T02:21:26.012508] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:26.034483] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:26.035906] [INFO ] [MAIN ] PVH: Generated 1820 derivative records from 51137 primary records. [2025-09-29T02:21:26.036148] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-29T02:21:26.068479] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:26.071473] [INFO ] [MAIN ] PWR: Generated 1820 derivative records from 48047 primary records. [2025-09-29T02:21:26.072824] [DEBUG] [LOCAL ] PVH: Derivative data saved (1820 records). [2025-09-29T02:21:26.082470] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-29T02:21:26.082617] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-29T02:21:26.086746] [INFO ] [MAIN ] Derivative Progress: 1631/2211 symbols completed. PVH took 1.3s. Estimated remaining: 4m 5s. Rate: 142.0 symbols/min [2025-09-29T02:21:26.087503] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:26.103435] [DEBUG] [LOCAL ] PWR: Derivative data saved (1820 records). [2025-09-29T02:21:26.103841] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-29T02:21:26.107360] [INFO ] [MAIN ] Derivative Progress: 1632/2211 symbols completed. PWR took 1.3s. Estimated remaining: 4m 5s. Rate: 142.1 symbols/min [2025-09-29T02:21:26.109437] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:26.122256] [DEBUG] [LOCAL ] PX: Loaded 35085 existing records from primary storage. [2025-09-29T02:21:26.122748] [INFO ] [MAIN ] PX: Loaded 35085 primary data records. [2025-09-29T02:21:26.477598] [DEBUG] [LOCAL ] QD: Loaded 28475 existing records from primary storage. [2025-09-29T02:21:26.478024] [INFO ] [MAIN ] QD: Loaded 28475 primary data records. [2025-09-29T02:21:26.612349] [DEBUG] [LOCAL ] QBTS: Loaded 54526 existing records from primary storage. [2025-09-29T02:21:26.635731] [INFO ] [MAIN ] QBTS: Loaded 54526 primary data records. [2025-09-29T02:21:27.241887] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:27.252460] [INFO ] [MAIN ] PX: Generated 1820 derivative records from 35085 primary records. [2025-09-29T02:21:27.253581] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-29T02:21:27.275463] [DEBUG] [LOCAL ] PX: Derivative data saved (1820 records). [2025-09-29T02:21:27.276457] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-29T02:21:27.280098] [INFO ] [MAIN ] Derivative Progress: 1633/2211 symbols completed. PX took 1.3s. Estimated remaining: 4m 4s. Rate: 141.9 symbols/min [2025-09-29T02:21:27.297575] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:27.298732] [INFO ] [MAIN ] QD: Generated 1820 derivative records from 28475 primary records. [2025-09-29T02:21:27.298840] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-29T02:21:27.316358] [DEBUG] [LOCAL ] QD: Derivative data saved (1820 records). [2025-09-29T02:21:27.316628] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-29T02:21:27.319816] [INFO ] [MAIN ] Derivative Progress: 1634/2211 symbols completed. QD took 1.2s. Estimated remaining: 4m 4s. Rate: 142.0 symbols/min [2025-09-29T02:21:27.334819] [DEBUG] [MAIN ] QBTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:27.335499] [INFO ] [MAIN ] QBTS: Generated 1820 derivative records from 54526 primary records. [2025-09-29T02:21:27.335585] [DEBUG] [LOCAL ] QBTS: Saving derivative data. [2025-09-29T02:21:27.352243] [DEBUG] [LOCAL ] QBTS: Derivative data saved (1820 records). [2025-09-29T02:21:27.352376] [INFO ] [MAIN ] QBTS: Successfully saved derivative data. [2025-09-29T02:21:27.355773] [INFO ] [MAIN ] Derivative Progress: 1635/2211 symbols completed. QBTS took 1.3s. Estimated remaining: 4m 3s. Rate: 142.1 symbols/min [2025-09-29T02:21:27.356374] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:27.356458] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:27.356543] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:27.442717] [DEBUG] [LOCAL ] QGEN: Loaded 49874 existing records from primary storage. [2025-09-29T02:21:27.457623] [INFO ] [MAIN ] QGEN: Loaded 49874 primary data records. [2025-09-29T02:21:27.473239] [DEBUG] [LOCAL ] QSR: Loaded 53178 existing records from primary storage. [2025-09-29T02:21:27.498260] [INFO ] [MAIN ] QSR: Loaded 53178 primary data records. [2025-09-29T02:21:27.504578] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-29T02:21:27.590156] [INFO ] [MAIN ] QS: Loaded 54522 primary data records. [2025-09-29T02:21:28.543853] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:28.546773] [INFO ] [MAIN ] QGEN: Generated 1820 derivative records from 49874 primary records. [2025-09-29T02:21:28.547896] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-29T02:21:28.575225] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:28.578578] [INFO ] [MAIN ] QSR: Generated 1820 derivative records from 53178 primary records. [2025-09-29T02:21:28.579004] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-29T02:21:28.583258] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1820 records). [2025-09-29T02:21:28.585488] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-29T02:21:28.600205] [INFO ] [MAIN ] Derivative Progress: 1636/2211 symbols completed. QGEN took 1.2s. Estimated remaining: 4m 3s. Rate: 141.9 symbols/min [2025-09-29T02:21:28.601087] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:28.618475] [DEBUG] [LOCAL ] QSR: Derivative data saved (1820 records). [2025-09-29T02:21:28.619179] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-29T02:21:28.622430] [INFO ] [MAIN ] Derivative Progress: 1637/2211 symbols completed. QSR took 1.3s. Estimated remaining: 4m 3s. Rate: 142.0 symbols/min [2025-09-29T02:21:28.623255] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:28.623521] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:28.625182] [INFO ] [MAIN ] QS: Generated 1820 derivative records from 54522 primary records. [2025-09-29T02:21:28.626015] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-29T02:21:28.646623] [DEBUG] [LOCAL ] QS: Derivative data saved (1820 records). [2025-09-29T02:21:28.646786] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-29T02:21:28.650290] [INFO ] [MAIN ] Derivative Progress: 1638/2211 symbols completed. QS took 1.3s. Estimated remaining: 4m 2s. Rate: 142.1 symbols/min [2025-09-29T02:21:28.650634] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:28.679512] [DEBUG] [LOCAL ] QVCC: Loaded 9018 existing records from primary storage. [2025-09-29T02:21:28.680720] [INFO ] [MAIN ] QVCC: Loaded 9018 primary data records. [2025-09-29T02:21:28.713241] [DEBUG] [LOCAL ] QUAD: Loaded 23938 existing records from primary storage. [2025-09-29T02:21:28.728254] [INFO ] [MAIN ] QUAD: Loaded 23938 primary data records. [2025-09-29T02:21:28.821481] [DEBUG] [LOCAL ] QTWO: Loaded 39754 existing records from primary storage. [2025-09-29T02:21:28.821891] [INFO ] [MAIN ] QTWO: Loaded 39754 primary data records. [2025-09-29T02:21:29.858200] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:29.859994] [INFO ] [MAIN ] QVCC: Generated 1820 derivative records from 9018 primary records. [2025-09-29T02:21:29.874230] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-29T02:21:29.874153] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:29.876792] [INFO ] [MAIN ] QUAD: Generated 1820 derivative records from 23938 primary records. [2025-09-29T02:21:29.877285] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-29T02:21:29.897284] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1820 records). [2025-09-29T02:21:29.906286] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-29T02:21:29.915743] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1820 records). [2025-09-29T02:21:29.911469] [INFO ] [MAIN ] Derivative Progress: 1639/2211 symbols completed. QVCC took 1.3s. Estimated remaining: 4m 2s. Rate: 141.9 symbols/min [2025-09-29T02:21:29.916144] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:29.928898] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-29T02:21:29.931873] [INFO ] [MAIN ] Derivative Progress: 1640/2211 symbols completed. QUAD took 1.3s. Estimated remaining: 4m 1s. Rate: 142.0 symbols/min [2025-09-29T02:21:29.933068] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:29.933751] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:29.934862] [INFO ] [MAIN ] QTWO: Generated 1820 derivative records from 39754 primary records. [2025-09-29T02:21:29.935063] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-29T02:21:29.958387] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1820 records). [2025-09-29T02:21:29.954608] [DEBUG] [LOCAL ] QVCD: Loaded 4542 existing records from primary storage. [2025-09-29T02:21:29.958810] [INFO ] [MAIN ] QVCD: Loaded 4542 primary data records. [2025-09-29T02:21:29.958635] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-29T02:21:29.962230] [INFO ] [MAIN ] Derivative Progress: 1641/2211 symbols completed. QTWO took 1.4s. Estimated remaining: 4m 1s. Rate: 142.1 symbols/min [2025-09-29T02:21:29.962577] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:30.310807] [DEBUG] [LOCAL ] R: Loaded 29775 existing records from primary storage. [2025-09-29T02:21:30.346885] [INFO ] [MAIN ] R: Loaded 29775 primary data records. [2025-09-29T02:21:30.361349] [DEBUG] [LOCAL ] QXO: Loaded 53964 existing records from primary storage. [2025-09-29T02:21:30.361825] [INFO ] [MAIN ] QXO: Loaded 53964 primary data records. [2025-09-29T02:21:31.064861] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:21:31.066318] [INFO ] [MAIN ] QVCD: Generated 1819 derivative records from 4542 primary records. [2025-09-29T02:21:31.066515] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-29T02:21:31.087812] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1819 records). [2025-09-29T02:21:31.088873] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-29T02:21:31.092486] [INFO ] [MAIN ] Derivative Progress: 1642/2211 symbols completed. QVCD took 1.2s. Estimated remaining: 4m 1s. Rate: 141.9 symbols/min [2025-09-29T02:21:31.094751] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:31.116596] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:31.119908] [INFO ] [MAIN ] R: Generated 1820 derivative records from 29775 primary records. [2025-09-29T02:21:31.126425] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-29T02:21:31.141314] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:21:31.143740] [INFO ] [MAIN ] QXO: Generated 1819 derivative records from 53964 primary records. [2025-09-29T02:21:31.156070] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-29T02:21:31.168184] [DEBUG] [LOCAL ] RA: Loaded 22045 existing records from primary storage. [2025-09-29T02:21:31.170781] [INFO ] [MAIN ] RA: Loaded 22045 primary data records. [2025-09-29T02:21:31.226511] [DEBUG] [LOCAL ] R: Derivative data saved (1820 records). [2025-09-29T02:21:31.269360] [DEBUG] [LOCAL ] QXO: Derivative data saved (1819 records). [2025-09-29T02:21:31.282776] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-29T02:21:31.295996] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-29T02:21:31.311915] [INFO ] [MAIN ] Derivative Progress: 1643/2211 symbols completed. R took 1.3s. Estimated remaining: 4m 0s. Rate: 142.0 symbols/min [2025-09-29T02:21:31.321113] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:31.321218] [INFO ] [MAIN ] Derivative Progress: 1644/2211 symbols completed. QXO took 1.4s. Estimated remaining: 3m 59s. Rate: 142.1 symbols/min [2025-09-29T02:21:31.337027] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:31.629946] [DEBUG] [LOCAL ] RAMP: Loaded 38208 existing records from primary storage. [2025-09-29T02:21:31.630218] [INFO ] [MAIN ] RAMP: Loaded 38208 primary data records. [2025-09-29T02:21:31.645988] [DEBUG] [LOCAL ] RACE: Loaded 33300 existing records from primary storage. [2025-09-29T02:21:31.675784] [INFO ] [MAIN ] RACE: Loaded 33300 primary data records. [2025-09-29T02:21:31.976801] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:32.122120] [INFO ] [MAIN ] RA: Generated 1820 derivative records from 22045 primary records. [2025-09-29T02:21:32.158468] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-29T02:21:32.339189] [DEBUG] [LOCAL ] RA: Derivative data saved (1820 records). [2025-09-29T02:21:32.340805] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-29T02:21:32.344468] [INFO ] [MAIN ] Derivative Progress: 1645/2211 symbols completed. RA took 1.2s. Estimated remaining: 3m 59s. Rate: 141.9 symbols/min [2025-09-29T02:21:32.346604] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:32.376126] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:32.377122] [INFO ] [MAIN ] RAMP: Generated 1820 derivative records from 38208 primary records. [2025-09-29T02:21:32.377394] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-29T02:21:32.397934] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1820 records). [2025-09-29T02:21:32.406083] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-29T02:21:32.413989] [INFO ] [MAIN ] Derivative Progress: 1646/2211 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 59s. Rate: 142.0 symbols/min [2025-09-29T02:21:32.414748] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:32.426471] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:32.428112] [INFO ] [MAIN ] RACE: Generated 1820 derivative records from 33300 primary records. [2025-09-29T02:21:32.428255] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-29T02:21:32.460218] [DEBUG] [LOCAL ] RACE: Derivative data saved (1820 records). [2025-09-29T02:21:32.460480] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-29T02:21:32.464435] [INFO ] [MAIN ] Derivative Progress: 1647/2211 symbols completed. RACE took 1.1s. Estimated remaining: 3m 58s. Rate: 142.1 symbols/min [2025-09-29T02:21:32.464759] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:32.470690] [DEBUG] [LOCAL ] RBA: Loaded 46598 existing records from primary storage. [2025-09-29T02:21:32.471142] [INFO ] [MAIN ] RBA: Loaded 46598 primary data records. [2025-09-29T02:21:32.501860] [DEBUG] [LOCAL ] RBC: Loaded 15326 existing records from primary storage. [2025-09-29T02:21:32.539221] [INFO ] [MAIN ] RBC: Loaded 15326 primary data records. [2025-09-29T02:21:33.184365] [DEBUG] [LOCAL ] RBLX: Loaded 54496 existing records from primary storage. [2025-09-29T02:21:33.185012] [INFO ] [MAIN ] RBLX: Loaded 54496 primary data records. [2025-09-29T02:21:33.557810] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:33.560830] [INFO ] [MAIN ] RBA: Generated 1820 derivative records from 46598 primary records. [2025-09-29T02:21:33.562180] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-29T02:21:33.577242] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:33.587013] [INFO ] [MAIN ] RBC: Generated 1820 derivative records from 15326 primary records. [2025-09-29T02:21:33.587301] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-29T02:21:33.608336] [DEBUG] [LOCAL ] RBA: Derivative data saved (1820 records). [2025-09-29T02:21:33.611036] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-29T02:21:33.612176] [DEBUG] [LOCAL ] RBC: Derivative data saved (1820 records). [2025-09-29T02:21:33.615370] [INFO ] [MAIN ] Derivative Progress: 1648/2211 symbols completed. RBA took 1.3s. Estimated remaining: 3m 58s. Rate: 141.9 symbols/min [2025-09-29T02:21:33.617692] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-29T02:21:33.621383] [INFO ] [MAIN ] Derivative Progress: 1649/2211 symbols completed. RBC took 1.2s. Estimated remaining: 3m 57s. Rate: 142.0 symbols/min [2025-09-29T02:21:33.635333] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:33.636122] [INFO ] [MAIN ] RBLX: Generated 1820 derivative records from 54496 primary records. [2025-09-29T02:21:33.636226] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-29T02:21:33.652427] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1820 records). [2025-09-29T02:21:33.652526] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-29T02:21:33.655454] [INFO ] [MAIN ] Derivative Progress: 1650/2211 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 57s. Rate: 142.1 symbols/min [2025-09-29T02:21:33.656016] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:33.656068] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:33.656127] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:33.665287] [DEBUG] [LOCAL ] RBOT: Loaded 5223 existing records from primary storage. [2025-09-29T02:21:33.665624] [INFO ] [MAIN ] RBOT: Loaded 5223 primary data records. [2025-09-29T02:21:34.116737] [DEBUG] [LOCAL ] RBRK: Loaded 53892 existing records from primary storage. [2025-09-29T02:21:34.115731] [DEBUG] [LOCAL ] RC: Loaded 49676 existing records from primary storage. [2025-09-29T02:21:34.117861] [INFO ] [MAIN ] RBRK: Loaded 53892 primary data records. [2025-09-29T02:21:34.117955] [INFO ] [MAIN ] RC: Loaded 49676 primary data records. [2025-09-29T02:21:34.821610] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:34.825002] [INFO ] [MAIN ] RBOT: Generated 1820 derivative records from 5223 primary records. [2025-09-29T02:21:34.826536] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-29T02:21:34.844805] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1820 records). [2025-09-29T02:21:34.845141] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-29T02:21:34.848695] [INFO ] [MAIN ] Derivative Progress: 1651/2211 symbols completed. RBOT took 1.2s. Estimated remaining: 3m 57s. Rate: 141.9 symbols/min [2025-09-29T02:21:34.849602] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:34.874696] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:34.876264] [INFO ] [MAIN ] RBRK: Generated 1820 derivative records from 53892 primary records. [2025-09-29T02:21:34.884841] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-29T02:21:34.891831] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:34.907581] [INFO ] [MAIN ] RC: Generated 1820 derivative records from 49676 primary records. [2025-09-29T02:21:34.913304] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-29T02:21:34.914274] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1820 records). [2025-09-29T02:21:34.914988] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-29T02:21:34.918626] [INFO ] [MAIN ] Derivative Progress: 1652/2211 symbols completed. RBRK took 1.3s. Estimated remaining: 3m 56s. Rate: 142.0 symbols/min [2025-09-29T02:21:34.925983] [INFO ] [MAIN ] RCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:34.935739] [DEBUG] [LOCAL ] RC: Derivative data saved (1820 records). [2025-09-29T02:21:34.936096] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-29T02:21:34.938944] [INFO ] [MAIN ] Derivative Progress: 1653/2211 symbols completed. RC took 1.3s. Estimated remaining: 3m 56s. Rate: 142.1 symbols/min [2025-09-29T02:21:34.939338] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:34.963867] [DEBUG] [LOCAL ] RCS: Loaded 11593 existing records from primary storage. [2025-09-29T02:21:34.964039] [INFO ] [MAIN ] RCS: Loaded 11593 primary data records. [2025-09-29T02:21:35.087197] [DEBUG] [LOCAL ] RCI: Loaded 49383 existing records from primary storage. [2025-09-29T02:21:35.101197] [INFO ] [MAIN ] RCI: Loaded 49383 primary data records. [2025-09-29T02:21:35.469772] [DEBUG] [LOCAL ] RCL: Loaded 52876 existing records from primary storage. [2025-09-29T02:21:35.504432] [INFO ] [MAIN ] RCL: Loaded 52876 primary data records. [2025-09-29T02:21:36.098001] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:36.099554] [INFO ] [MAIN ] RCS: Generated 1820 derivative records from 11593 primary records. [2025-09-29T02:21:36.100064] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-29T02:21:36.119089] [DEBUG] [LOCAL ] RCS: Derivative data saved (1820 records). [2025-09-29T02:21:36.119811] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-29T02:21:36.124714] [INFO ] [MAIN ] Derivative Progress: 1654/2211 symbols completed. RCS took 1.2s. Estimated remaining: 3m 55s. Rate: 141.9 symbols/min [2025-09-29T02:21:36.126677] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:36.142557] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:36.143956] [INFO ] [MAIN ] RCI: Generated 1820 derivative records from 49383 primary records. [2025-09-29T02:21:36.144496] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-29T02:21:36.164637] [DEBUG] [LOCAL ] RCI: Derivative data saved (1820 records). [2025-09-29T02:21:36.164901] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-29T02:21:36.171147] [INFO ] [MAIN ] Derivative Progress: 1655/2211 symbols completed. RCI took 1.3s. Estimated remaining: 3m 55s. Rate: 142.0 symbols/min [2025-09-29T02:21:36.172581] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:36.191534] [DEBUG] [MAIN ] RCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:36.192365] [INFO ] [MAIN ] RCL: Generated 1820 derivative records from 52876 primary records. [2025-09-29T02:21:36.203124] [DEBUG] [LOCAL ] RCL: Saving derivative data. [2025-09-29T02:21:36.235400] [DEBUG] [LOCAL ] RCL: Derivative data saved (1820 records). [2025-09-29T02:21:36.235696] [INFO ] [MAIN ] RCL: Successfully saved derivative data. [2025-09-29T02:21:36.238778] [INFO ] [MAIN ] Derivative Progress: 1656/2211 symbols completed. RCL took 1.3s. Estimated remaining: 3m 54s. Rate: 142.1 symbols/min [2025-09-29T02:21:36.240839] [DEBUG] [LOCAL ] RCUS: Loaded 43206 existing records from primary storage. [2025-09-29T02:21:36.239279] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:36.241066] [INFO ] [MAIN ] RCUS: Loaded 43206 primary data records. [2025-09-29T02:21:36.632047] [DEBUG] [LOCAL ] RDDT: Loaded 54563 existing records from primary storage. [2025-09-29T02:21:36.632755] [INFO ] [MAIN ] RDDT: Loaded 54563 primary data records. [2025-09-29T02:21:36.780356] [DEBUG] [LOCAL ] RDN: Loaded 45976 existing records from primary storage. [2025-09-29T02:21:36.793731] [INFO ] [MAIN ] RDN: Loaded 45976 primary data records. [2025-09-29T02:21:37.366953] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:37.368018] [INFO ] [MAIN ] RCUS: Generated 1820 derivative records from 43206 primary records. [2025-09-29T02:21:37.369838] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-29T02:21:37.388246] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1820 records). [2025-09-29T02:21:37.389353] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-29T02:21:37.392489] [INFO ] [MAIN ] Derivative Progress: 1657/2211 symbols completed. RCUS took 1.3s. Estimated remaining: 3m 54s. Rate: 141.9 symbols/min [2025-09-29T02:21:37.392933] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:37.416368] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:37.417578] [INFO ] [MAIN ] RDDT: Generated 1820 derivative records from 54563 primary records. [2025-09-29T02:21:37.417832] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-29T02:21:37.439884] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1820 records). [2025-09-29T02:21:37.440314] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-29T02:21:37.445679] [INFO ] [MAIN ] Derivative Progress: 1658/2211 symbols completed. RDDT took 1.3s. Estimated remaining: 3m 54s. Rate: 142.0 symbols/min [2025-09-29T02:21:37.447927] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:37.463733] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:37.479689] [INFO ] [MAIN ] RDN: Generated 1820 derivative records from 45976 primary records. [2025-09-29T02:21:37.480146] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-29T02:21:37.499908] [DEBUG] [LOCAL ] RDN: Derivative data saved (1820 records). [2025-09-29T02:21:37.500233] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-29T02:21:37.517104] [INFO ] [MAIN ] Derivative Progress: 1659/2211 symbols completed. RDN took 1.3s. Estimated remaining: 3m 53s. Rate: 142.1 symbols/min [2025-09-29T02:21:37.519572] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:37.523489] [DEBUG] [LOCAL ] RDW: Loaded 52794 existing records from primary storage. [2025-09-29T02:21:37.523968] [INFO ] [MAIN ] RDW: Loaded 52794 primary data records. [2025-09-29T02:21:37.913445] [DEBUG] [LOCAL ] RDY: Loaded 47418 existing records from primary storage. [2025-09-29T02:21:37.938503] [INFO ] [MAIN ] RDY: Loaded 47418 primary data records. [2025-09-29T02:21:37.939592] [DEBUG] [LOCAL ] RELX: Loaded 48567 existing records from primary storage. [2025-09-29T02:21:37.940125] [INFO ] [MAIN ] RELX: Loaded 48567 primary data records. [2025-09-29T02:21:38.711122] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:38.713238] [INFO ] [MAIN ] RDW: Generated 1820 derivative records from 52794 primary records. [2025-09-29T02:21:38.713398] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-29T02:21:38.733034] [DEBUG] [LOCAL ] RDW: Derivative data saved (1820 records). [2025-09-29T02:21:38.734010] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-29T02:21:38.737842] [INFO ] [MAIN ] Derivative Progress: 1660/2211 symbols completed. RDW took 1.3s. Estimated remaining: 3m 53s. Rate: 141.9 symbols/min [2025-09-29T02:21:38.738743] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:38.767117] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:38.781363] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:38.780968] [INFO ] [MAIN ] RDY: Generated 1820 derivative records from 47418 primary records. [2025-09-29T02:21:38.782539] [INFO ] [MAIN ] RELX: Generated 1820 derivative records from 48567 primary records. [2025-09-29T02:21:38.782735] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-29T02:21:38.782838] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-29T02:21:38.827932] [DEBUG] [LOCAL ] RDY: Derivative data saved (1820 records). [2025-09-29T02:21:38.829343] [DEBUG] [LOCAL ] RELX: Derivative data saved (1820 records). [2025-09-29T02:21:38.829420] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-29T02:21:38.829518] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-29T02:21:38.832550] [INFO ] [MAIN ] Derivative Progress: 1661/2211 symbols completed. RELX took 1.3s. Estimated remaining: 3m 52s. Rate: 142.0 symbols/min [2025-09-29T02:21:38.836482] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:38.836728] [INFO ] [MAIN ] Derivative Progress: 1662/2211 symbols completed. RDY took 1.4s. Estimated remaining: 3m 52s. Rate: 142.1 symbols/min [2025-09-29T02:21:38.849865] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:38.851425] [DEBUG] [LOCAL ] RERE: Loaded 41690 existing records from primary storage. [2025-09-29T02:21:38.851800] [INFO ] [MAIN ] RERE: Loaded 41690 primary data records. [2025-09-29T02:21:39.270422] [DEBUG] [LOCAL ] REVG: Loaded 41461 existing records from primary storage. [2025-09-29T02:21:39.272258] [DEBUG] [LOCAL ] RES: Loaded 48190 existing records from primary storage. [2025-09-29T02:21:39.272362] [INFO ] [MAIN ] REVG: Loaded 41461 primary data records. [2025-09-29T02:21:39.272951] [INFO ] [MAIN ] RES: Loaded 48190 primary data records. [2025-09-29T02:21:39.990799] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:39.993505] [INFO ] [MAIN ] RERE: Generated 1820 derivative records from 41690 primary records. [2025-09-29T02:21:39.993951] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-29T02:21:40.013590] [DEBUG] [LOCAL ] RERE: Derivative data saved (1820 records). [2025-09-29T02:21:40.015318] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-29T02:21:40.018239] [INFO ] [MAIN ] Derivative Progress: 1663/2211 symbols completed. RERE took 1.3s. Estimated remaining: 3m 52s. Rate: 141.9 symbols/min [2025-09-29T02:21:40.043486] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:40.046270] [INFO ] [MAIN ] RES: Generated 1820 derivative records from 48190 primary records. [2025-09-29T02:21:40.046393] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-29T02:21:40.086881] [DEBUG] [LOCAL ] RES: Derivative data saved (1820 records). [2025-09-29T02:21:40.087410] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-29T02:21:40.091405] [INFO ] [MAIN ] Derivative Progress: 1664/2211 symbols completed. RES took 1.3s. Estimated remaining: 3m 51s. Rate: 142.0 symbols/min [2025-09-29T02:21:40.087960] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:40.092899] [INFO ] [MAIN ] REVG: Generated 1820 derivative records from 41461 primary records. [2025-09-29T02:21:40.093028] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-29T02:21:40.119582] [DEBUG] [LOCAL ] REVG: Derivative data saved (1820 records). [2025-09-29T02:21:40.119821] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-29T02:21:40.123340] [INFO ] [MAIN ] Derivative Progress: 1665/2211 symbols completed. REVG took 1.3s. Estimated remaining: 3m 51s. Rate: 142.1 symbols/min [2025-09-29T02:21:40.124073] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:40.123973] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:40.124164] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:40.150639] [DEBUG] [LOCAL ] REX: Loaded 14221 existing records from primary storage. [2025-09-29T02:21:40.151413] [INFO ] [MAIN ] REX: Loaded 14221 primary data records. [2025-09-29T02:21:40.607736] [DEBUG] [LOCAL ] REZI: Loaded 47576 existing records from primary storage. [2025-09-29T02:21:40.605939] [DEBUG] [LOCAL ] REXR: Loaded 52852 existing records from primary storage. [2025-09-29T02:21:40.608263] [INFO ] [MAIN ] REZI: Loaded 47576 primary data records. [2025-09-29T02:21:40.608507] [INFO ] [MAIN ] REXR: Loaded 52852 primary data records. [2025-09-29T02:21:41.400458] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:41.401711] [INFO ] [MAIN ] REX: Generated 1820 derivative records from 14221 primary records. [2025-09-29T02:21:41.403200] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-29T02:21:41.424538] [DEBUG] [LOCAL ] REX: Derivative data saved (1820 records). [2025-09-29T02:21:41.425096] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-29T02:21:41.427947] [INFO ] [MAIN ] Derivative Progress: 1666/2211 symbols completed. REX took 1.3s. Estimated remaining: 3m 50s. Rate: 141.9 symbols/min [2025-09-29T02:21:41.428294] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:41.447034] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:41.448335] [INFO ] [MAIN ] REZI: Generated 1820 derivative records from 47576 primary records. [2025-09-29T02:21:41.448786] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-29T02:21:41.472297] [DEBUG] [LOCAL ] REZI: Derivative data saved (1820 records). [2025-09-29T02:21:41.486126] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-29T02:21:41.485960] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:41.490017] [INFO ] [MAIN ] REXR: Generated 1820 derivative records from 52852 primary records. [2025-09-29T02:21:41.490234] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-29T02:21:41.489110] [INFO ] [MAIN ] Derivative Progress: 1667/2211 symbols completed. REZI took 1.4s. Estimated remaining: 3m 50s. Rate: 142.0 symbols/min [2025-09-29T02:21:41.491521] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:41.510564] [DEBUG] [LOCAL ] REXR: Derivative data saved (1820 records). [2025-09-29T02:21:41.510713] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-29T02:21:41.513496] [INFO ] [MAIN ] Derivative Progress: 1668/2211 symbols completed. REXR took 1.4s. Estimated remaining: 3m 49s. Rate: 142.0 symbols/min [2025-09-29T02:21:41.513968] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:41.543461] [DEBUG] [LOCAL ] RFI: Loaded 10550 existing records from primary storage. [2025-09-29T02:21:41.545805] [INFO ] [MAIN ] RFI: Loaded 10550 primary data records. [2025-09-29T02:21:41.631523] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-29T02:21:41.632026] [DEBUG] [LOCAL ] RFL: Loaded 11051 existing records from primary storage. [2025-09-29T02:21:41.671749] [INFO ] [MAIN ] RFL: Loaded 11051 primary data records. [2025-09-29T02:21:41.672055] [INFO ] [MAIN ] RF: Loaded 54410 primary data records. [2025-09-29T02:21:42.609479] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:42.611008] [INFO ] [MAIN ] RFI: Generated 1820 derivative records from 10550 primary records. [2025-09-29T02:21:42.611454] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-29T02:21:42.652731] [DEBUG] [LOCAL ] RFI: Derivative data saved (1820 records). [2025-09-29T02:21:42.653733] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-29T02:21:42.653329] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:42.655984] [INFO ] [MAIN ] Derivative Progress: 1669/2211 symbols completed. RFI took 1.2s. Estimated remaining: 3m 49s. Rate: 141.9 symbols/min [2025-09-29T02:21:42.656254] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:42.670722] [INFO ] [MAIN ] RF: Generated 1820 derivative records from 54410 primary records. [2025-09-29T02:21:42.671157] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:42.671302] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-29T02:21:42.672612] [INFO ] [MAIN ] RFL: Generated 1820 derivative records from 11051 primary records. [2025-09-29T02:21:42.673778] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-29T02:21:42.700660] [DEBUG] [LOCAL ] RFL: Derivative data saved (1820 records). [2025-09-29T02:21:42.705401] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-29T02:21:42.708208] [INFO ] [MAIN ] Derivative Progress: 1670/2211 symbols completed. RFL took 1.2s. Estimated remaining: 3m 49s. Rate: 142.0 symbols/min [2025-09-29T02:21:42.712198] [DEBUG] [LOCAL ] RFM: Loaded 4196 existing records from primary storage. [2025-09-29T02:21:42.711890] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:42.715380] [DEBUG] [LOCAL ] RF: Derivative data saved (1820 records). [2025-09-29T02:21:42.715772] [INFO ] [MAIN ] RFM: Loaded 4196 primary data records. [2025-09-29T02:21:42.716424] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-29T02:21:42.724605] [INFO ] [MAIN ] Derivative Progress: 1671/2211 symbols completed. RF took 1.3s. Estimated remaining: 3m 48s. Rate: 142.1 symbols/min [2025-09-29T02:21:42.742859] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:42.801093] [DEBUG] [LOCAL ] RFMZ: Loaded 8822 existing records from primary storage. [2025-09-29T02:21:42.826897] [INFO ] [MAIN ] RFMZ: Loaded 8822 primary data records. [2025-09-29T02:21:43.229148] [DEBUG] [LOCAL ] RGA: Loaded 30535 existing records from primary storage. [2025-09-29T02:21:43.292164] [INFO ] [MAIN ] RGA: Loaded 30535 primary data records. [2025-09-29T02:21:43.829174] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:43.831521] [INFO ] [MAIN ] RFM: Generated 1820 derivative records from 4196 primary records. [2025-09-29T02:21:43.831901] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-29T02:21:43.867108] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:43.868130] [DEBUG] [LOCAL ] RFM: Derivative data saved (1820 records). [2025-09-29T02:21:43.869698] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-29T02:21:43.872109] [INFO ] [MAIN ] Derivative Progress: 1672/2211 symbols completed. RFM took 1.2s. Estimated remaining: 3m 48s. Rate: 141.9 symbols/min [2025-09-29T02:21:43.869577] [INFO ] [MAIN ] RFMZ: Generated 1820 derivative records from 8822 primary records. [2025-09-29T02:21:43.872464] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:43.873240] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-29T02:21:43.910690] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1820 records). [2025-09-29T02:21:43.911250] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:43.912328] [INFO ] [MAIN ] RGA: Generated 1820 derivative records from 30535 primary records. [2025-09-29T02:21:43.911542] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-29T02:21:43.916068] [INFO ] [MAIN ] Derivative Progress: 1673/2211 symbols completed. RFMZ took 1.2s. Estimated remaining: 3m 47s. Rate: 142.0 symbols/min [2025-09-29T02:21:43.916304] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:43.912440] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-29T02:21:43.940747] [DEBUG] [LOCAL ] RGA: Derivative data saved (1820 records). [2025-09-29T02:21:43.941373] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-29T02:21:43.944432] [INFO ] [MAIN ] Derivative Progress: 1674/2211 symbols completed. RGA took 1.2s. Estimated remaining: 3m 47s. Rate: 142.1 symbols/min [2025-09-29T02:21:43.947404] [DEBUG] [LOCAL ] RGT: Loaded 2885 existing records from primary storage. [2025-09-29T02:21:43.947551] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:43.947855] [INFO ] [MAIN ] RGT: Loaded 2885 primary data records. [2025-09-29T02:21:43.975985] [DEBUG] [LOCAL ] RGR: Loaded 20706 existing records from primary storage. [2025-09-29T02:21:43.995142] [INFO ] [MAIN ] RGR: Loaded 20706 primary data records. [2025-09-29T02:21:44.655154] [DEBUG] [LOCAL ] RH: Loaded 48340 existing records from primary storage. [2025-09-29T02:21:44.656263] [INFO ] [MAIN ] RH: Loaded 48340 primary data records. [2025-09-29T02:21:45.063907] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:45.064815] [INFO ] [MAIN ] RGT: Generated 1820 derivative records from 2885 primary records. [2025-09-29T02:21:45.066370] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-29T02:21:45.086310] [DEBUG] [LOCAL ] RGT: Derivative data saved (1820 records). [2025-09-29T02:21:45.094763] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-29T02:21:45.097538] [INFO ] [MAIN ] Derivative Progress: 1675/2211 symbols completed. RGT took 1.2s. Estimated remaining: 3m 47s. Rate: 141.9 symbols/min [2025-09-29T02:21:45.097943] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:45.105454] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:45.106575] [INFO ] [MAIN ] RGR: Generated 1820 derivative records from 20706 primary records. [2025-09-29T02:21:45.107174] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-29T02:21:45.127339] [DEBUG] [LOCAL ] RGR: Derivative data saved (1820 records). [2025-09-29T02:21:45.129676] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-29T02:21:45.132900] [INFO ] [MAIN ] Derivative Progress: 1676/2211 symbols completed. RGR took 1.3s. Estimated remaining: 3m 46s. Rate: 142.0 symbols/min [2025-09-29T02:21:45.133418] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:45.148127] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:45.148978] [INFO ] [MAIN ] RH: Generated 1820 derivative records from 48340 primary records. [2025-09-29T02:21:45.149072] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-29T02:21:45.165921] [DEBUG] [LOCAL ] RH: Derivative data saved (1820 records). [2025-09-29T02:21:45.166172] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-29T02:21:45.168798] [INFO ] [MAIN ] Derivative Progress: 1677/2211 symbols completed. RH took 1.2s. Estimated remaining: 3m 46s. Rate: 142.1 symbols/min [2025-09-29T02:21:45.169120] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:45.216219] [DEBUG] [LOCAL ] RHI: Loaded 49995 existing records from primary storage. [2025-09-29T02:21:45.216476] [INFO ] [MAIN ] RHI: Loaded 49995 primary data records. [2025-09-29T02:21:45.439115] [DEBUG] [LOCAL ] RHP: Loaded 42305 existing records from primary storage. [2025-09-29T02:21:45.460584] [INFO ] [MAIN ] RHP: Loaded 42305 primary data records. [2025-09-29T02:21:45.594730] [DEBUG] [LOCAL ] RIG: Loaded 54449 existing records from primary storage. [2025-09-29T02:21:45.611173] [INFO ] [MAIN ] RIG: Loaded 54449 primary data records. [2025-09-29T02:21:46.315838] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:46.316860] [INFO ] [MAIN ] RHI: Generated 1820 derivative records from 49995 primary records. [2025-09-29T02:21:46.317512] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-29T02:21:46.336567] [DEBUG] [LOCAL ] RHI: Derivative data saved (1820 records). [2025-09-29T02:21:46.338890] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-29T02:21:46.342521] [INFO ] [MAIN ] Derivative Progress: 1678/2211 symbols completed. RHI took 1.2s. Estimated remaining: 3m 45s. Rate: 141.9 symbols/min [2025-09-29T02:21:46.357410] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:46.359399] [INFO ] [MAIN ] RHP: Generated 1820 derivative records from 42305 primary records. [2025-09-29T02:21:46.360442] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-29T02:21:46.383850] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:46.389708] [INFO ] [MAIN ] RIG: Generated 1820 derivative records from 54449 primary records. [2025-09-29T02:21:46.392234] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-29T02:21:46.394203] [DEBUG] [LOCAL ] RHP: Derivative data saved (1820 records). [2025-09-29T02:21:46.395186] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-29T02:21:46.398243] [INFO ] [MAIN ] Derivative Progress: 1679/2211 symbols completed. RHP took 1.3s. Estimated remaining: 3m 45s. Rate: 142.0 symbols/min [2025-09-29T02:21:46.413896] [DEBUG] [LOCAL ] RIG: Derivative data saved (1820 records). [2025-09-29T02:21:46.414021] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-29T02:21:46.417286] [INFO ] [MAIN ] Derivative Progress: 1680/2211 symbols completed. RIG took 1.2s. Estimated remaining: 3m 44s. Rate: 142.1 symbols/min [2025-09-29T02:21:46.417839] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:46.417791] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:46.417916] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:46.438552] [DEBUG] [LOCAL ] RIV: Loaded 12193 existing records from primary storage. [2025-09-29T02:21:46.438830] [INFO ] [MAIN ] RIV: Loaded 12193 primary data records. [2025-09-29T02:21:46.843487] [DEBUG] [LOCAL ] RIO: Loaded 54173 existing records from primary storage. [2025-09-29T02:21:46.846682] [DEBUG] [LOCAL ] RITM: Loaded 53589 existing records from primary storage. [2025-09-29T02:21:46.846986] [INFO ] [MAIN ] RITM: Loaded 53589 primary data records. [2025-09-29T02:21:46.847057] [INFO ] [MAIN ] RIO: Loaded 54173 primary data records. [2025-09-29T02:21:47.614780] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:47.617141] [INFO ] [MAIN ] RIV: Generated 1820 derivative records from 12193 primary records. [2025-09-29T02:21:47.617482] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-29T02:21:47.639530] [DEBUG] [LOCAL ] RIV: Derivative data saved (1820 records). [2025-09-29T02:21:47.639964] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-29T02:21:47.643429] [INFO ] [MAIN ] Derivative Progress: 1681/2211 symbols completed. RIV took 1.2s. Estimated remaining: 3m 44s. Rate: 141.9 symbols/min [2025-09-29T02:21:47.644303] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:47.667034] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:47.668873] [INFO ] [MAIN ] RIO: Generated 1820 derivative records from 54173 primary records. [2025-09-29T02:21:47.669064] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-29T02:21:47.703404] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:47.703517] [DEBUG] [LOCAL ] RIO: Derivative data saved (1820 records). [2025-09-29T02:21:47.703980] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-29T02:21:47.705117] [INFO ] [MAIN ] RITM: Generated 1820 derivative records from 53589 primary records. [2025-09-29T02:21:47.708508] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-29T02:21:47.708160] [INFO ] [MAIN ] Derivative Progress: 1682/2211 symbols completed. RIO took 1.3s. Estimated remaining: 3m 44s. Rate: 142.0 symbols/min [2025-09-29T02:21:47.709698] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:47.729921] [DEBUG] [LOCAL ] RITM: Derivative data saved (1820 records). [2025-09-29T02:21:47.742376] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-29T02:21:47.744925] [INFO ] [MAIN ] Derivative Progress: 1683/2211 symbols completed. RITM took 1.3s. Estimated remaining: 3m 43s. Rate: 142.1 symbols/min [2025-09-29T02:21:47.745389] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:47.771682] [DEBUG] [LOCAL ] RJF: Loaded 47804 existing records from primary storage. [2025-09-29T02:21:47.772131] [INFO ] [MAIN ] RJF: Loaded 47804 primary data records. [2025-09-29T02:21:48.178881] [DEBUG] [LOCAL ] RL: Loaded 41998 existing records from primary storage. [2025-09-29T02:21:48.176008] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-09-29T02:21:48.179519] [INFO ] [MAIN ] RL: Loaded 41998 primary data records. [2025-09-29T02:21:48.179820] [INFO ] [MAIN ] RKT: Loaded 54501 primary data records. [2025-09-29T02:21:49.093936] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:49.121134] [INFO ] [MAIN ] RJF: Generated 1820 derivative records from 47804 primary records. [2025-09-29T02:21:49.123717] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-29T02:21:49.153112] [DEBUG] [LOCAL ] RJF: Derivative data saved (1820 records). [2025-09-29T02:21:49.154321] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-29T02:21:49.159777] [INFO ] [MAIN ] Derivative Progress: 1684/2211 symbols completed. RJF took 1.5s. Estimated remaining: 3m 43s. Rate: 141.9 symbols/min [2025-09-29T02:21:49.161010] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:49.203202] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:21:49.208994] [INFO ] [MAIN ] RL: Generated 1819 derivative records from 41998 primary records. [2025-09-29T02:21:49.209690] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-29T02:21:49.258626] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:49.277591] [INFO ] [MAIN ] RKT: Generated 1820 derivative records from 54501 primary records. [2025-09-29T02:21:49.281185] [DEBUG] [LOCAL ] RL: Derivative data saved (1819 records). [2025-09-29T02:21:49.281702] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-29T02:21:49.282229] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-29T02:21:49.289108] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-29T02:21:49.289868] [INFO ] [MAIN ] RLI: Loaded 33794 primary data records. [2025-09-29T02:21:49.287494] [INFO ] [MAIN ] Derivative Progress: 1685/2211 symbols completed. RL took 1.5s. Estimated remaining: 3m 42s. Rate: 141.9 symbols/min [2025-09-29T02:21:49.290204] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:49.440922] [DEBUG] [LOCAL ] RKT: Derivative data saved (1820 records). [2025-09-29T02:21:49.458047] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-29T02:21:49.494741] [INFO ] [MAIN ] Derivative Progress: 1686/2211 symbols completed. RKT took 1.8s. Estimated remaining: 3m 42s. Rate: 142.0 symbols/min [2025-09-29T02:21:49.561186] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:49.746056] [DEBUG] [LOCAL ] RLJ: Loaded 48922 existing records from primary storage. [2025-09-29T02:21:49.749565] [INFO ] [MAIN ] RLJ: Loaded 48922 primary data records. [2025-09-29T02:21:49.803445] [DEBUG] [LOCAL ] RLTY: Loaded 11255 existing records from primary storage. [2025-09-29T02:21:49.828282] [INFO ] [MAIN ] RLTY: Loaded 11255 primary data records. [2025-09-29T02:21:50.448802] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:50.451278] [INFO ] [MAIN ] RLI: Generated 1820 derivative records from 33794 primary records. [2025-09-29T02:21:50.451834] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-29T02:21:50.470988] [DEBUG] [LOCAL ] RLI: Derivative data saved (1820 records). [2025-09-29T02:21:50.471239] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-29T02:21:50.473953] [INFO ] [MAIN ] Derivative Progress: 1687/2211 symbols completed. RLI took 1.3s. Estimated remaining: 3m 42s. Rate: 141.9 symbols/min [2025-09-29T02:21:50.475959] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:50.501583] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:50.502997] [INFO ] [MAIN ] RLJ: Generated 1820 derivative records from 48922 primary records. [2025-09-29T02:21:50.503355] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-29T02:21:50.518339] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:50.519554] [INFO ] [MAIN ] RLTY: Generated 1820 derivative records from 11255 primary records. [2025-09-29T02:21:50.520042] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-29T02:21:50.550701] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1820 records). [2025-09-29T02:21:50.566668] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1820 records). [2025-09-29T02:21:50.566887] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-29T02:21:50.567008] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-29T02:21:50.570528] [INFO ] [MAIN ] Derivative Progress: 1688/2211 symbols completed. RLTY took 1.0s. Estimated remaining: 3m 41s. Rate: 141.9 symbols/min [2025-09-29T02:21:50.573825] [INFO ] [MAIN ] Derivative Progress: 1689/2211 symbols completed. RLJ took 1.3s. Estimated remaining: 3m 41s. Rate: 142.0 symbols/min [2025-09-29T02:21:50.573725] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:50.574291] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:50.598122] [DEBUG] [LOCAL ] RLX: Loaded 48987 existing records from primary storage. [2025-09-29T02:21:50.598710] [INFO ] [MAIN ] RLX: Loaded 48987 primary data records. [2025-09-29T02:21:50.699378] [DEBUG] [LOCAL ] RM: Loaded 7734 existing records from primary storage. [2025-09-29T02:21:50.719268] [INFO ] [MAIN ] RM: Loaded 7734 primary data records. [2025-09-29T02:21:50.742696] [DEBUG] [LOCAL ] RMAX: Loaded 22121 existing records from primary storage. [2025-09-29T02:21:50.743341] [INFO ] [MAIN ] RMAX: Loaded 22121 primary data records. [2025-09-29T02:21:51.683722] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:51.684810] [INFO ] [MAIN ] RLX: Generated 1820 derivative records from 48987 primary records. [2025-09-29T02:21:51.685404] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-29T02:21:51.705193] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:51.708454] [INFO ] [MAIN ] RM: Generated 1820 derivative records from 7734 primary records. [2025-09-29T02:21:51.717617] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-29T02:21:51.757028] [DEBUG] [LOCAL ] RLX: Derivative data saved (1820 records). [2025-09-29T02:21:51.757973] [DEBUG] [LOCAL ] RM: Derivative data saved (1820 records). [2025-09-29T02:21:51.758180] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-29T02:21:51.754246] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:51.758366] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-29T02:21:51.761952] [INFO ] [MAIN ] RMAX: Generated 1820 derivative records from 22121 primary records. [2025-09-29T02:21:51.760936] [INFO ] [MAIN ] Derivative Progress: 1690/2211 symbols completed. RM took 1.2s. Estimated remaining: 3m 40s. Rate: 141.9 symbols/min [2025-09-29T02:21:51.765155] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:51.765573] [INFO ] [MAIN ] Derivative Progress: 1691/2211 symbols completed. RLX took 1.3s. Estimated remaining: 3m 40s. Rate: 141.9 symbols/min [2025-09-29T02:21:51.765422] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-29T02:21:51.766303] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:51.785371] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1820 records). [2025-09-29T02:21:51.787008] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-29T02:21:51.790066] [INFO ] [MAIN ] Derivative Progress: 1692/2211 symbols completed. RMAX took 1.2s. Estimated remaining: 3m 39s. Rate: 142.0 symbols/min [2025-09-29T02:21:51.790317] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:51.794977] [DEBUG] [LOCAL ] RMI: Loaded 4716 existing records from primary storage. [2025-09-29T02:21:51.795154] [INFO ] [MAIN ] RMI: Loaded 4716 primary data records. [2025-09-29T02:21:51.913971] [DEBUG] [LOCAL ] RMM: Loaded 10624 existing records from primary storage. [2025-09-29T02:21:51.939814] [INFO ] [MAIN ] RMM: Loaded 10624 primary data records. [2025-09-29T02:21:52.060228] [DEBUG] [LOCAL ] RMD: Loaded 42855 existing records from primary storage. [2025-09-29T02:21:52.156692] [INFO ] [MAIN ] RMD: Loaded 42855 primary data records. [2025-09-29T02:21:52.943804] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:52.946089] [INFO ] [MAIN ] RMI: Generated 1820 derivative records from 4716 primary records. [2025-09-29T02:21:52.946941] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-29T02:21:52.967530] [DEBUG] [LOCAL ] RMI: Derivative data saved (1820 records). [2025-09-29T02:21:52.969412] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-29T02:21:52.972044] [INFO ] [MAIN ] Derivative Progress: 1693/2211 symbols completed. RMI took 1.2s. Estimated remaining: 3m 39s. Rate: 141.9 symbols/min [2025-09-29T02:21:52.988141] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:52.989187] [INFO ] [MAIN ] RMM: Generated 1820 derivative records from 10624 primary records. [2025-09-29T02:21:52.989425] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-29T02:21:53.011444] [DEBUG] [LOCAL ] RMM: Derivative data saved (1820 records). [2025-09-29T02:21:53.011830] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-29T02:21:53.014677] [INFO ] [MAIN ] Derivative Progress: 1694/2211 symbols completed. RMM took 1.2s. Estimated remaining: 3m 39s. Rate: 141.9 symbols/min [2025-09-29T02:21:53.028257] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:53.029027] [INFO ] [MAIN ] RMD: Generated 1820 derivative records from 42855 primary records. [2025-09-29T02:21:53.029121] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-29T02:21:53.045860] [DEBUG] [LOCAL ] RMD: Derivative data saved (1820 records). [2025-09-29T02:21:53.046030] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-29T02:21:53.049458] [INFO ] [MAIN ] Derivative Progress: 1695/2211 symbols completed. RMD took 1.3s. Estimated remaining: 3m 38s. Rate: 142.0 symbols/min [2025-09-29T02:21:53.050023] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:53.050335] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:53.050201] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:53.063724] [DEBUG] [LOCAL ] RMMZ: Loaded 4875 existing records from primary storage. [2025-09-29T02:21:53.064181] [INFO ] [MAIN ] RMMZ: Loaded 4875 primary data records. [2025-09-29T02:21:53.153363] [DEBUG] [LOCAL ] RMT: Loaded 17682 existing records from primary storage. [2025-09-29T02:21:53.174461] [INFO ] [MAIN ] RMT: Loaded 17682 primary data records. [2025-09-29T02:21:53.449206] [DEBUG] [LOCAL ] RNG: Loaded 48830 existing records from primary storage. [2025-09-29T02:21:53.510977] [INFO ] [MAIN ] RNG: Loaded 48830 primary data records. [2025-09-29T02:21:54.249032] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:54.253464] [INFO ] [MAIN ] RMMZ: Generated 1820 derivative records from 4875 primary records. [2025-09-29T02:21:54.267051] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-29T02:21:54.267963] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:54.269471] [INFO ] [MAIN ] RMT: Generated 1820 derivative records from 17682 primary records. [2025-09-29T02:21:54.270535] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-29T02:21:54.303984] [DEBUG] [LOCAL ] RMT: Derivative data saved (1820 records). [2025-09-29T02:21:54.305061] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1820 records). [2025-09-29T02:21:54.305916] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-29T02:21:54.305560] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-29T02:21:54.308800] [INFO ] [MAIN ] Derivative Progress: 1696/2211 symbols completed. RMT took 1.3s. Estimated remaining: 3m 38s. Rate: 141.9 symbols/min [2025-09-29T02:21:54.311738] [INFO ] [MAIN ] Derivative Progress: 1697/2211 symbols completed. RMMZ took 1.3s. Estimated remaining: 3m 37s. Rate: 141.9 symbols/min [2025-09-29T02:21:54.309166] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:54.312930] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:54.331428] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:54.332391] [INFO ] [MAIN ] RNG: Generated 1820 derivative records from 48830 primary records. [2025-09-29T02:21:54.332501] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-29T02:21:54.360244] [DEBUG] [LOCAL ] RNG: Derivative data saved (1820 records). [2025-09-29T02:21:54.367170] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-29T02:21:54.371024] [DEBUG] [LOCAL ] RNP: Loaded 15940 existing records from primary storage. [2025-09-29T02:21:54.370210] [INFO ] [MAIN ] Derivative Progress: 1698/2211 symbols completed. RNG took 1.3s. Estimated remaining: 3m 37s. Rate: 142.0 symbols/min [2025-09-29T02:21:54.380722] [INFO ] [MAIN ] RNP: Loaded 15940 primary data records. [2025-09-29T02:21:54.381812] [DEBUG] [LOCAL ] RNGR: Loaded 20653 existing records from primary storage. [2025-09-29T02:21:54.380890] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:54.404589] [INFO ] [MAIN ] RNGR: Loaded 20653 primary data records. [2025-09-29T02:21:54.805193] [DEBUG] [LOCAL ] RNR: Loaded 34623 existing records from primary storage. [2025-09-29T02:21:54.955168] [INFO ] [MAIN ] RNR: Loaded 34623 primary data records. [2025-09-29T02:21:55.459605] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:55.474201] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:55.476846] [INFO ] [MAIN ] RNGR: Generated 1820 derivative records from 20653 primary records. [2025-09-29T02:21:55.473982] [INFO ] [MAIN ] RNP: Generated 1820 derivative records from 15940 primary records. [2025-09-29T02:21:55.477082] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-29T02:21:55.478207] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-29T02:21:55.511777] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1820 records). [2025-09-29T02:21:55.516890] [DEBUG] [LOCAL ] RNP: Derivative data saved (1820 records). [2025-09-29T02:21:55.517211] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-29T02:21:55.517101] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-29T02:21:55.520813] [INFO ] [MAIN ] Derivative Progress: 1699/2211 symbols completed. RNP took 1.2s. Estimated remaining: 3m 37s. Rate: 141.9 symbols/min [2025-09-29T02:21:55.525331] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:55.525593] [INFO ] [MAIN ] Derivative Progress: 1700/2211 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 36s. Rate: 141.9 symbols/min [2025-09-29T02:21:55.526479] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:55.546046] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:55.548137] [INFO ] [MAIN ] RNR: Generated 1820 derivative records from 34623 primary records. [2025-09-29T02:21:55.548418] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-29T02:21:55.575594] [DEBUG] [LOCAL ] RNR: Derivative data saved (1820 records). [2025-09-29T02:21:55.575858] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-29T02:21:55.579359] [INFO ] [MAIN ] Derivative Progress: 1701/2211 symbols completed. RNR took 1.2s. Estimated remaining: 3m 35s. Rate: 142.0 symbols/min [2025-09-29T02:21:55.579630] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:55.592630] [DEBUG] [LOCAL ] ROG: Loaded 23367 existing records from primary storage. [2025-09-29T02:21:55.593028] [INFO ] [MAIN ] ROG: Loaded 23367 primary data records. [2025-09-29T02:21:55.743688] [DEBUG] [LOCAL ] RNST: Loaded 37619 existing records from primary storage. [2025-09-29T02:21:55.743977] [INFO ] [MAIN ] RNST: Loaded 37619 primary data records. [2025-09-29T02:21:56.133681] [DEBUG] [LOCAL ] ROK: Loaded 44522 existing records from primary storage. [2025-09-29T02:21:56.140627] [INFO ] [MAIN ] ROK: Loaded 44522 primary data records. [2025-09-29T02:21:56.813093] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:56.814486] [INFO ] [MAIN ] ROG: Generated 1820 derivative records from 23367 primary records. [2025-09-29T02:21:56.815090] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-29T02:21:56.835024] [DEBUG] [LOCAL ] ROG: Derivative data saved (1820 records). [2025-09-29T02:21:56.836110] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-29T02:21:56.838953] [INFO ] [MAIN ] Derivative Progress: 1702/2211 symbols completed. ROG took 1.3s. Estimated remaining: 3m 35s. Rate: 141.9 symbols/min [2025-09-29T02:21:56.840453] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:56.864859] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:56.865759] [INFO ] [MAIN ] RNST: Generated 1820 derivative records from 37619 primary records. [2025-09-29T02:21:56.865896] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-29T02:21:56.882815] [DEBUG] [LOCAL ] RNST: Derivative data saved (1820 records). [2025-09-29T02:21:56.883037] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-29T02:21:56.887075] [INFO ] [MAIN ] Derivative Progress: 1703/2211 symbols completed. RNST took 1.4s. Estimated remaining: 3m 35s. Rate: 141.9 symbols/min [2025-09-29T02:21:56.887366] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:56.908124] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:56.910068] [INFO ] [MAIN ] ROK: Generated 1820 derivative records from 44522 primary records. [2025-09-29T02:21:56.910517] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-29T02:21:56.944309] [DEBUG] [LOCAL ] ROK: Derivative data saved (1820 records). [2025-09-29T02:21:56.944746] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-29T02:21:56.948705] [INFO ] [MAIN ] Derivative Progress: 1704/2211 symbols completed. ROK took 1.4s. Estimated remaining: 3m 34s. Rate: 142.0 symbols/min [2025-09-29T02:21:56.949067] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:56.971121] [DEBUG] [LOCAL ] ROL: Loaded 51031 existing records from primary storage. [2025-09-29T02:21:56.982711] [INFO ] [MAIN ] ROL: Loaded 51031 primary data records. [2025-09-29T02:21:57.122877] [DEBUG] [LOCAL ] RPT: Loaded 19767 existing records from primary storage. [2025-09-29T02:21:57.147268] [DEBUG] [LOCAL ] RPM: Loaded 41763 existing records from primary storage. [2025-09-29T02:21:57.158113] [INFO ] [MAIN ] RPM: Loaded 41763 primary data records. [2025-09-29T02:21:57.144833] [INFO ] [MAIN ] RPT: Loaded 19767 primary data records. [2025-09-29T02:21:58.166445] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:58.168401] [INFO ] [MAIN ] ROL: Generated 1820 derivative records from 51031 primary records. [2025-09-29T02:21:58.169968] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-29T02:21:58.200774] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:58.203319] [INFO ] [MAIN ] RPT: Generated 1820 derivative records from 19767 primary records. [2025-09-29T02:21:58.204052] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-29T02:21:58.226352] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:58.239823] [INFO ] [MAIN ] RPM: Generated 1820 derivative records from 41763 primary records. [2025-09-29T02:21:58.244524] [DEBUG] [LOCAL ] RPT: Derivative data saved (1820 records). [2025-09-29T02:21:58.240983] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-29T02:21:58.244708] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-29T02:21:58.248058] [INFO ] [MAIN ] Derivative Progress: 1705/2211 symbols completed. RPT took 1.3s. Estimated remaining: 3m 34s. Rate: 141.8 symbols/min [2025-09-29T02:21:58.248285] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:58.238233] [DEBUG] [LOCAL ] ROL: Derivative data saved (1820 records). [2025-09-29T02:21:58.249988] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-29T02:21:58.253598] [INFO ] [MAIN ] Derivative Progress: 1706/2211 symbols completed. ROL took 1.4s. Estimated remaining: 3m 34s. Rate: 141.9 symbols/min [2025-09-29T02:21:58.261811] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:58.271103] [DEBUG] [LOCAL ] RPM: Derivative data saved (1820 records). [2025-09-29T02:21:58.271343] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-29T02:21:58.275298] [INFO ] [MAIN ] Derivative Progress: 1707/2211 symbols completed. RPM took 1.4s. Estimated remaining: 3m 33s. Rate: 142.0 symbols/min [2025-09-29T02:21:58.277818] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:58.316179] [DEBUG] [LOCAL ] RQI: Loaded 29573 existing records from primary storage. [2025-09-29T02:21:58.316432] [INFO ] [MAIN ] RQI: Loaded 29573 primary data records. [2025-09-29T02:21:58.515255] [DEBUG] [LOCAL ] RRX: Loaded 41752 existing records from primary storage. [2025-09-29T02:21:58.544585] [DEBUG] [LOCAL ] RRC: Loaded 53554 existing records from primary storage. [2025-09-29T02:21:58.552696] [INFO ] [MAIN ] RRX: Loaded 41752 primary data records. [2025-09-29T02:21:58.554861] [INFO ] [MAIN ] RRC: Loaded 53554 primary data records. [2025-09-29T02:21:59.450085] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:59.451603] [INFO ] [MAIN ] RQI: Generated 1820 derivative records from 29573 primary records. [2025-09-29T02:21:59.452125] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-29T02:21:59.472676] [DEBUG] [LOCAL ] RQI: Derivative data saved (1820 records). [2025-09-29T02:21:59.473481] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-29T02:21:59.478744] [INFO ] [MAIN ] Derivative Progress: 1708/2211 symbols completed. RQI took 1.2s. Estimated remaining: 3m 33s. Rate: 141.8 symbols/min [2025-09-29T02:21:59.495176] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:59.496331] [INFO ] [MAIN ] RRX: Generated 1820 derivative records from 41752 primary records. [2025-09-29T02:21:59.496553] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-29T02:21:59.526459] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:59.528731] [INFO ] [MAIN ] RRC: Generated 1820 derivative records from 53554 primary records. [2025-09-29T02:21:59.529351] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-29T02:21:59.540569] [DEBUG] [LOCAL ] RRX: Derivative data saved (1820 records). [2025-09-29T02:21:59.544230] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-29T02:21:59.550362] [INFO ] [MAIN ] Derivative Progress: 1709/2211 symbols completed. RRX took 1.3s. Estimated remaining: 3m 32s. Rate: 141.9 symbols/min [2025-09-29T02:21:59.551697] [DEBUG] [LOCAL ] RRC: Derivative data saved (1820 records). [2025-09-29T02:21:59.551871] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-29T02:21:59.555038] [INFO ] [MAIN ] Derivative Progress: 1710/2211 symbols completed. RRC took 1.3s. Estimated remaining: 3m 32s. Rate: 142.0 symbols/min [2025-09-29T02:21:59.555594] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:59.555675] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:59.555824] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:59.567305] [DEBUG] [LOCAL ] RSF: Loaded 4192 existing records from primary storage. [2025-09-29T02:21:59.567503] [INFO ] [MAIN ] RSF: Loaded 4192 primary data records. [2025-09-29T02:21:59.787571] [DEBUG] [LOCAL ] RS: Loaded 25864 existing records from primary storage. [2025-09-29T02:21:59.936480] [INFO ] [MAIN ] RS: Loaded 25864 primary data records. [2025-09-29T02:22:00.049253] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-29T02:22:00.072494] [INFO ] [MAIN ] RSG: Loaded 48173 primary data records. [2025-09-29T02:22:00.641255] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:22:00.642984] [INFO ] [MAIN ] RSF: Generated 1819 derivative records from 4192 primary records. [2025-09-29T02:22:00.643701] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-29T02:22:00.661483] [DEBUG] [LOCAL ] RSF: Derivative data saved (1819 records). [2025-09-29T02:22:00.662315] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-29T02:22:00.665058] [INFO ] [MAIN ] Derivative Progress: 1711/2211 symbols completed. RSF took 1.1s. Estimated remaining: 3m 31s. Rate: 141.9 symbols/min [2025-09-29T02:22:00.665575] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:00.686360] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:00.687382] [INFO ] [MAIN ] RS: Generated 1820 derivative records from 25864 primary records. [2025-09-29T02:22:00.687628] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-29T02:22:00.709858] [DEBUG] [LOCAL ] RS: Derivative data saved (1820 records). [2025-09-29T02:22:00.718152] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-29T02:22:00.726576] [INFO ] [MAIN ] Derivative Progress: 1712/2211 symbols completed. RS took 1.2s. Estimated remaining: 3m 31s. Rate: 141.9 symbols/min [2025-09-29T02:22:00.727401] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:00.727064] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:00.728472] [INFO ] [MAIN ] RSG: Generated 1820 derivative records from 48173 primary records. [2025-09-29T02:22:00.728931] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-29T02:22:00.761514] [DEBUG] [LOCAL ] RSG: Derivative data saved (1820 records). [2025-09-29T02:22:00.761734] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-29T02:22:00.765493] [INFO ] [MAIN ] Derivative Progress: 1713/2211 symbols completed. RSG took 1.2s. Estimated remaining: 3m 30s. Rate: 142.0 symbols/min [2025-09-29T02:22:00.767093] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:00.782980] [DEBUG] [LOCAL ] RSI: Loaded 47695 existing records from primary storage. [2025-09-29T02:22:00.783417] [INFO ] [MAIN ] RSI: Loaded 47695 primary data records. [2025-09-29T02:22:00.932392] [DEBUG] [LOCAL ] RSKD: Loaded 34254 existing records from primary storage. [2025-09-29T02:22:00.932710] [INFO ] [MAIN ] RSKD: Loaded 34254 primary data records. [2025-09-29T02:22:01.320725] [DEBUG] [LOCAL ] RTO: Loaded 40847 existing records from primary storage. [2025-09-29T02:22:01.326622] [INFO ] [MAIN ] RTO: Loaded 40847 primary data records. [2025-09-29T02:22:01.925682] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:01.927007] [INFO ] [MAIN ] RSI: Generated 1820 derivative records from 47695 primary records. [2025-09-29T02:22:01.927418] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-29T02:22:01.948408] [DEBUG] [LOCAL ] RSI: Derivative data saved (1820 records). [2025-09-29T02:22:01.948779] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-29T02:22:01.951575] [INFO ] [MAIN ] Derivative Progress: 1714/2211 symbols completed. RSI took 1.3s. Estimated remaining: 3m 30s. Rate: 141.8 symbols/min [2025-09-29T02:22:01.966570] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:01.967217] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:01.968919] [INFO ] [MAIN ] RSKD: Generated 1820 derivative records from 34254 primary records. [2025-09-29T02:22:01.969254] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-29T02:22:02.010370] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1820 records). [2025-09-29T02:22:02.009059] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:02.011322] [INFO ] [MAIN ] RTO: Generated 1820 derivative records from 40847 primary records. [2025-09-29T02:22:02.011495] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-29T02:22:02.011578] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-29T02:22:02.014923] [INFO ] [MAIN ] Derivative Progress: 1715/2211 symbols completed. RSKD took 1.3s. Estimated remaining: 3m 30s. Rate: 141.9 symbols/min [2025-09-29T02:22:02.015948] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:02.034181] [DEBUG] [LOCAL ] RTO: Derivative data saved (1820 records). [2025-09-29T02:22:02.034345] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-29T02:22:02.037879] [INFO ] [MAIN ] Derivative Progress: 1716/2211 symbols completed. RTO took 1.3s. Estimated remaining: 3m 29s. Rate: 142.0 symbols/min [2025-09-29T02:22:02.038305] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:02.113110] [DEBUG] [LOCAL ] RVT: Loaded 27362 existing records from primary storage. [2025-09-29T02:22:02.115583] [INFO ] [MAIN ] RVT: Loaded 27362 primary data records. [2025-09-29T02:22:02.114974] [DEBUG] [LOCAL ] RTX: Loaded 54488 existing records from primary storage. [2025-09-29T02:22:02.115951] [INFO ] [MAIN ] RTX: Loaded 54488 primary data records. [2025-09-29T02:22:02.270951] [DEBUG] [LOCAL ] RVLV: Loaded 48453 existing records from primary storage. [2025-09-29T02:22:02.293756] [INFO ] [MAIN ] RVLV: Loaded 48453 primary data records. [2025-09-29T02:22:03.242738] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:03.243718] [INFO ] [MAIN ] RVT: Generated 1820 derivative records from 27362 primary records. [2025-09-29T02:22:03.244019] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-29T02:22:03.258141] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:03.260228] [INFO ] [MAIN ] RTX: Generated 1820 derivative records from 54488 primary records. [2025-09-29T02:22:03.267911] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-29T02:22:03.293557] [DEBUG] [LOCAL ] RTX: Derivative data saved (1820 records). [2025-09-29T02:22:03.295181] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-29T02:22:03.295629] [DEBUG] [LOCAL ] RVT: Derivative data saved (1820 records). [2025-09-29T02:22:03.299240] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-29T02:22:03.299093] [INFO ] [MAIN ] Derivative Progress: 1717/2211 symbols completed. RTX took 1.3s. Estimated remaining: 3m 29s. Rate: 141.8 symbols/min [2025-09-29T02:22:03.302266] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:03.302335] [INFO ] [MAIN ] Derivative Progress: 1718/2211 symbols completed. RVT took 1.3s. Estimated remaining: 3m 28s. Rate: 141.9 symbols/min [2025-09-29T02:22:03.302698] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:03.328088] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:03.329381] [INFO ] [MAIN ] RVLV: Generated 1820 derivative records from 48453 primary records. [2025-09-29T02:22:03.329569] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-29T02:22:03.367183] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1820 records). [2025-09-29T02:22:03.367375] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-29T02:22:03.372489] [INFO ] [MAIN ] Derivative Progress: 1719/2211 symbols completed. RVLV took 1.4s. Estimated remaining: 3m 28s. Rate: 142.0 symbols/min [2025-09-29T02:22:03.372978] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:03.420974] [DEBUG] [LOCAL ] RWT: Loaded 41352 existing records from primary storage. [2025-09-29T02:22:03.421868] [INFO ] [MAIN ] RWT: Loaded 41352 primary data records. [2025-09-29T02:22:03.575329] [DEBUG] [LOCAL ] RVTY: Loaded 48199 existing records from primary storage. [2025-09-29T02:22:03.575631] [INFO ] [MAIN ] RVTY: Loaded 48199 primary data records. [2025-09-29T02:22:03.895529] [DEBUG] [LOCAL ] RXO: Loaded 48520 existing records from primary storage. [2025-09-29T02:22:03.920207] [INFO ] [MAIN ] RXO: Loaded 48520 primary data records. [2025-09-29T02:22:04.596517] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:04.601019] [INFO ] [MAIN ] RWT: Generated 1820 derivative records from 41352 primary records. [2025-09-29T02:22:04.602358] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-29T02:22:04.625998] [DEBUG] [LOCAL ] RWT: Derivative data saved (1820 records). [2025-09-29T02:22:04.626341] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-29T02:22:04.632236] [INFO ] [MAIN ] Derivative Progress: 1720/2211 symbols completed. RWT took 1.3s. Estimated remaining: 3m 28s. Rate: 141.8 symbols/min [2025-09-29T02:22:04.633559] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:04.649778] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:04.651405] [INFO ] [MAIN ] RVTY: Generated 1820 derivative records from 48199 primary records. [2025-09-29T02:22:04.651868] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-29T02:22:04.683907] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:22:04.687109] [INFO ] [MAIN ] RXO: Generated 1819 derivative records from 48520 primary records. [2025-09-29T02:22:04.687485] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-29T02:22:04.687955] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1820 records). [2025-09-29T02:22:04.688532] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-29T02:22:04.691915] [INFO ] [MAIN ] Derivative Progress: 1721/2211 symbols completed. RVTY took 1.4s. Estimated remaining: 3m 27s. Rate: 141.9 symbols/min [2025-09-29T02:22:04.692273] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:04.709796] [DEBUG] [LOCAL ] RXO: Derivative data saved (1819 records). [2025-09-29T02:22:04.710046] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-29T02:22:04.712986] [INFO ] [MAIN ] Derivative Progress: 1722/2211 symbols completed. RXO took 1.3s. Estimated remaining: 3m 27s. Rate: 142.0 symbols/min [2025-09-29T02:22:04.713240] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:04.780050] [DEBUG] [LOCAL ] RYAM: Loaded 35709 existing records from primary storage. [2025-09-29T02:22:04.781762] [DEBUG] [LOCAL ] RY: Loaded 48606 existing records from primary storage. [2025-09-29T02:22:04.780394] [INFO ] [MAIN ] RYAM: Loaded 35709 primary data records. [2025-09-29T02:22:04.781963] [INFO ] [MAIN ] RY: Loaded 48606 primary data records. [2025-09-29T02:22:05.073082] [DEBUG] [LOCAL ] RYAN: Loaded 44960 existing records from primary storage. [2025-09-29T02:22:05.135359] [INFO ] [MAIN ] RYAN: Loaded 44960 primary data records. [2025-09-29T02:22:05.925190] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:05.940111] [INFO ] [MAIN ] RYAM: Generated 1820 derivative records from 35709 primary records. [2025-09-29T02:22:05.939060] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:05.941379] [INFO ] [MAIN ] RY: Generated 1820 derivative records from 48606 primary records. [2025-09-29T02:22:05.941682] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-29T02:22:05.942087] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-29T02:22:05.969083] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1820 records). [2025-09-29T02:22:05.975705] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-29T02:22:05.981149] [INFO ] [MAIN ] Derivative Progress: 1723/2211 symbols completed. RYAM took 1.3s. Estimated remaining: 3m 26s. Rate: 141.8 symbols/min [2025-09-29T02:22:05.982737] [DEBUG] [LOCAL ] RY: Derivative data saved (1820 records). [2025-09-29T02:22:05.984965] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-29T02:22:05.988250] [INFO ] [MAIN ] Derivative Progress: 1724/2211 symbols completed. RY took 1.4s. Estimated remaining: 3m 26s. Rate: 141.9 symbols/min [2025-09-29T02:22:06.007209] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:06.008335] [INFO ] [MAIN ] RYAN: Generated 1820 derivative records from 44960 primary records. [2025-09-29T02:22:06.008434] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-29T02:22:06.025182] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1820 records). [2025-09-29T02:22:06.025313] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-29T02:22:06.028253] [INFO ] [MAIN ] Derivative Progress: 1725/2211 symbols completed. RYAN took 1.3s. Estimated remaining: 3m 25s. Rate: 142.0 symbols/min [2025-09-29T02:22:06.029306] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:06.029458] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:06.029550] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:06.043246] [DEBUG] [LOCAL ] RZB: Loaded 6291 existing records from primary storage. [2025-09-29T02:22:06.043546] [INFO ] [MAIN ] RZB: Loaded 6291 primary data records. [2025-09-29T02:22:06.195979] [DEBUG] [LOCAL ] RYI: Loaded 21835 existing records from primary storage. [2025-09-29T02:22:06.196966] [INFO ] [MAIN ] RYI: Loaded 21835 primary data records. [2025-09-29T02:22:06.553829] [DEBUG] [LOCAL ] RYN: Loaded 46335 existing records from primary storage. [2025-09-29T02:22:06.560493] [INFO ] [MAIN ] RYN: Loaded 46335 primary data records. [2025-09-29T02:22:07.167271] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:07.170076] [INFO ] [MAIN ] RZB: Generated 1820 derivative records from 6291 primary records. [2025-09-29T02:22:07.171288] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-29T02:22:07.193203] [DEBUG] [LOCAL ] RZB: Derivative data saved (1820 records). [2025-09-29T02:22:07.207367] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-29T02:22:07.210789] [INFO ] [MAIN ] Derivative Progress: 1726/2211 symbols completed. RZB took 1.2s. Estimated remaining: 3m 25s. Rate: 141.8 symbols/min [2025-09-29T02:22:07.211323] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:07.211584] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:07.212601] [INFO ] [MAIN ] RYI: Generated 1820 derivative records from 21835 primary records. [2025-09-29T02:22:07.213934] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-29T02:22:07.245004] [DEBUG] [LOCAL ] RYI: Derivative data saved (1820 records). [2025-09-29T02:22:07.245326] [DEBUG] [LOCAL ] RZC: Loaded 6838 existing records from primary storage. [2025-09-29T02:22:07.246103] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-29T02:22:07.246226] [INFO ] [MAIN ] RZC: Loaded 6838 primary data records. [2025-09-29T02:22:07.254416] [INFO ] [MAIN ] Derivative Progress: 1727/2211 symbols completed. RYI took 1.2s. Estimated remaining: 3m 25s. Rate: 141.9 symbols/min [2025-09-29T02:22:07.264528] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:07.264745] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:07.278406] [INFO ] [MAIN ] RYN: Generated 1820 derivative records from 46335 primary records. [2025-09-29T02:22:07.290739] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-29T02:22:07.401600] [DEBUG] [LOCAL ] RYN: Derivative data saved (1820 records). [2025-09-29T02:22:07.417610] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-29T02:22:07.436994] [INFO ] [MAIN ] Derivative Progress: 1728/2211 symbols completed. RYN took 1.4s. Estimated remaining: 3m 24s. Rate: 141.9 symbols/min [2025-09-29T02:22:07.459972] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:07.725478] [DEBUG] [LOCAL ] S: Loaded 54315 existing records from primary storage. [2025-09-29T02:22:07.726180] [INFO ] [MAIN ] S: Loaded 54315 primary data records. [2025-09-29T02:22:07.900116] [DEBUG] [LOCAL ] SA: Loaded 43820 existing records from primary storage. [2025-09-29T02:22:07.943605] [INFO ] [MAIN ] SA: Loaded 43820 primary data records. [2025-09-29T02:22:07.976894] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:07.990710] [INFO ] [MAIN ] RZC: Generated 1820 derivative records from 6838 primary records. [2025-09-29T02:22:08.169986] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-29T02:22:08.345353] [DEBUG] [LOCAL ] RZC: Derivative data saved (1820 records). [2025-09-29T02:22:08.469933] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-29T02:22:08.473313] [INFO ] [MAIN ] Derivative Progress: 1729/2211 symbols completed. RZC took 1.3s. Estimated remaining: 3m 24s. Rate: 141.8 symbols/min [2025-09-29T02:22:08.475089] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:08.493589] [DEBUG] [LOCAL ] SABA: Loaded 9306 existing records from primary storage. [2025-09-29T02:22:08.507285] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:08.507564] [INFO ] [MAIN ] SABA: Loaded 9306 primary data records. [2025-09-29T02:22:08.508976] [INFO ] [MAIN ] S: Generated 1820 derivative records from 54315 primary records. [2025-09-29T02:22:08.520940] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-29T02:22:08.644090] [DEBUG] [LOCAL ] S: Derivative data saved (1820 records). [2025-09-29T02:22:08.655496] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-29T02:22:08.680234] [INFO ] [MAIN ] Derivative Progress: 1730/2211 symbols completed. S took 1.4s. Estimated remaining: 3m 23s. Rate: 141.9 symbols/min [2025-09-29T02:22:08.680864] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:08.896775] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:08.899483] [INFO ] [MAIN ] SA: Generated 1820 derivative records from 43820 primary records. [2025-09-29T02:22:08.900188] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-29T02:22:08.948603] [DEBUG] [LOCAL ] SA: Derivative data saved (1820 records). [2025-09-29T02:22:08.950768] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-29T02:22:08.954004] [INFO ] [MAIN ] Derivative Progress: 1731/2211 symbols completed. SA took 1.5s. Estimated remaining: 3m 23s. Rate: 141.9 symbols/min [2025-09-29T02:22:08.955080] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:08.956893] [DEBUG] [LOCAL ] SAFE: Loaded 30819 existing records from primary storage. [2025-09-29T02:22:08.957819] [INFO ] [MAIN ] SAFE: Loaded 30819 primary data records. [2025-09-29T02:22:09.114174] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:09.182128] [INFO ] [MAIN ] SABA: Generated 1820 derivative records from 9306 primary records. [2025-09-29T02:22:09.205919] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-29T02:22:09.316065] [DEBUG] [LOCAL ] SAH: Loaded 22368 existing records from primary storage. [2025-09-29T02:22:09.332302] [INFO ] [MAIN ] SAH: Loaded 22368 primary data records. [2025-09-29T02:22:09.402629] [DEBUG] [LOCAL ] SABA: Derivative data saved (1820 records). [2025-09-29T02:22:09.408491] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-29T02:22:09.411233] [INFO ] [MAIN ] Derivative Progress: 1732/2211 symbols completed. SABA took 0.9s. Estimated remaining: 3m 23s. Rate: 141.9 symbols/min [2025-09-29T02:22:09.411417] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:09.594875] [DEBUG] [LOCAL ] SAM: Loaded 21766 existing records from primary storage. [2025-09-29T02:22:09.716480] [INFO ] [MAIN ] SAM: Loaded 21766 primary data records. [2025-09-29T02:22:09.872060] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:09.895128] [INFO ] [MAIN ] SAFE: Generated 1820 derivative records from 30819 primary records. [2025-09-29T02:22:09.956439] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-29T02:22:10.155934] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1820 records). [2025-09-29T02:22:10.157237] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-29T02:22:10.161745] [INFO ] [MAIN ] Derivative Progress: 1733/2211 symbols completed. SAFE took 1.5s. Estimated remaining: 3m 22s. Rate: 141.8 symbols/min [2025-09-29T02:22:10.164388] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:10.185977] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:10.186887] [INFO ] [MAIN ] SAH: Generated 1820 derivative records from 22368 primary records. [2025-09-29T02:22:10.187085] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-29T02:22:10.205997] [DEBUG] [LOCAL ] SAH: Derivative data saved (1820 records). [2025-09-29T02:22:10.206508] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-29T02:22:10.208718] [INFO ] [MAIN ] Derivative Progress: 1734/2211 symbols completed. SAH took 1.3s. Estimated remaining: 3m 22s. Rate: 141.9 symbols/min [2025-09-29T02:22:10.209159] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:10.228627] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:10.229500] [INFO ] [MAIN ] SAM: Generated 1820 derivative records from 21766 primary records. [2025-09-29T02:22:10.229633] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-29T02:22:10.265191] [DEBUG] [LOCAL ] SAM: Derivative data saved (1820 records). [2025-09-29T02:22:10.265365] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-29T02:22:10.269105] [INFO ] [MAIN ] Derivative Progress: 1735/2211 symbols completed. SAM took 0.9s. Estimated remaining: 3m 21s. Rate: 142.0 symbols/min [2025-09-29T02:22:10.269454] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:10.309605] [DEBUG] [LOCAL ] SAN: Loaded 53774 existing records from primary storage. [2025-09-29T02:22:10.311128] [INFO ] [MAIN ] SAN: Loaded 53774 primary data records. [2025-09-29T02:22:10.375589] [DEBUG] [LOCAL ] SAND: Loaded 52527 existing records from primary storage. [2025-09-29T02:22:10.398808] [INFO ] [MAIN ] SAND: Loaded 52527 primary data records. [2025-09-29T02:22:10.812434] [DEBUG] [LOCAL ] SAP: Loaded 50800 existing records from primary storage. [2025-09-29T02:22:10.838935] [INFO ] [MAIN ] SAP: Loaded 50800 primary data records. [2025-09-29T02:22:11.383274] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:11.386228] [INFO ] [MAIN ] SAN: Generated 1820 derivative records from 53774 primary records. [2025-09-29T02:22:11.387222] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-29T02:22:11.403475] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:11.417606] [INFO ] [MAIN ] SAND: Generated 1820 derivative records from 52527 primary records. [2025-09-29T02:22:11.420194] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-29T02:22:11.422675] [DEBUG] [LOCAL ] SAN: Derivative data saved (1820 records). [2025-09-29T02:22:11.423160] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-29T02:22:11.433620] [INFO ] [MAIN ] Derivative Progress: 1736/2211 symbols completed. SAN took 1.3s. Estimated remaining: 3m 21s. Rate: 141.8 symbols/min [2025-09-29T02:22:11.438716] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:11.445180] [DEBUG] [LOCAL ] SAND: Derivative data saved (1820 records). [2025-09-29T02:22:11.445674] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-29T02:22:11.447982] [INFO ] [MAIN ] Derivative Progress: 1737/2211 symbols completed. SAND took 1.2s. Estimated remaining: 3m 20s. Rate: 141.9 symbols/min [2025-09-29T02:22:11.448279] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:11.470345] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:11.478306] [DEBUG] [LOCAL ] SAR: Loaded 16382 existing records from primary storage. [2025-09-29T02:22:11.478519] [INFO ] [MAIN ] SAR: Loaded 16382 primary data records. [2025-09-29T02:22:11.477735] [INFO ] [MAIN ] SAP: Generated 1820 derivative records from 50800 primary records. [2025-09-29T02:22:11.496164] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-29T02:22:11.723674] [DEBUG] [LOCAL ] SAP: Derivative data saved (1820 records). [2025-09-29T02:22:11.831254] [DEBUG] [LOCAL ] SARO: Loaded 49425 existing records from primary storage. [2025-09-29T02:22:11.829823] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-29T02:22:11.869124] [INFO ] [MAIN ] SARO: Loaded 49425 primary data records. [2025-09-29T02:22:11.868703] [INFO ] [MAIN ] Derivative Progress: 1738/2211 symbols completed. SAP took 1.6s. Estimated remaining: 3m 20s. Rate: 141.9 symbols/min [2025-09-29T02:22:12.261542] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:12.262478] [INFO ] [MAIN ] SAR: Generated 1820 derivative records from 16382 primary records. [2025-09-29T02:22:12.262990] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-29T02:22:12.280950] [DEBUG] [LOCAL ] SAR: Derivative data saved (1820 records). [2025-09-29T02:22:12.281195] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-29T02:22:12.283677] [INFO ] [MAIN ] Derivative Progress: 1739/2211 symbols completed. SAR took 0.8s. Estimated remaining: 3m 20s. Rate: 141.9 symbols/min [2025-09-29T02:22:12.302229] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:12.302977] [INFO ] [MAIN ] SARO: Generated 1820 derivative records from 49425 primary records. [2025-09-29T02:22:12.303066] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-29T02:22:12.319709] [DEBUG] [LOCAL ] SARO: Derivative data saved (1820 records). [2025-09-29T02:22:12.319820] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-29T02:22:12.323440] [INFO ] [MAIN ] Derivative Progress: 1740/2211 symbols completed. SARO took 0.9s. Estimated remaining: 3m 19s. Rate: 142.0 symbols/min [2025-09-29T02:22:12.324249] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:12.324303] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:12.324139] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:12.339768] [DEBUG] [LOCAL ] SBI: Loaded 7848 existing records from primary storage. [2025-09-29T02:22:12.340300] [INFO ] [MAIN ] SBI: Loaded 7848 primary data records. [2025-09-29T02:22:12.564749] [DEBUG] [LOCAL ] SB: Loaded 33735 existing records from primary storage. [2025-09-29T02:22:12.607749] [INFO ] [MAIN ] SB: Loaded 33735 primary data records. [2025-09-29T02:22:12.735625] [DEBUG] [LOCAL ] SBH: Loaded 50565 existing records from primary storage. [2025-09-29T02:22:12.750198] [INFO ] [MAIN ] SBH: Loaded 50565 primary data records. [2025-09-29T02:22:13.445299] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:13.447800] [INFO ] [MAIN ] SBI: Generated 1820 derivative records from 7848 primary records. [2025-09-29T02:22:13.448899] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-29T02:22:13.468209] [DEBUG] [LOCAL ] SBI: Derivative data saved (1820 records). [2025-09-29T02:22:13.468420] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-29T02:22:13.470951] [INFO ] [MAIN ] Derivative Progress: 1741/2211 symbols completed. SBI took 1.1s. Estimated remaining: 3m 19s. Rate: 141.8 symbols/min [2025-09-29T02:22:13.471750] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:13.499905] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:13.507681] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:13.508613] [INFO ] [MAIN ] SBH: Generated 1820 derivative records from 50565 primary records. [2025-09-29T02:22:13.509295] [INFO ] [MAIN ] SB: Generated 1820 derivative records from 33735 primary records. [2025-09-29T02:22:13.513498] [DEBUG] [LOCAL ] SBR: Loaded 7350 existing records from primary storage. [2025-09-29T02:22:13.513883] [INFO ] [MAIN ] SBR: Loaded 7350 primary data records. [2025-09-29T02:22:13.513581] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-29T02:22:13.513823] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-29T02:22:13.651124] [DEBUG] [LOCAL ] SB: Derivative data saved (1820 records). [2025-09-29T02:22:13.677295] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-29T02:22:13.707679] [DEBUG] [LOCAL ] SBH: Derivative data saved (1820 records). [2025-09-29T02:22:13.727785] [INFO ] [MAIN ] Derivative Progress: 1742/2211 symbols completed. SB took 1.4s. Estimated remaining: 3m 18s. Rate: 141.9 symbols/min [2025-09-29T02:22:13.727936] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-29T02:22:13.766862] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:13.889584] [INFO ] [MAIN ] Derivative Progress: 1743/2211 symbols completed. SBH took 1.6s. Estimated remaining: 3m 18s. Rate: 141.9 symbols/min [2025-09-29T02:22:13.900595] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:13.951615] [DEBUG] [LOCAL ] SBSI: Loaded 14974 existing records from primary storage. [2025-09-29T02:22:13.951849] [INFO ] [MAIN ] SBSI: Loaded 14974 primary data records. [2025-09-29T02:22:13.952459] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:13.954005] [INFO ] [MAIN ] SBR: Generated 1820 derivative records from 7350 primary records. [2025-09-29T02:22:13.954353] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-29T02:22:14.153283] [DEBUG] [LOCAL ] SBS: Loaded 50166 existing records from primary storage. [2025-09-29T02:22:14.159391] [INFO ] [MAIN ] SBS: Loaded 50166 primary data records. [2025-09-29T02:22:14.159206] [DEBUG] [LOCAL ] SBR: Derivative data saved (1820 records). [2025-09-29T02:22:14.159618] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-29T02:22:14.191251] [INFO ] [MAIN ] Derivative Progress: 1744/2211 symbols completed. SBR took 0.7s. Estimated remaining: 3m 17s. Rate: 141.9 symbols/min [2025-09-29T02:22:14.217959] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:14.799597] [DEBUG] [LOCAL ] SBSW: Loaded 53745 existing records from primary storage. [2025-09-29T02:22:14.800884] [INFO ] [MAIN ] SBSW: Loaded 53745 primary data records. [2025-09-29T02:22:14.814385] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:14.821109] [INFO ] [MAIN ] SBSI: Generated 1820 derivative records from 14974 primary records. [2025-09-29T02:22:14.890279] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-29T02:22:15.176044] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1820 records). [2025-09-29T02:22:15.176464] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-29T02:22:15.179720] [INFO ] [MAIN ] Derivative Progress: 1745/2211 symbols completed. SBSI took 1.3s. Estimated remaining: 3m 17s. Rate: 141.8 symbols/min [2025-09-29T02:22:15.180735] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:15.195201] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:15.196397] [INFO ] [MAIN ] SBS: Generated 1820 derivative records from 50166 primary records. [2025-09-29T02:22:15.196671] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-29T02:22:15.217171] [DEBUG] [LOCAL ] SBS: Derivative data saved (1820 records). [2025-09-29T02:22:15.217399] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-29T02:22:15.219825] [INFO ] [MAIN ] Derivative Progress: 1746/2211 symbols completed. SBS took 1.5s. Estimated remaining: 3m 17s. Rate: 141.9 symbols/min [2025-09-29T02:22:15.221707] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:15.249063] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:15.254000] [DEBUG] [LOCAL ] SCD: Loaded 12749 existing records from primary storage. [2025-09-29T02:22:15.255153] [INFO ] [MAIN ] SBSW: Generated 1820 derivative records from 53745 primary records. [2025-09-29T02:22:15.254335] [INFO ] [MAIN ] SCD: Loaded 12749 primary data records. [2025-09-29T02:22:15.267227] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-29T02:22:15.404324] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1820 records). [2025-09-29T02:22:15.432961] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-29T02:22:15.456671] [DEBUG] [LOCAL ] SCCO: Loaded 50148 existing records from primary storage. [2025-09-29T02:22:15.460293] [INFO ] [MAIN ] Derivative Progress: 1747/2211 symbols completed. SBSW took 1.2s. Estimated remaining: 3m 16s. Rate: 141.9 symbols/min [2025-09-29T02:22:15.481301] [INFO ] [MAIN ] SCCO: Loaded 50148 primary data records. [2025-09-29T02:22:15.498599] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:16.027222] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:16.045360] [INFO ] [MAIN ] SCD: Generated 1820 derivative records from 12749 primary records. [2025-09-29T02:22:16.045597] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-29T02:22:16.060933] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-29T02:22:16.063888] [INFO ] [MAIN ] SCHW: Loaded 54465 primary data records. [2025-09-29T02:22:16.080162] [DEBUG] [LOCAL ] SCD: Derivative data saved (1820 records). [2025-09-29T02:22:16.093099] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-29T02:22:16.108980] [INFO ] [MAIN ] Derivative Progress: 1748/2211 symbols completed. SCD took 0.9s. Estimated remaining: 3m 16s. Rate: 141.9 symbols/min [2025-09-29T02:22:16.123400] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:16.424745] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:16.440850] [INFO ] [MAIN ] SCCO: Generated 1820 derivative records from 50148 primary records. [2025-09-29T02:22:16.441187] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-29T02:22:16.459080] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1820 records). [2025-09-29T02:22:16.469853] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-29T02:22:16.473391] [INFO ] [MAIN ] Derivative Progress: 1749/2211 symbols completed. SCCO took 1.3s. Estimated remaining: 3m 15s. Rate: 141.9 symbols/min [2025-09-29T02:22:16.474195] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:16.498954] [DEBUG] [LOCAL ] SCI: Loaded 47257 existing records from primary storage. [2025-09-29T02:22:16.499285] [INFO ] [MAIN ] SCI: Loaded 47257 primary data records. [2025-09-29T02:22:16.606067] [DEBUG] [LOCAL ] SCL: Loaded 15113 existing records from primary storage. [2025-09-29T02:22:16.632737] [INFO ] [MAIN ] SCL: Loaded 15113 primary data records. [2025-09-29T02:22:16.812691] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:16.952561] [INFO ] [MAIN ] SCHW: Generated 1820 derivative records from 54465 primary records. [2025-09-29T02:22:16.993048] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-29T02:22:17.132196] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1820 records). [2025-09-29T02:22:17.259072] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-29T02:22:17.261824] [INFO ] [MAIN ] Derivative Progress: 1750/2211 symbols completed. SCHW took 1.8s. Estimated remaining: 3m 15s. Rate: 141.8 symbols/min [2025-09-29T02:22:17.262516] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:17.290874] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:17.297080] [INFO ] [MAIN ] SCI: Generated 1820 derivative records from 47257 primary records. [2025-09-29T02:22:17.297723] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-29T02:22:17.323251] [DEBUG] [LOCAL ] SCM: Loaded 20163 existing records from primary storage. [2025-09-29T02:22:17.325685] [INFO ] [MAIN ] SCM: Loaded 20163 primary data records. [2025-09-29T02:22:17.326443] [DEBUG] [LOCAL ] SCI: Derivative data saved (1820 records). [2025-09-29T02:22:17.326805] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-29T02:22:17.383676] [INFO ] [MAIN ] Derivative Progress: 1751/2211 symbols completed. SCI took 1.3s. Estimated remaining: 3m 15s. Rate: 141.9 symbols/min [2025-09-29T02:22:17.407368] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:17.433758] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:17.467303] [INFO ] [MAIN ] SCL: Generated 1820 derivative records from 15113 primary records. [2025-09-29T02:22:17.483461] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-29T02:22:17.713258] [DEBUG] [LOCAL ] SCL: Derivative data saved (1820 records). [2025-09-29T02:22:17.714184] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-29T02:22:17.717377] [INFO ] [MAIN ] Derivative Progress: 1752/2211 symbols completed. SCL took 1.2s. Estimated remaining: 3m 14s. Rate: 141.9 symbols/min [2025-09-29T02:22:17.717622] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:17.756421] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:17.757341] [INFO ] [MAIN ] SCM: Generated 1820 derivative records from 20163 primary records. [2025-09-29T02:22:17.765621] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-29T02:22:17.781737] [DEBUG] [LOCAL ] SCS: Loaded 43834 existing records from primary storage. [2025-09-29T02:22:17.781996] [INFO ] [MAIN ] SCS: Loaded 43834 primary data records. [2025-09-29T02:22:17.862401] [DEBUG] [LOCAL ] SCM: Derivative data saved (1820 records). [2025-09-29T02:22:17.863040] [DEBUG] [LOCAL ] SD: Loaded 29368 existing records from primary storage. [2025-09-29T02:22:17.881759] [INFO ] [MAIN ] SD: Loaded 29368 primary data records. [2025-09-29T02:22:17.881848] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-29T02:22:17.946186] [INFO ] [MAIN ] Derivative Progress: 1753/2211 symbols completed. SCM took 0.7s. Estimated remaining: 3m 14s. Rate: 141.9 symbols/min [2025-09-29T02:22:18.502241] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:18.503281] [INFO ] [MAIN ] SCS: Generated 1820 derivative records from 43834 primary records. [2025-09-29T02:22:18.503486] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-29T02:22:18.520830] [DEBUG] [LOCAL ] SCS: Derivative data saved (1820 records). [2025-09-29T02:22:18.522675] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-29T02:22:18.525765] [INFO ] [MAIN ] Derivative Progress: 1754/2211 symbols completed. SCS took 1.1s. Estimated remaining: 3m 13s. Rate: 141.9 symbols/min [2025-09-29T02:22:18.539051] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:18.539716] [INFO ] [MAIN ] SD: Generated 1820 derivative records from 29368 primary records. [2025-09-29T02:22:18.539803] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-29T02:22:18.555473] [DEBUG] [LOCAL ] SD: Derivative data saved (1820 records). [2025-09-29T02:22:18.555572] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-29T02:22:18.558542] [INFO ] [MAIN ] Derivative Progress: 1755/2211 symbols completed. SD took 0.8s. Estimated remaining: 3m 13s. Rate: 142.0 symbols/min [2025-09-29T02:22:18.558989] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:18.559109] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:18.559276] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:18.583529] [DEBUG] [LOCAL ] SDHY: Loaded 10710 existing records from primary storage. [2025-09-29T02:22:18.578341] [DEBUG] [LOCAL ] SDHC: Loaded 10686 existing records from primary storage. [2025-09-29T02:22:18.583945] [INFO ] [MAIN ] SDHC: Loaded 10686 primary data records. [2025-09-29T02:22:18.584060] [INFO ] [MAIN ] SDHY: Loaded 10710 primary data records. [2025-09-29T02:22:19.296317] [DEBUG] [LOCAL ] SDRL: Loaded 42459 existing records from primary storage. [2025-09-29T02:22:19.312040] [INFO ] [MAIN ] SDRL: Loaded 42459 primary data records. [2025-09-29T02:22:19.700178] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:19.717188] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:19.716430] [INFO ] [MAIN ] SDHC: Generated 1820 derivative records from 10686 primary records. [2025-09-29T02:22:19.717523] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-29T02:22:19.718201] [INFO ] [MAIN ] SDHY: Generated 1820 derivative records from 10710 primary records. [2025-09-29T02:22:19.719478] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-29T02:22:19.753537] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1820 records). [2025-09-29T02:22:19.757525] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1820 records). [2025-09-29T02:22:19.757792] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-29T02:22:19.760736] [INFO ] [MAIN ] Derivative Progress: 1756/2211 symbols completed. SDHY took 1.2s. Estimated remaining: 3m 12s. Rate: 141.8 symbols/min [2025-09-29T02:22:19.761284] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:19.757878] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-29T02:22:19.764493] [INFO ] [MAIN ] Derivative Progress: 1757/2211 symbols completed. SDHC took 1.2s. Estimated remaining: 3m 12s. Rate: 141.9 symbols/min [2025-09-29T02:22:19.764879] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:19.782729] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:19.784546] [INFO ] [MAIN ] SDRL: Generated 1820 derivative records from 42459 primary records. [2025-09-29T02:22:19.784782] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-29T02:22:19.811289] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1820 records). [2025-09-29T02:22:19.811528] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-29T02:22:19.814603] [INFO ] [MAIN ] Derivative Progress: 1758/2211 symbols completed. SDRL took 1.3s. Estimated remaining: 3m 11s. Rate: 142.0 symbols/min [2025-09-29T02:22:19.815154] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:19.860922] [DEBUG] [LOCAL ] SEG: Loaded 13887 existing records from primary storage. [2025-09-29T02:22:19.877963] [INFO ] [MAIN ] SEG: Loaded 13887 primary data records. [2025-09-29T02:22:19.879630] [DEBUG] [LOCAL ] SEE: Loaded 49069 existing records from primary storage. [2025-09-29T02:22:19.895438] [INFO ] [MAIN ] SEE: Loaded 49069 primary data records. [2025-09-29T02:22:20.011943] [DEBUG] [LOCAL ] SE: Loaded 54140 existing records from primary storage. [2025-09-29T02:22:20.051320] [INFO ] [MAIN ] SE: Loaded 54140 primary data records. [2025-09-29T02:22:21.010731] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:21.013323] [INFO ] [MAIN ] SEE: Generated 1820 derivative records from 49069 primary records. [2025-09-29T02:22:21.013683] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-29T02:22:21.043842] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:21.047237] [DEBUG] [LOCAL ] SEE: Derivative data saved (1820 records). [2025-09-29T02:22:21.047667] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-29T02:22:21.050015] [INFO ] [MAIN ] Derivative Progress: 1759/2211 symbols completed. SEE took 1.3s. Estimated remaining: 3m 11s. Rate: 141.8 symbols/min [2025-09-29T02:22:21.050242] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:21.045910] [INFO ] [MAIN ] SEG: Generated 1820 derivative records from 13887 primary records. [2025-09-29T02:22:21.050840] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-29T02:22:21.071702] [DEBUG] [LOCAL ] SEG: Derivative data saved (1820 records). [2025-09-29T02:22:21.072326] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-29T02:22:21.085926] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:21.090047] [INFO ] [MAIN ] SE: Generated 1820 derivative records from 54140 primary records. [2025-09-29T02:22:21.090231] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-09-29T02:22:21.088788] [INFO ] [MAIN ] Derivative Progress: 1760/2211 symbols completed. SEG took 1.3s. Estimated remaining: 3m 11s. Rate: 141.9 symbols/min [2025-09-29T02:22:21.090926] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:21.109323] [DEBUG] [LOCAL ] SE: Derivative data saved (1820 records). [2025-09-29T02:22:21.109524] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-29T02:22:21.113102] [INFO ] [MAIN ] Derivative Progress: 1761/2211 symbols completed. SE took 1.4s. Estimated remaining: 3m 10s. Rate: 142.0 symbols/min [2025-09-29T02:22:21.113350] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:21.153910] [DEBUG] [LOCAL ] SEI: Loaded 50411 existing records from primary storage. [2025-09-29T02:22:21.155262] [INFO ] [MAIN ] SEI: Loaded 50411 primary data records. [2025-09-29T02:22:21.340372] [DEBUG] [LOCAL ] SEMR: Loaded 42184 existing records from primary storage. [2025-09-29T02:22:21.347865] [DEBUG] [LOCAL ] SEM: Loaded 43533 existing records from primary storage. [2025-09-29T02:22:21.365882] [INFO ] [MAIN ] SEMR: Loaded 42184 primary data records. [2025-09-29T02:22:21.383348] [INFO ] [MAIN ] SEM: Loaded 43533 primary data records. [2025-09-29T02:22:22.242662] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:22.243806] [INFO ] [MAIN ] SEI: Generated 1820 derivative records from 50411 primary records. [2025-09-29T02:22:22.244180] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-29T02:22:22.268463] [DEBUG] [LOCAL ] SEI: Derivative data saved (1820 records). [2025-09-29T02:22:22.269795] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-29T02:22:22.272953] [INFO ] [MAIN ] Derivative Progress: 1762/2211 symbols completed. SEI took 1.2s. Estimated remaining: 3m 10s. Rate: 141.8 symbols/min [2025-09-29T02:22:22.273782] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:22.296335] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:22.299224] [INFO ] [MAIN ] SEMR: Generated 1820 derivative records from 42184 primary records. [2025-09-29T02:22:22.300380] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-29T02:22:22.326958] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:22.334850] [INFO ] [MAIN ] SEM: Generated 1820 derivative records from 43533 primary records. [2025-09-29T02:22:22.337752] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-29T02:22:22.350954] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1820 records). [2025-09-29T02:22:22.354674] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-29T02:22:22.362840] [DEBUG] [LOCAL ] SEM: Derivative data saved (1820 records). [2025-09-29T02:22:22.362314] [INFO ] [MAIN ] Derivative Progress: 1763/2211 symbols completed. SEMR took 1.2s. Estimated remaining: 3m 9s. Rate: 141.9 symbols/min [2025-09-29T02:22:22.363256] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-29T02:22:22.363187] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:22.366437] [INFO ] [MAIN ] Derivative Progress: 1764/2211 symbols completed. SEM took 1.3s. Estimated remaining: 3m 9s. Rate: 142.0 symbols/min [2025-09-29T02:22:22.367285] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:22.394577] [DEBUG] [LOCAL ] SFB: Loaded 4046 existing records from primary storage. [2025-09-29T02:22:22.394835] [INFO ] [MAIN ] SFB: Loaded 4046 primary data records. [2025-09-29T02:22:22.513786] [DEBUG] [LOCAL ] SES: Loaded 52331 existing records from primary storage. [2025-09-29T02:22:22.536324] [INFO ] [MAIN ] SES: Loaded 52331 primary data records. [2025-09-29T02:22:22.776348] [DEBUG] [LOCAL ] SF: Loaded 42360 existing records from primary storage. [2025-09-29T02:22:22.925272] [INFO ] [MAIN ] SF: Loaded 42360 primary data records. [2025-09-29T02:22:23.539264] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:23.540470] [INFO ] [MAIN ] SFB: Generated 1820 derivative records from 4046 primary records. [2025-09-29T02:22:23.540840] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-29T02:22:23.556083] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:23.566049] [INFO ] [MAIN ] SES: Generated 1820 derivative records from 52331 primary records. [2025-09-29T02:22:23.574000] [DEBUG] [LOCAL ] SFB: Derivative data saved (1820 records). [2025-09-29T02:22:23.574349] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-29T02:22:23.574155] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-29T02:22:23.577968] [INFO ] [MAIN ] Derivative Progress: 1765/2211 symbols completed. SFB took 1.2s. Estimated remaining: 3m 9s. Rate: 141.8 symbols/min [2025-09-29T02:22:23.595030] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:23.599771] [DEBUG] [LOCAL ] SES: Derivative data saved (1820 records). [2025-09-29T02:22:23.601025] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-29T02:22:23.604423] [INFO ] [MAIN ] Derivative Progress: 1766/2211 symbols completed. SES took 1.3s. Estimated remaining: 3m 8s. Rate: 141.9 symbols/min [2025-09-29T02:22:23.604987] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:23.623591] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:23.624442] [INFO ] [MAIN ] SF: Generated 1820 derivative records from 42360 primary records. [2025-09-29T02:22:23.624771] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-29T02:22:23.642760] [DEBUG] [LOCAL ] SF: Derivative data saved (1820 records). [2025-09-29T02:22:23.648296] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-29T02:22:23.651142] [INFO ] [MAIN ] Derivative Progress: 1767/2211 symbols completed. SF took 1.3s. Estimated remaining: 3m 8s. Rate: 142.0 symbols/min [2025-09-29T02:22:23.651564] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:23.664316] [DEBUG] [LOCAL ] SFBS: Loaded 21483 existing records from primary storage. [2025-09-29T02:22:23.664508] [INFO ] [MAIN ] SFBS: Loaded 21483 primary data records. [2025-09-29T02:22:23.837933] [DEBUG] [LOCAL ] SFL: Loaded 46026 existing records from primary storage. [2025-09-29T02:22:23.863947] [INFO ] [MAIN ] SFL: Loaded 46026 primary data records. [2025-09-29T02:22:24.199975] [DEBUG] [LOCAL ] SG: Loaded 54227 existing records from primary storage. [2025-09-29T02:22:24.218803] [INFO ] [MAIN ] SG: Loaded 54227 primary data records. [2025-09-29T02:22:24.861673] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:24.863423] [INFO ] [MAIN ] SFBS: Generated 1820 derivative records from 21483 primary records. [2025-09-29T02:22:24.864443] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-29T02:22:24.887357] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1820 records). [2025-09-29T02:22:24.888702] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-29T02:22:24.903435] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:24.910415] [INFO ] [MAIN ] SFL: Generated 1820 derivative records from 46026 primary records. [2025-09-29T02:22:24.908668] [INFO ] [MAIN ] Derivative Progress: 1768/2211 symbols completed. SFBS took 1.3s. Estimated remaining: 3m 7s. Rate: 141.8 symbols/min [2025-09-29T02:22:24.911116] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-29T02:22:24.933074] [DEBUG] [LOCAL ] SFL: Derivative data saved (1820 records). [2025-09-29T02:22:24.946346] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-29T02:22:24.946985] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:24.951530] [INFO ] [MAIN ] Derivative Progress: 1769/2211 symbols completed. SFL took 1.3s. Estimated remaining: 3m 7s. Rate: 141.9 symbols/min [2025-09-29T02:22:24.952709] [INFO ] [MAIN ] SG: Generated 1820 derivative records from 54227 primary records. [2025-09-29T02:22:24.952817] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-29T02:22:24.969214] [DEBUG] [LOCAL ] SG: Derivative data saved (1820 records). [2025-09-29T02:22:24.969329] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-29T02:22:24.973047] [INFO ] [MAIN ] Derivative Progress: 1770/2211 symbols completed. SG took 1.3s. Estimated remaining: 3m 6s. Rate: 142.0 symbols/min [2025-09-29T02:22:24.974060] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:24.974191] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:24.974383] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:25.004265] [DEBUG] [LOCAL ] SGU: Loaded 6765 existing records from primary storage. [2025-09-29T02:22:25.004723] [INFO ] [MAIN ] SGU: Loaded 6765 primary data records. [2025-09-29T02:22:25.409849] [DEBUG] [LOCAL ] SGHC: Loaded 46435 existing records from primary storage. [2025-09-29T02:22:25.410467] [INFO ] [MAIN ] SGHC: Loaded 46435 primary data records. [2025-09-29T02:22:25.411778] [DEBUG] [LOCAL ] SHAK: Loaded 49831 existing records from primary storage. [2025-09-29T02:22:25.412207] [INFO ] [MAIN ] SHAK: Loaded 49831 primary data records. [2025-09-29T02:22:26.197302] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7799 incomplete bins [2025-09-29T02:22:26.199695] [INFO ] [MAIN ] SGU: Generated 1815 derivative records from 6765 primary records. [2025-09-29T02:22:26.200091] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-29T02:22:26.218246] [DEBUG] [LOCAL ] SGU: Derivative data saved (1815 records). [2025-09-29T02:22:26.218589] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-29T02:22:26.221096] [INFO ] [MAIN ] Derivative Progress: 1771/2211 symbols completed. SGU took 1.2s. Estimated remaining: 3m 6s. Rate: 141.8 symbols/min [2025-09-29T02:22:26.221534] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:26.243605] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:26.244517] [INFO ] [MAIN ] SHAK: Generated 1820 derivative records from 49831 primary records. [2025-09-29T02:22:26.244810] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-29T02:22:26.281050] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:22:26.283897] [INFO ] [MAIN ] SGHC: Generated 1819 derivative records from 46435 primary records. [2025-09-29T02:22:26.284330] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-29T02:22:26.295756] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1820 records). [2025-09-29T02:22:26.296170] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-29T02:22:26.299030] [INFO ] [MAIN ] Derivative Progress: 1772/2211 symbols completed. SHAK took 1.3s. Estimated remaining: 3m 6s. Rate: 141.9 symbols/min [2025-09-29T02:22:26.299293] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:26.300675] [DEBUG] [LOCAL ] SHCO: Loaded 26427 existing records from primary storage. [2025-09-29T02:22:26.301218] [INFO ] [MAIN ] SHCO: Loaded 26427 primary data records. [2025-09-29T02:22:26.450127] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1819 records). [2025-09-29T02:22:26.450348] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-29T02:22:26.453395] [INFO ] [MAIN ] Derivative Progress: 1773/2211 symbols completed. SGHC took 1.5s. Estimated remaining: 3m 5s. Rate: 141.9 symbols/min [2025-09-29T02:22:26.453693] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:26.735500] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-09-29T02:22:26.746246] [INFO ] [MAIN ] SHEL: Loaded 54451 primary data records. [2025-09-29T02:22:26.747273] [DEBUG] [LOCAL ] SHG: Loaded 27307 existing records from primary storage. [2025-09-29T02:22:26.783420] [INFO ] [MAIN ] SHG: Loaded 27307 primary data records. [2025-09-29T02:22:27.439572] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:27.442228] [INFO ] [MAIN ] SHCO: Generated 1820 derivative records from 26427 primary records. [2025-09-29T02:22:27.443760] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-29T02:22:27.468012] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1820 records). [2025-09-29T02:22:27.468611] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-29T02:22:27.471069] [INFO ] [MAIN ] Derivative Progress: 1774/2211 symbols completed. SHCO took 1.2s. Estimated remaining: 3m 5s. Rate: 141.8 symbols/min [2025-09-29T02:22:27.471696] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:27.491132] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:27.493904] [INFO ] [MAIN ] SHEL: Generated 1820 derivative records from 54451 primary records. [2025-09-29T02:22:27.494770] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-29T02:22:27.520584] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:27.523751] [INFO ] [MAIN ] SHG: Generated 1820 derivative records from 27307 primary records. [2025-09-29T02:22:27.523898] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-29T02:22:27.527604] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1820 records). [2025-09-29T02:22:27.527729] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-29T02:22:27.531016] [INFO ] [MAIN ] Derivative Progress: 1775/2211 symbols completed. SHEL took 1.2s. Estimated remaining: 3m 4s. Rate: 141.9 symbols/min [2025-09-29T02:22:27.542861] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:27.563717] [DEBUG] [LOCAL ] SHG: Derivative data saved (1820 records). [2025-09-29T02:22:27.563881] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-29T02:22:27.567408] [INFO ] [MAIN ] Derivative Progress: 1776/2211 symbols completed. SHG took 1.1s. Estimated remaining: 3m 4s. Rate: 142.0 symbols/min [2025-09-29T02:22:27.567804] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:27.576596] [DEBUG] [LOCAL ] SHOC: Loaded 3747 existing records from primary storage. [2025-09-29T02:22:27.578236] [INFO ] [MAIN ] SHOC: Loaded 3747 primary data records. [2025-09-29T02:22:27.669503] [DEBUG] [LOCAL ] SHO: Loaded 50552 existing records from primary storage. [2025-09-29T02:22:27.694674] [INFO ] [MAIN ] SHO: Loaded 50552 primary data records. [2025-09-29T02:22:28.191798] [DEBUG] [LOCAL ] SHW: Loaded 51174 existing records from primary storage. [2025-09-29T02:22:28.342700] [INFO ] [MAIN ] SHW: Loaded 51174 primary data records. [2025-09-29T02:22:28.699011] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:22:28.716229] [INFO ] [MAIN ] SHOC: Generated 1819 derivative records from 3747 primary records. [2025-09-29T02:22:28.717061] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-29T02:22:28.739978] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1819 records). [2025-09-29T02:22:28.741053] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-29T02:22:28.744020] [INFO ] [MAIN ] Derivative Progress: 1777/2211 symbols completed. SHOC took 1.2s. Estimated remaining: 3m 4s. Rate: 141.8 symbols/min [2025-09-29T02:22:28.757964] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:28.759275] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:28.760520] [INFO ] [MAIN ] SHO: Generated 1820 derivative records from 50552 primary records. [2025-09-29T02:22:28.761616] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-29T02:22:28.782457] [DEBUG] [LOCAL ] SHO: Derivative data saved (1820 records). [2025-09-29T02:22:28.783040] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-29T02:22:28.786213] [INFO ] [MAIN ] Derivative Progress: 1778/2211 symbols completed. SHO took 1.3s. Estimated remaining: 3m 3s. Rate: 141.9 symbols/min [2025-09-29T02:22:28.786844] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:28.817848] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:28.818962] [INFO ] [MAIN ] SHW: Generated 1820 derivative records from 51174 primary records. [2025-09-29T02:22:28.819249] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-29T02:22:28.837034] [DEBUG] [LOCAL ] SHW: Derivative data saved (1820 records). [2025-09-29T02:22:28.838290] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-29T02:22:28.841950] [INFO ] [MAIN ] Derivative Progress: 1779/2211 symbols completed. SHW took 1.3s. Estimated remaining: 3m 3s. Rate: 142.0 symbols/min [2025-09-29T02:22:28.855277] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:28.859383] [DEBUG] [LOCAL ] SID: Loaded 42834 existing records from primary storage. [2025-09-29T02:22:28.859860] [INFO ] [MAIN ] SID: Loaded 42834 primary data records. [2025-09-29T02:22:29.072984] [DEBUG] [LOCAL ] SII: Loaded 23644 existing records from primary storage. [2025-09-29T02:22:29.120514] [INFO ] [MAIN ] SII: Loaded 23644 primary data records. [2025-09-29T02:22:29.134369] [DEBUG] [LOCAL ] SIG: Loaded 47111 existing records from primary storage. [2025-09-29T02:22:29.267977] [INFO ] [MAIN ] SIG: Loaded 47111 primary data records. [2025-09-29T02:22:30.065010] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:30.066489] [INFO ] [MAIN ] SID: Generated 1820 derivative records from 42834 primary records. [2025-09-29T02:22:30.066957] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-29T02:22:30.090986] [DEBUG] [LOCAL ] SID: Derivative data saved (1820 records). [2025-09-29T02:22:30.091169] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-29T02:22:30.093613] [INFO ] [MAIN ] Derivative Progress: 1780/2211 symbols completed. SID took 1.3s. Estimated remaining: 3m 2s. Rate: 141.8 symbols/min [2025-09-29T02:22:30.094156] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:30.116430] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:30.117536] [INFO ] [MAIN ] SII: Generated 1820 derivative records from 23644 primary records. [2025-09-29T02:22:30.125331] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-29T02:22:30.131352] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:30.132369] [INFO ] [MAIN ] SIG: Generated 1820 derivative records from 47111 primary records. [2025-09-29T02:22:30.140059] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-29T02:22:30.172540] [DEBUG] [LOCAL ] SII: Derivative data saved (1820 records). [2025-09-29T02:22:30.174432] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-29T02:22:30.177480] [INFO ] [MAIN ] Derivative Progress: 1781/2211 symbols completed. SII took 1.3s. Estimated remaining: 3m 2s. Rate: 141.9 symbols/min [2025-09-29T02:22:30.174916] [DEBUG] [LOCAL ] SIG: Derivative data saved (1820 records). [2025-09-29T02:22:30.177951] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-29T02:22:30.177869] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:30.181216] [INFO ] [MAIN ] Derivative Progress: 1782/2211 symbols completed. SIG took 1.4s. Estimated remaining: 3m 1s. Rate: 141.9 symbols/min [2025-09-29T02:22:30.181721] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:30.195514] [DEBUG] [LOCAL ] SILA: Loaded 31635 existing records from primary storage. [2025-09-29T02:22:30.195926] [INFO ] [MAIN ] SILA: Loaded 31635 primary data records. [2025-09-29T02:22:30.428925] [DEBUG] [LOCAL ] SITE: Loaded 35513 existing records from primary storage. [2025-09-29T02:22:30.481863] [INFO ] [MAIN ] SITE: Loaded 35513 primary data records. [2025-09-29T02:22:30.566454] [DEBUG] [LOCAL ] SITC: Loaded 42233 existing records from primary storage. [2025-09-29T02:22:30.615352] [INFO ] [MAIN ] SITC: Loaded 42233 primary data records. [2025-09-29T02:22:31.288298] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:31.290293] [INFO ] [MAIN ] SILA: Generated 1820 derivative records from 31635 primary records. [2025-09-29T02:22:31.291141] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-29T02:22:31.313116] [DEBUG] [LOCAL ] SILA: Derivative data saved (1820 records). [2025-09-29T02:22:31.313740] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-29T02:22:31.316523] [INFO ] [MAIN ] Derivative Progress: 1783/2211 symbols completed. SILA took 1.2s. Estimated remaining: 3m 1s. Rate: 141.8 symbols/min [2025-09-29T02:22:31.337785] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:31.350748] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:31.351520] [INFO ] [MAIN ] SITE: Generated 1820 derivative records from 35513 primary records. [2025-09-29T02:22:31.352195] [INFO ] [MAIN ] SITC: Generated 1820 derivative records from 42233 primary records. [2025-09-29T02:22:31.352355] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-29T02:22:31.352730] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-29T02:22:31.387784] [DEBUG] [LOCAL ] SITC: Derivative data saved (1820 records). [2025-09-29T02:22:31.389906] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-29T02:22:31.394016] [INFO ] [MAIN ] Derivative Progress: 1784/2211 symbols completed. SITC took 1.2s. Estimated remaining: 3m 1s. Rate: 141.9 symbols/min [2025-09-29T02:22:31.395821] [DEBUG] [LOCAL ] SITE: Derivative data saved (1820 records). [2025-09-29T02:22:31.395935] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-29T02:22:31.399025] [INFO ] [MAIN ] Derivative Progress: 1785/2211 symbols completed. SITE took 1.2s. Estimated remaining: 3m 0s. Rate: 142.0 symbols/min [2025-09-29T02:22:31.399639] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:31.399760] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:31.399828] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:31.436421] [DEBUG] [LOCAL ] SJT: Loaded 22419 existing records from primary storage. [2025-09-29T02:22:31.445488] [INFO ] [MAIN ] SJT: Loaded 22419 primary data records. [2025-09-29T02:22:31.596277] [DEBUG] [LOCAL ] SKE: Loaded 36252 existing records from primary storage. [2025-09-29T02:22:31.632358] [INFO ] [MAIN ] SKE: Loaded 36252 primary data records. [2025-09-29T02:22:31.780173] [DEBUG] [LOCAL ] SJM: Loaded 50877 existing records from primary storage. [2025-09-29T02:22:31.853136] [INFO ] [MAIN ] SJM: Loaded 50877 primary data records. [2025-09-29T02:22:32.645607] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:32.647161] [INFO ] [MAIN ] SJT: Generated 1820 derivative records from 22419 primary records. [2025-09-29T02:22:32.659758] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-29T02:22:32.660523] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:32.662497] [INFO ] [MAIN ] SKE: Generated 1820 derivative records from 36252 primary records. [2025-09-29T02:22:32.663557] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-29T02:22:32.692125] [DEBUG] [LOCAL ] SJT: Derivative data saved (1820 records). [2025-09-29T02:22:32.694568] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-29T02:22:32.697239] [INFO ] [MAIN ] Derivative Progress: 1786/2211 symbols completed. SJT took 1.3s. Estimated remaining: 2m 60s. Rate: 141.8 symbols/min [2025-09-29T02:22:32.700224] [DEBUG] [LOCAL ] SKE: Derivative data saved (1820 records). [2025-09-29T02:22:32.700349] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:32.700543] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-29T02:22:32.704042] [INFO ] [MAIN ] Derivative Progress: 1787/2211 symbols completed. SKE took 1.3s. Estimated remaining: 2m 59s. Rate: 141.9 symbols/min [2025-09-29T02:22:32.704846] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:32.727207] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:32.731154] [INFO ] [MAIN ] SJM: Generated 1820 derivative records from 50877 primary records. [2025-09-29T02:22:32.731321] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-29T02:22:32.736350] [DEBUG] [LOCAL ] SKIL: Loaded 6395 existing records from primary storage. [2025-09-29T02:22:32.749194] [INFO ] [MAIN ] SKIL: Loaded 6395 primary data records. [2025-09-29T02:22:32.749671] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-29T02:22:32.778998] [INFO ] [MAIN ] SKLZ: Loaded 12122 primary data records. [2025-09-29T02:22:32.851476] [DEBUG] [LOCAL ] SJM: Derivative data saved (1820 records). [2025-09-29T02:22:32.908262] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-29T02:22:32.957800] [INFO ] [MAIN ] Derivative Progress: 1788/2211 symbols completed. SJM took 1.6s. Estimated remaining: 2m 59s. Rate: 141.9 symbols/min [2025-09-29T02:22:32.994723] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:33.529638] [DEBUG] [LOCAL ] SKM: Loaded 35557 existing records from primary storage. [2025-09-29T02:22:33.528158] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:33.530160] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:33.530301] [INFO ] [MAIN ] SKM: Loaded 35557 primary data records. [2025-09-29T02:22:33.532194] [INFO ] [MAIN ] SKLZ: Generated 1820 derivative records from 12122 primary records. [2025-09-29T02:22:33.531259] [INFO ] [MAIN ] SKIL: Generated 1820 derivative records from 6395 primary records. [2025-09-29T02:22:33.557490] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-29T02:22:33.569662] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-29T02:22:33.704825] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1820 records). [2025-09-29T02:22:33.716034] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1820 records). [2025-09-29T02:22:33.743318] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-29T02:22:33.733471] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-29T02:22:33.905153] [INFO ] [MAIN ] Derivative Progress: 1789/2211 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 59s. Rate: 141.8 symbols/min [2025-09-29T02:22:33.908934] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:33.909034] [INFO ] [MAIN ] Derivative Progress: 1790/2211 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 58s. Rate: 141.9 symbols/min [2025-09-29T02:22:33.910177] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:33.954441] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:33.955361] [INFO ] [MAIN ] SKM: Generated 1820 derivative records from 35557 primary records. [2025-09-29T02:22:33.955692] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-29T02:22:33.997081] [DEBUG] [LOCAL ] SKM: Derivative data saved (1820 records). [2025-09-29T02:22:33.998962] [DEBUG] [LOCAL ] SKY: Loaded 38305 existing records from primary storage. [2025-09-29T02:22:33.999352] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-29T02:22:34.002683] [INFO ] [MAIN ] Derivative Progress: 1791/2211 symbols completed. SKM took 1.0s. Estimated remaining: 2m 58s. Rate: 141.9 symbols/min [2025-09-29T02:22:33.999504] [INFO ] [MAIN ] SKY: Loaded 38305 primary data records. [2025-09-29T02:22:34.003335] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:34.103322] [DEBUG] [LOCAL ] SKT: Loaded 43227 existing records from primary storage. [2025-09-29T02:22:34.141631] [INFO ] [MAIN ] SKT: Loaded 43227 primary data records. [2025-09-29T02:22:34.437839] [DEBUG] [LOCAL ] SKYH: Loaded 16851 existing records from primary storage. [2025-09-29T02:22:34.495084] [INFO ] [MAIN ] SKYH: Loaded 16851 primary data records. [2025-09-29T02:22:35.228776] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:35.231962] [INFO ] [MAIN ] SKY: Generated 1820 derivative records from 38305 primary records. [2025-09-29T02:22:35.233241] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-29T02:22:35.252928] [DEBUG] [LOCAL ] SKY: Derivative data saved (1820 records). [2025-09-29T02:22:35.253157] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-29T02:22:35.255764] [INFO ] [MAIN ] Derivative Progress: 1792/2211 symbols completed. SKY took 1.3s. Estimated remaining: 2m 57s. Rate: 141.8 symbols/min [2025-09-29T02:22:35.256271] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:35.282677] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:35.284835] [INFO ] [MAIN ] SKT: Generated 1820 derivative records from 43227 primary records. [2025-09-29T02:22:35.285464] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-29T02:22:35.308136] [DEBUG] [LOCAL ] SKT: Derivative data saved (1820 records). [2025-09-29T02:22:35.308375] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-29T02:22:35.312360] [INFO ] [MAIN ] Derivative Progress: 1793/2211 symbols completed. SKT took 1.4s. Estimated remaining: 2m 57s. Rate: 141.9 symbols/min [2025-09-29T02:22:35.312914] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:35.327754] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:35.328622] [INFO ] [MAIN ] SKYH: Generated 1820 derivative records from 16851 primary records. [2025-09-29T02:22:35.328741] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-29T02:22:35.347312] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1820 records). [2025-09-29T02:22:35.347531] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-29T02:22:35.350986] [INFO ] [MAIN ] Derivative Progress: 1794/2211 symbols completed. SKYH took 1.3s. Estimated remaining: 2m 56s. Rate: 141.9 symbols/min [2025-09-29T02:22:35.351393] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:35.401694] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-29T02:22:35.415205] [INFO ] [MAIN ] SLB: Loaded 54477 primary data records. [2025-09-29T02:22:35.585810] [DEBUG] [LOCAL ] SLF: Loaded 39426 existing records from primary storage. [2025-09-29T02:22:35.587265] [INFO ] [MAIN ] SLF: Loaded 39426 primary data records. [2025-09-29T02:22:35.890331] [DEBUG] [LOCAL ] SLG: Loaded 46130 existing records from primary storage. [2025-09-29T02:22:35.931675] [INFO ] [MAIN ] SLG: Loaded 46130 primary data records. [2025-09-29T02:22:36.594246] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:36.596998] [INFO ] [MAIN ] SLB: Generated 1820 derivative records from 54477 primary records. [2025-09-29T02:22:36.598358] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-29T02:22:36.642407] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:36.643612] [DEBUG] [LOCAL ] SLB: Derivative data saved (1820 records). [2025-09-29T02:22:36.645471] [INFO ] [MAIN ] SLF: Generated 1820 derivative records from 39426 primary records. [2025-09-29T02:22:36.645631] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-29T02:22:36.645842] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-29T02:22:36.650890] [INFO ] [MAIN ] Derivative Progress: 1795/2211 symbols completed. SLB took 1.4s. Estimated remaining: 2m 56s. Rate: 141.8 symbols/min [2025-09-29T02:22:36.653567] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:36.674085] [DEBUG] [LOCAL ] SLF: Derivative data saved (1820 records). [2025-09-29T02:22:36.691688] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-29T02:22:36.696380] [INFO ] [MAIN ] Derivative Progress: 1796/2211 symbols completed. SLF took 1.4s. Estimated remaining: 2m 56s. Rate: 141.8 symbols/min [2025-09-29T02:22:36.692217] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:36.696838] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:36.698692] [INFO ] [MAIN ] SLG: Generated 1820 derivative records from 46130 primary records. [2025-09-29T02:22:36.699279] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-29T02:22:36.717792] [DEBUG] [LOCAL ] SLG: Derivative data saved (1820 records). [2025-09-29T02:22:36.717937] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-29T02:22:36.721997] [INFO ] [MAIN ] Derivative Progress: 1797/2211 symbols completed. SLG took 1.4s. Estimated remaining: 2m 55s. Rate: 141.9 symbols/min [2025-09-29T02:22:36.722397] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:36.780708] [DEBUG] [LOCAL ] SLGN: Loaded 41039 existing records from primary storage. [2025-09-29T02:22:36.781018] [INFO ] [MAIN ] SLGN: Loaded 41039 primary data records. [2025-09-29T02:22:36.792536] [DEBUG] [LOCAL ] SLVM: Loaded 28332 existing records from primary storage. [2025-09-29T02:22:36.835591] [INFO ] [MAIN ] SLVM: Loaded 28332 primary data records. [2025-09-29T02:22:36.968833] [DEBUG] [LOCAL ] SLQT: Loaded 44370 existing records from primary storage. [2025-09-29T02:22:37.028622] [INFO ] [MAIN ] SLQT: Loaded 44370 primary data records. [2025-09-29T02:22:37.965222] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:37.967372] [INFO ] [MAIN ] SLGN: Generated 1820 derivative records from 41039 primary records. [2025-09-29T02:22:37.968184] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-29T02:22:37.992099] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1820 records). [2025-09-29T02:22:38.010995] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-29T02:22:38.011590] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:38.014975] [INFO ] [MAIN ] Derivative Progress: 1798/2211 symbols completed. SLGN took 1.4s. Estimated remaining: 2m 55s. Rate: 141.7 symbols/min [2025-09-29T02:22:38.017206] [INFO ] [MAIN ] SLVM: Generated 1820 derivative records from 28332 primary records. [2025-09-29T02:22:38.017612] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-29T02:22:38.037761] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1820 records). [2025-09-29T02:22:38.038745] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-29T02:22:38.043266] [INFO ] [MAIN ] Derivative Progress: 1799/2211 symbols completed. SLVM took 1.3s. Estimated remaining: 2m 54s. Rate: 141.8 symbols/min [2025-09-29T02:22:38.057080] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:38.057884] [INFO ] [MAIN ] SLQT: Generated 1820 derivative records from 44370 primary records. [2025-09-29T02:22:38.058004] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-29T02:22:38.074362] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1820 records). [2025-09-29T02:22:38.074518] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-29T02:22:38.078730] [INFO ] [MAIN ] Derivative Progress: 1800/2211 symbols completed. SLQT took 1.4s. Estimated remaining: 2m 54s. Rate: 141.9 symbols/min [2025-09-29T02:22:38.079235] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:38.079285] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:38.079347] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:38.099731] [DEBUG] [LOCAL ] SMBK: Loaded 8332 existing records from primary storage. [2025-09-29T02:22:38.100086] [INFO ] [MAIN ] SMBK: Loaded 8332 primary data records. [2025-09-29T02:22:38.129363] [DEBUG] [LOCAL ] SMC: Loaded 11630 existing records from primary storage. [2025-09-29T02:22:38.180617] [INFO ] [MAIN ] SMC: Loaded 11630 primary data records. [2025-09-29T02:22:38.685288] [DEBUG] [LOCAL ] SM: Loaded 53080 existing records from primary storage. [2025-09-29T02:22:38.831917] [INFO ] [MAIN ] SM: Loaded 53080 primary data records. [2025-09-29T02:22:39.290317] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:39.304359] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:39.306949] [INFO ] [MAIN ] SMC: Generated 1820 derivative records from 11630 primary records. [2025-09-29T02:22:39.307075] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-29T02:22:39.305567] [INFO ] [MAIN ] SMBK: Generated 1820 derivative records from 8332 primary records. [2025-09-29T02:22:39.308205] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-29T02:22:39.336223] [DEBUG] [LOCAL ] SMC: Derivative data saved (1820 records). [2025-09-29T02:22:39.339468] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-29T02:22:39.345119] [INFO ] [MAIN ] Derivative Progress: 1801/2211 symbols completed. SMC took 1.3s. Estimated remaining: 2m 54s. Rate: 141.7 symbols/min [2025-09-29T02:22:39.345567] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:39.348382] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1820 records). [2025-09-29T02:22:39.348911] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-29T02:22:39.351778] [INFO ] [MAIN ] Derivative Progress: 1802/2211 symbols completed. SMBK took 1.3s. Estimated remaining: 2m 53s. Rate: 141.8 symbols/min [2025-09-29T02:22:39.352208] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:39.373972] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:39.376263] [INFO ] [MAIN ] SM: Generated 1820 derivative records from 53080 primary records. [2025-09-29T02:22:39.376498] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-29T02:22:39.395914] [DEBUG] [LOCAL ] SM: Derivative data saved (1820 records). [2025-09-29T02:22:39.396111] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-29T02:22:39.399775] [INFO ] [MAIN ] Derivative Progress: 1803/2211 symbols completed. SM took 1.3s. Estimated remaining: 2m 53s. Rate: 141.9 symbols/min [2025-09-29T02:22:39.400171] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:39.442780] [DEBUG] [LOCAL ] SMHI: Loaded 13885 existing records from primary storage. [2025-09-29T02:22:39.456676] [INFO ] [MAIN ] SMHI: Loaded 13885 primary data records. [2025-09-29T02:22:39.489092] [DEBUG] [LOCAL ] SMFG: Loaded 48771 existing records from primary storage. [2025-09-29T02:22:39.488049] [DEBUG] [LOCAL ] SMG: Loaded 44546 existing records from primary storage. [2025-09-29T02:22:39.516501] [INFO ] [MAIN ] SMFG: Loaded 48771 primary data records. [2025-09-29T02:22:39.538396] [INFO ] [MAIN ] SMG: Loaded 44546 primary data records. [2025-09-29T02:22:40.531248] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:40.533171] [INFO ] [MAIN ] SMHI: Generated 1820 derivative records from 13885 primary records. [2025-09-29T02:22:40.533522] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-29T02:22:40.570244] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1820 records). [2025-09-29T02:22:40.594342] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-29T02:22:40.594099] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:40.597061] [INFO ] [MAIN ] Derivative Progress: 1804/2211 symbols completed. SMHI took 1.2s. Estimated remaining: 2m 52s. Rate: 141.7 symbols/min [2025-09-29T02:22:40.598445] [INFO ] [MAIN ] SMG: Generated 1820 derivative records from 44546 primary records. [2025-09-29T02:22:40.597549] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:40.599490] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:40.599599] [INFO ] [MAIN ] SMFG: Generated 1820 derivative records from 48771 primary records. [2025-09-29T02:22:40.599720] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-29T02:22:40.600407] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-29T02:22:40.636764] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1820 records). [2025-09-29T02:22:40.641869] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-29T02:22:40.641704] [DEBUG] [LOCAL ] SMG: Derivative data saved (1820 records). [2025-09-29T02:22:40.647457] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-29T02:22:40.647253] [INFO ] [MAIN ] Derivative Progress: 1805/2211 symbols completed. SMFG took 1.3s. Estimated remaining: 2m 52s. Rate: 141.8 symbols/min [2025-09-29T02:22:40.658174] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:40.658293] [INFO ] [MAIN ] Derivative Progress: 1806/2211 symbols completed. SMG took 1.3s. Estimated remaining: 2m 51s. Rate: 141.9 symbols/min [2025-09-29T02:22:40.658983] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:40.675094] [DEBUG] [LOCAL ] SMP: Loaded 19999 existing records from primary storage. [2025-09-29T02:22:40.675616] [INFO ] [MAIN ] SMP: Loaded 19999 primary data records. [2025-09-29T02:22:41.103859] [DEBUG] [LOCAL ] SMR: Loaded 54577 existing records from primary storage. [2025-09-29T02:22:41.104210] [INFO ] [MAIN ] SMR: Loaded 54577 primary data records. [2025-09-29T02:22:41.105618] [DEBUG] [LOCAL ] SMRT: Loaded 44707 existing records from primary storage. [2025-09-29T02:22:41.111285] [INFO ] [MAIN ] SMRT: Loaded 44707 primary data records. [2025-09-29T02:22:41.919242] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:41.922072] [INFO ] [MAIN ] SMP: Generated 1820 derivative records from 19999 primary records. [2025-09-29T02:22:41.922718] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-29T02:22:41.944692] [DEBUG] [LOCAL ] SMP: Derivative data saved (1820 records). [2025-09-29T02:22:41.945090] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-29T02:22:41.948200] [INFO ] [MAIN ] Derivative Progress: 1807/2211 symbols completed. SMP took 1.3s. Estimated remaining: 2m 51s. Rate: 141.7 symbols/min [2025-09-29T02:22:41.949129] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:41.981308] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:41.989094] [INFO ] [MAIN ] SMR: Generated 1820 derivative records from 54577 primary records. [2025-09-29T02:22:41.999386] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:42.000575] [INFO ] [MAIN ] SMRT: Generated 1820 derivative records from 44707 primary records. [2025-09-29T02:22:41.999715] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-09-29T02:22:42.001720] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-29T02:22:42.040222] [DEBUG] [LOCAL ] SMR: Derivative data saved (1820 records). [2025-09-29T02:22:42.050018] [DEBUG] [LOCAL ] SMWB: Loaded 33137 existing records from primary storage. [2025-09-29T02:22:42.050133] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-29T02:22:42.050351] [INFO ] [MAIN ] SMWB: Loaded 33137 primary data records. [2025-09-29T02:22:42.053448] [INFO ] [MAIN ] Derivative Progress: 1808/2211 symbols completed. SMR took 1.4s. Estimated remaining: 2m 51s. Rate: 141.8 symbols/min [2025-09-29T02:22:42.048387] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1820 records). [2025-09-29T02:22:42.053810] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:42.054157] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-29T02:22:42.094778] [INFO ] [MAIN ] Derivative Progress: 1809/2211 symbols completed. SMRT took 1.4s. Estimated remaining: 2m 50s. Rate: 141.9 symbols/min [2025-09-29T02:22:42.108473] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:42.419918] [DEBUG] [LOCAL ] SNA: Loaded 26608 existing records from primary storage. [2025-09-29T02:22:42.538763] [INFO ] [MAIN ] SNA: Loaded 26608 primary data records. [2025-09-29T02:22:42.673452] [DEBUG] [LOCAL ] SN: Loaded 50487 existing records from primary storage. [2025-09-29T02:22:42.686594] [INFO ] [MAIN ] SN: Loaded 50487 primary data records. [2025-09-29T02:22:42.872342] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:42.874198] [INFO ] [MAIN ] SMWB: Generated 1820 derivative records from 33137 primary records. [2025-09-29T02:22:42.950414] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-29T02:22:43.584975] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1820 records). [2025-09-29T02:22:43.585624] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-29T02:22:43.588599] [INFO ] [MAIN ] Derivative Progress: 1810/2211 symbols completed. SMWB took 1.6s. Estimated remaining: 2m 50s. Rate: 141.7 symbols/min [2025-09-29T02:22:43.591753] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:43.627201] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:43.643764] [INFO ] [MAIN ] SNA: Generated 1820 derivative records from 26608 primary records. [2025-09-29T02:22:43.644270] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:43.644686] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-29T02:22:43.646116] [INFO ] [MAIN ] SN: Generated 1820 derivative records from 50487 primary records. [2025-09-29T02:22:43.646525] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-29T02:22:43.694585] [DEBUG] [LOCAL ] SNA: Derivative data saved (1820 records). [2025-09-29T02:22:43.700851] [DEBUG] [LOCAL ] SN: Derivative data saved (1820 records). [2025-09-29T02:22:43.701057] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-29T02:22:43.719370] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-29T02:22:43.722565] [INFO ] [MAIN ] Derivative Progress: 1811/2211 symbols completed. SNA took 1.6s. Estimated remaining: 2m 49s. Rate: 141.7 symbols/min [2025-09-29T02:22:43.724279] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-29T02:22:43.727806] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:43.728068] [INFO ] [MAIN ] Derivative Progress: 1812/2211 symbols completed. SN took 1.7s. Estimated remaining: 2m 49s. Rate: 141.8 symbols/min [2025-09-29T02:22:43.728304] [INFO ] [MAIN ] SNAP: Loaded 54576 primary data records. [2025-09-29T02:22:43.728924] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:43.832363] [DEBUG] [LOCAL ] SNDA: Loaded 4732 existing records from primary storage. [2025-09-29T02:22:43.858604] [INFO ] [MAIN ] SNDA: Loaded 4732 primary data records. [2025-09-29T02:22:44.274614] [DEBUG] [LOCAL ] SNDR: Loaded 41368 existing records from primary storage. [2025-09-29T02:22:44.281062] [INFO ] [MAIN ] SNDR: Loaded 41368 primary data records. [2025-09-29T02:22:44.955116] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:44.957308] [INFO ] [MAIN ] SNAP: Generated 1820 derivative records from 54576 primary records. [2025-09-29T02:22:44.957789] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-29T02:22:44.981398] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1820 records). [2025-09-29T02:22:44.994925] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-29T02:22:45.000547] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:44.999790] [INFO ] [MAIN ] Derivative Progress: 1813/2211 symbols completed. SNAP took 1.4s. Estimated remaining: 2m 49s. Rate: 141.6 symbols/min [2025-09-29T02:22:45.002242] [INFO ] [MAIN ] SNDA: Generated 1820 derivative records from 4732 primary records. [2025-09-29T02:22:45.002674] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-29T02:22:45.021880] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1820 records). [2025-09-29T02:22:45.022288] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-29T02:22:45.038625] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:45.037952] [INFO ] [MAIN ] Derivative Progress: 1814/2211 symbols completed. SNDA took 1.3s. Estimated remaining: 2m 48s. Rate: 141.7 symbols/min [2025-09-29T02:22:45.039524] [INFO ] [MAIN ] SNDR: Generated 1820 derivative records from 41368 primary records. [2025-09-29T02:22:45.039736] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-29T02:22:45.057145] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1820 records). [2025-09-29T02:22:45.057365] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-29T02:22:45.061284] [INFO ] [MAIN ] Derivative Progress: 1815/2211 symbols completed. SNDR took 1.3s. Estimated remaining: 2m 48s. Rate: 141.8 symbols/min [2025-09-29T02:22:45.061808] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:45.062233] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:45.062498] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:45.146161] [DEBUG] [LOCAL ] SNN: Loaded 45037 existing records from primary storage. [2025-09-29T02:22:45.163508] [INFO ] [MAIN ] SNN: Loaded 45037 primary data records. [2025-09-29T02:22:45.180566] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-09-29T02:22:45.186715] [DEBUG] [LOCAL ] SNV: Loaded 49633 existing records from primary storage. [2025-09-29T02:22:45.231154] [INFO ] [MAIN ] SNOW: Loaded 54371 primary data records. [2025-09-29T02:22:45.240104] [INFO ] [MAIN ] SNV: Loaded 49633 primary data records. [2025-09-29T02:22:46.369228] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:46.370688] [INFO ] [MAIN ] SNN: Generated 1820 derivative records from 45037 primary records. [2025-09-29T02:22:46.370906] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-29T02:22:46.396413] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:46.405191] [DEBUG] [LOCAL ] SNN: Derivative data saved (1820 records). [2025-09-29T02:22:46.406243] [INFO ] [MAIN ] SNOW: Generated 1820 derivative records from 54371 primary records. [2025-09-29T02:22:46.420894] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-29T02:22:46.421302] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:46.421399] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-29T02:22:46.426632] [INFO ] [MAIN ] Derivative Progress: 1816/2211 symbols completed. SNN took 1.4s. Estimated remaining: 2m 47s. Rate: 141.6 symbols/min [2025-09-29T02:22:46.426955] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:46.422353] [INFO ] [MAIN ] SNV: Generated 1820 derivative records from 49633 primary records. [2025-09-29T02:22:46.436847] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-29T02:22:46.465433] [DEBUG] [LOCAL ] SNV: Derivative data saved (1820 records). [2025-09-29T02:22:46.461365] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1820 records). [2025-09-29T02:22:46.465707] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-29T02:22:46.465842] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-29T02:22:46.469176] [INFO ] [MAIN ] Derivative Progress: 1817/2211 symbols completed. SNV took 1.4s. Estimated remaining: 2m 47s. Rate: 141.7 symbols/min [2025-09-29T02:22:46.473003] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:46.473092] [INFO ] [MAIN ] Derivative Progress: 1818/2211 symbols completed. SNOW took 1.4s. Estimated remaining: 2m 46s. Rate: 141.7 symbols/min [2025-09-29T02:22:46.473865] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:46.538908] [DEBUG] [LOCAL ] SNX: Loaded 40540 existing records from primary storage. [2025-09-29T02:22:46.539422] [INFO ] [MAIN ] SNX: Loaded 40540 primary data records. [2025-09-29T02:22:46.688828] [DEBUG] [LOCAL ] SOBO: Loaded 40211 existing records from primary storage. [2025-09-29T02:22:46.709825] [INFO ] [MAIN ] SOBO: Loaded 40211 primary data records. [2025-09-29T02:22:46.734400] [DEBUG] [LOCAL ] SO: Loaded 54383 existing records from primary storage. [2025-09-29T02:22:46.760593] [INFO ] [MAIN ] SO: Loaded 54383 primary data records. [2025-09-29T02:22:47.706926] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:47.708340] [INFO ] [MAIN ] SNX: Generated 1820 derivative records from 40540 primary records. [2025-09-29T02:22:47.708923] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-29T02:22:47.731587] [DEBUG] [LOCAL ] SNX: Derivative data saved (1820 records). [2025-09-29T02:22:47.732086] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-29T02:22:47.734598] [INFO ] [MAIN ] Derivative Progress: 1819/2211 symbols completed. SNX took 1.3s. Estimated remaining: 2m 46s. Rate: 141.6 symbols/min [2025-09-29T02:22:47.735882] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:47.757168] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:47.760871] [INFO ] [MAIN ] SOBO: Generated 1820 derivative records from 40211 primary records. [2025-09-29T02:22:47.775143] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-29T02:22:47.775919] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:47.776844] [INFO ] [MAIN ] SO: Generated 1820 derivative records from 54383 primary records. [2025-09-29T02:22:47.777003] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-09-29T02:22:47.809278] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1820 records). [2025-09-29T02:22:47.814697] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-29T02:22:47.816315] [DEBUG] [LOCAL ] SO: Derivative data saved (1820 records). [2025-09-29T02:22:47.816536] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-09-29T02:22:47.820871] [INFO ] [MAIN ] Derivative Progress: 1820/2211 symbols completed. SO took 1.3s. Estimated remaining: 2m 46s. Rate: 141.7 symbols/min [2025-09-29T02:22:47.821243] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:47.825233] [INFO ] [MAIN ] Derivative Progress: 1821/2211 symbols completed. SOBO took 1.4s. Estimated remaining: 2m 45s. Rate: 141.7 symbols/min [2025-09-29T02:22:47.841906] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:47.874707] [DEBUG] [LOCAL ] SOJC: Loaded 5120 existing records from primary storage. [2025-09-29T02:22:47.875061] [INFO ] [MAIN ] SOJC: Loaded 5120 primary data records. [2025-09-29T02:22:47.882677] [DEBUG] [LOCAL ] SOC: Loaded 51041 existing records from primary storage. [2025-09-29T02:22:47.926115] [INFO ] [MAIN ] SOC: Loaded 51041 primary data records. [2025-09-29T02:22:47.964116] [DEBUG] [LOCAL ] SOJD: Loaded 13180 existing records from primary storage. [2025-09-29T02:22:47.996150] [INFO ] [MAIN ] SOJD: Loaded 13180 primary data records. [2025-09-29T02:22:49.147685] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:49.150843] [INFO ] [MAIN ] SOJC: Generated 1820 derivative records from 5120 primary records. [2025-09-29T02:22:49.151225] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-29T02:22:49.168760] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:49.171166] [INFO ] [MAIN ] SOC: Generated 1820 derivative records from 51041 primary records. [2025-09-29T02:22:49.188415] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1820 records). [2025-09-29T02:22:49.184967] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-29T02:22:49.189444] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-29T02:22:49.192423] [INFO ] [MAIN ] Derivative Progress: 1822/2211 symbols completed. SOJC took 1.4s. Estimated remaining: 2m 45s. Rate: 141.6 symbols/min [2025-09-29T02:22:49.192776] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:49.224897] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:49.229851] [INFO ] [MAIN ] SOJD: Generated 1820 derivative records from 13180 primary records. [2025-09-29T02:22:49.228798] [DEBUG] [LOCAL ] SOC: Derivative data saved (1820 records). [2025-09-29T02:22:49.230151] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-29T02:22:49.230242] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-29T02:22:49.234520] [INFO ] [MAIN ] Derivative Progress: 1823/2211 symbols completed. SOC took 1.5s. Estimated remaining: 2m 44s. Rate: 141.6 symbols/min [2025-09-29T02:22:49.238069] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:49.259595] [DEBUG] [LOCAL ] SOJE: Loaded 9408 existing records from primary storage. [2025-09-29T02:22:49.261989] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1820 records). [2025-09-29T02:22:49.262267] [INFO ] [MAIN ] SOJE: Loaded 9408 primary data records. [2025-09-29T02:22:49.262375] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-29T02:22:49.284983] [INFO ] [MAIN ] Derivative Progress: 1824/2211 symbols completed. SOJD took 1.4s. Estimated remaining: 2m 44s. Rate: 141.7 symbols/min [2025-09-29T02:22:49.304455] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:49.402217] [DEBUG] [LOCAL ] SOL: Loaded 13694 existing records from primary storage. [2025-09-29T02:22:49.408601] [INFO ] [MAIN ] SOL: Loaded 13694 primary data records. [2025-09-29T02:22:49.849214] [DEBUG] [LOCAL ] SOLV: Loaded 44791 existing records from primary storage. [2025-09-29T02:22:49.884784] [INFO ] [MAIN ] SOLV: Loaded 44791 primary data records. [2025-09-29T02:22:50.397158] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:50.399018] [INFO ] [MAIN ] SOJE: Generated 1820 derivative records from 9408 primary records. [2025-09-29T02:22:50.399297] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-29T02:22:50.424736] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1820 records). [2025-09-29T02:22:50.425410] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-29T02:22:50.441376] [INFO ] [MAIN ] Derivative Progress: 1825/2211 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 44s. Rate: 141.6 symbols/min [2025-09-29T02:22:50.443529] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:50.442322] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:50.444896] [INFO ] [MAIN ] SOL: Generated 1820 derivative records from 13694 primary records. [2025-09-29T02:22:50.445455] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-29T02:22:50.463822] [DEBUG] [LOCAL ] SOL: Derivative data saved (1820 records). [2025-09-29T02:22:50.464006] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-29T02:22:50.466370] [INFO ] [MAIN ] Derivative Progress: 1826/2211 symbols completed. SOL took 1.2s. Estimated remaining: 2m 43s. Rate: 141.6 symbols/min [2025-09-29T02:22:50.466962] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:50.486593] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:50.487834] [INFO ] [MAIN ] SOLV: Generated 1820 derivative records from 44791 primary records. [2025-09-29T02:22:50.487967] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-29T02:22:50.512703] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1820 records). [2025-09-29T02:22:50.524172] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-29T02:22:50.528725] [INFO ] [MAIN ] Derivative Progress: 1827/2211 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 43s. Rate: 141.7 symbols/min [2025-09-29T02:22:50.529202] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:50.549346] [DEBUG] [LOCAL ] SOR: Loaded 2947 existing records from primary storage. [2025-09-29T02:22:50.549544] [INFO ] [MAIN ] SOR: Loaded 2947 primary data records. [2025-09-29T02:22:50.645117] [DEBUG] [LOCAL ] SON: Loaded 43596 existing records from primary storage. [2025-09-29T02:22:50.708137] [INFO ] [MAIN ] SON: Loaded 43596 primary data records. [2025-09-29T02:22:50.714466] [DEBUG] [LOCAL ] SONY: Loaded 54136 existing records from primary storage. [2025-09-29T02:22:50.725307] [INFO ] [MAIN ] SONY: Loaded 54136 primary data records. [2025-09-29T02:22:51.728146] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:51.729390] [INFO ] [MAIN ] SOR: Generated 1820 derivative records from 2947 primary records. [2025-09-29T02:22:51.729686] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-29T02:22:51.750879] [DEBUG] [LOCAL ] SOR: Derivative data saved (1820 records). [2025-09-29T02:22:51.751489] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-29T02:22:51.758103] [INFO ] [MAIN ] Derivative Progress: 1828/2211 symbols completed. SOR took 1.2s. Estimated remaining: 2m 42s. Rate: 141.6 symbols/min [2025-09-29T02:22:51.774146] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:51.788685] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:51.789450] [INFO ] [MAIN ] SON: Generated 1820 derivative records from 43596 primary records. [2025-09-29T02:22:51.790262] [INFO ] [MAIN ] SONY: Generated 1820 derivative records from 54136 primary records. [2025-09-29T02:22:51.789665] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-29T02:22:51.791070] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-29T02:22:51.823979] [DEBUG] [LOCAL ] SON: Derivative data saved (1820 records). [2025-09-29T02:22:51.825725] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-29T02:22:51.828893] [INFO ] [MAIN ] Derivative Progress: 1829/2211 symbols completed. SON took 1.4s. Estimated remaining: 2m 42s. Rate: 141.6 symbols/min [2025-09-29T02:22:51.829000] [DEBUG] [LOCAL ] SONY: Derivative data saved (1820 records). [2025-09-29T02:22:51.829242] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-29T02:22:51.832927] [INFO ] [MAIN ] Derivative Progress: 1830/2211 symbols completed. SONY took 1.4s. Estimated remaining: 2m 41s. Rate: 141.7 symbols/min [2025-09-29T02:22:51.833762] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:51.833826] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:51.833614] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:51.849480] [DEBUG] [LOCAL ] SOS: Loaded 8266 existing records from primary storage. [2025-09-29T02:22:51.849814] [INFO ] [MAIN ] SOS: Loaded 8266 primary data records. [2025-09-29T02:22:52.101102] [DEBUG] [LOCAL ] SPB: Loaded 34677 existing records from primary storage. [2025-09-29T02:22:52.160791] [INFO ] [MAIN ] SPB: Loaded 34677 primary data records. [2025-09-29T02:22:52.245760] [DEBUG] [LOCAL ] SPCE: Loaded 50615 existing records from primary storage. [2025-09-29T02:22:52.251367] [INFO ] [MAIN ] SPCE: Loaded 50615 primary data records. [2025-09-29T02:22:52.997007] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:52.998803] [INFO ] [MAIN ] SOS: Generated 1820 derivative records from 8266 primary records. [2025-09-29T02:22:53.000145] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-29T02:22:53.022590] [DEBUG] [LOCAL ] SOS: Derivative data saved (1820 records). [2025-09-29T02:22:53.022863] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-29T02:22:53.026316] [INFO ] [MAIN ] Derivative Progress: 1831/2211 symbols completed. SOS took 1.2s. Estimated remaining: 2m 41s. Rate: 141.6 symbols/min [2025-09-29T02:22:53.027161] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:53.051474] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:53.052518] [INFO ] [MAIN ] SPB: Generated 1820 derivative records from 34677 primary records. [2025-09-29T02:22:53.056583] [DEBUG] [LOCAL ] SPE: Loaded 6441 existing records from primary storage. [2025-09-29T02:22:53.069149] [INFO ] [MAIN ] SPE: Loaded 6441 primary data records. [2025-09-29T02:22:53.074860] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:53.056180] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-29T02:22:53.075768] [INFO ] [MAIN ] SPCE: Generated 1820 derivative records from 50615 primary records. [2025-09-29T02:22:53.075878] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-29T02:22:53.269200] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1820 records). [2025-09-29T02:22:53.291072] [DEBUG] [LOCAL ] SPB: Derivative data saved (1820 records). [2025-09-29T02:22:53.429146] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-29T02:22:53.438854] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-29T02:22:53.442775] [INFO ] [MAIN ] Derivative Progress: 1832/2211 symbols completed. SPCE took 1.6s. Estimated remaining: 2m 41s. Rate: 141.6 symbols/min [2025-09-29T02:22:53.445770] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:53.445922] [INFO ] [MAIN ] Derivative Progress: 1833/2211 symbols completed. SPB took 1.6s. Estimated remaining: 2m 40s. Rate: 141.6 symbols/min [2025-09-29T02:22:53.446140] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:53.480948] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:53.482046] [INFO ] [MAIN ] SPE: Generated 1820 derivative records from 6441 primary records. [2025-09-29T02:22:53.482142] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-29T02:22:53.512550] [DEBUG] [LOCAL ] SPE: Derivative data saved (1820 records). [2025-09-29T02:22:53.525704] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-29T02:22:53.528786] [INFO ] [MAIN ] Derivative Progress: 1834/2211 symbols completed. SPE took 0.5s. Estimated remaining: 2m 40s. Rate: 141.7 symbols/min [2025-09-29T02:22:53.529246] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:53.568222] [DEBUG] [LOCAL ] SPGI: Loaded 46562 existing records from primary storage. [2025-09-29T02:22:53.568639] [INFO ] [MAIN ] SPGI: Loaded 46562 primary data records. [2025-09-29T02:22:53.606440] [DEBUG] [LOCAL ] SPG: Loaded 51134 existing records from primary storage. [2025-09-29T02:22:53.629687] [INFO ] [MAIN ] SPG: Loaded 51134 primary data records. [2025-09-29T02:22:53.733845] [DEBUG] [LOCAL ] SPH: Loaded 18213 existing records from primary storage. [2025-09-29T02:22:53.785908] [INFO ] [MAIN ] SPH: Loaded 18213 primary data records. [2025-09-29T02:22:54.737458] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:54.739330] [INFO ] [MAIN ] SPGI: Generated 1820 derivative records from 46562 primary records. [2025-09-29T02:22:54.739895] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-29T02:22:54.758051] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1820 records). [2025-09-29T02:22:54.758329] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-29T02:22:54.762154] [INFO ] [MAIN ] Derivative Progress: 1835/2211 symbols completed. SPGI took 1.3s. Estimated remaining: 2m 39s. Rate: 141.5 symbols/min [2025-09-29T02:22:54.763715] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:54.797829] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:54.797484] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:54.799003] [INFO ] [MAIN ] SPG: Generated 1820 derivative records from 51134 primary records. [2025-09-29T02:22:54.799876] [INFO ] [MAIN ] SPH: Generated 1820 derivative records from 18213 primary records. [2025-09-29T02:22:54.800112] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-29T02:22:54.800179] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-29T02:22:54.835132] [DEBUG] [LOCAL ] SPH: Derivative data saved (1820 records). [2025-09-29T02:22:54.836472] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-29T02:22:54.841442] [INFO ] [MAIN ] Derivative Progress: 1836/2211 symbols completed. SPH took 1.3s. Estimated remaining: 2m 39s. Rate: 141.6 symbols/min [2025-09-29T02:22:54.852228] [DEBUG] [LOCAL ] SPG: Derivative data saved (1820 records). [2025-09-29T02:22:54.852494] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-29T02:22:54.852379] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:54.856005] [INFO ] [MAIN ] Derivative Progress: 1837/2211 symbols completed. SPG took 1.4s. Estimated remaining: 2m 38s. Rate: 141.7 symbols/min [2025-09-29T02:22:54.856783] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:54.865945] [DEBUG] [LOCAL ] SPMC: Loaded 5613 existing records from primary storage. [2025-09-29T02:22:54.867479] [INFO ] [MAIN ] SPMC: Loaded 5613 primary data records. [2025-09-29T02:22:54.933832] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-09-29T02:22:54.980517] [INFO ] [MAIN ] SPHR: Loaded 40745 primary data records. [2025-09-29T02:22:55.383562] [DEBUG] [LOCAL ] SPIR: Loaded 37871 existing records from primary storage. [2025-09-29T02:22:55.384483] [INFO ] [MAIN ] SPIR: Loaded 37871 primary data records. [2025-09-29T02:22:56.075985] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:56.078087] [INFO ] [MAIN ] SPMC: Generated 1820 derivative records from 5613 primary records. [2025-09-29T02:22:56.078571] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-29T02:22:56.100347] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1820 records). [2025-09-29T02:22:56.100908] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-29T02:22:56.103467] [INFO ] [MAIN ] Derivative Progress: 1838/2211 symbols completed. SPMC took 1.2s. Estimated remaining: 2m 38s. Rate: 141.5 symbols/min [2025-09-29T02:22:56.118300] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:56.117536] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:56.120140] [INFO ] [MAIN ] SPHR: Generated 1820 derivative records from 40745 primary records. [2025-09-29T02:22:56.121009] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-29T02:22:56.143942] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1820 records). [2025-09-29T02:22:56.144252] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-29T02:22:56.162280] [INFO ] [MAIN ] Derivative Progress: 1839/2211 symbols completed. SPHR took 1.4s. Estimated remaining: 2m 38s. Rate: 141.6 symbols/min [2025-09-29T02:22:56.162710] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:56.164176] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:56.165338] [INFO ] [MAIN ] SPIR: Generated 1820 derivative records from 37871 primary records. [2025-09-29T02:22:56.165431] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-29T02:22:56.195887] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1820 records). [2025-09-29T02:22:56.207419] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-29T02:22:56.210472] [INFO ] [MAIN ] Derivative Progress: 1840/2211 symbols completed. SPIR took 1.4s. Estimated remaining: 2m 37s. Rate: 141.7 symbols/min [2025-09-29T02:22:56.211337] [DEBUG] [LOCAL ] SPNT: Loaded 35342 existing records from primary storage. [2025-09-29T02:22:56.211916] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:56.212252] [INFO ] [MAIN ] SPNT: Loaded 35342 primary data records. [2025-09-29T02:22:56.637162] [DEBUG] [LOCAL ] SPOT: Loaded 51481 existing records from primary storage. [2025-09-29T02:22:56.638449] [DEBUG] [LOCAL ] SPR: Loaded 41867 existing records from primary storage. [2025-09-29T02:22:56.638593] [INFO ] [MAIN ] SPOT: Loaded 51481 primary data records. [2025-09-29T02:22:56.639063] [INFO ] [MAIN ] SPR: Loaded 41867 primary data records. [2025-09-29T02:22:57.413557] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:57.416996] [INFO ] [MAIN ] SPNT: Generated 1820 derivative records from 35342 primary records. [2025-09-29T02:22:57.417886] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-29T02:22:57.437868] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1820 records). [2025-09-29T02:22:57.440221] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-29T02:22:57.446223] [INFO ] [MAIN ] Derivative Progress: 1841/2211 symbols completed. SPNT took 1.3s. Estimated remaining: 2m 37s. Rate: 141.5 symbols/min [2025-09-29T02:22:57.446708] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:57.462746] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:57.464023] [INFO ] [MAIN ] SPR: Generated 1820 derivative records from 41867 primary records. [2025-09-29T02:22:57.464461] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-29T02:22:57.487092] [DEBUG] [LOCAL ] SPRU: Loaded 8714 existing records from primary storage. [2025-09-29T02:22:57.491261] [INFO ] [MAIN ] SPRU: Loaded 8714 primary data records. [2025-09-29T02:22:57.581054] [DEBUG] [LOCAL ] SPR: Derivative data saved (1820 records). [2025-09-29T02:22:57.598267] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:57.613411] [INFO ] [MAIN ] SPOT: Generated 1820 derivative records from 51481 primary records. [2025-09-29T02:22:57.607005] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-29T02:22:57.639328] [INFO ] [MAIN ] Derivative Progress: 1842/2211 symbols completed. SPR took 1.4s. Estimated remaining: 2m 36s. Rate: 141.6 symbols/min [2025-09-29T02:22:57.644182] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:57.618835] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-29T02:22:57.729381] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1820 records). [2025-09-29T02:22:57.755812] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-29T02:22:57.759433] [INFO ] [MAIN ] Derivative Progress: 1843/2211 symbols completed. SPOT took 1.6s. Estimated remaining: 2m 36s. Rate: 141.6 symbols/min [2025-09-29T02:22:57.901889] [DEBUG] [LOCAL ] SPXC: Loaded 23666 existing records from primary storage. [2025-09-29T02:22:57.902129] [INFO ] [MAIN ] SPXC: Loaded 23666 primary data records. [2025-09-29T02:22:58.312410] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:58.314825] [INFO ] [MAIN ] SPRU: Generated 1820 derivative records from 8714 primary records. [2025-09-29T02:22:58.315185] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-29T02:22:58.332150] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1820 records). [2025-09-29T02:22:58.332283] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-29T02:22:58.334851] [INFO ] [MAIN ] Derivative Progress: 1844/2211 symbols completed. SPRU took 0.9s. Estimated remaining: 2m 36s. Rate: 141.6 symbols/min [2025-09-29T02:22:58.355682] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:58.356534] [INFO ] [MAIN ] SPXC: Generated 1820 derivative records from 23666 primary records. [2025-09-29T02:22:58.356626] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-29T02:22:58.372938] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1820 records). [2025-09-29T02:22:58.373084] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-29T02:22:58.377048] [INFO ] [MAIN ] Derivative Progress: 1845/2211 symbols completed. SPXC took 0.7s. Estimated remaining: 2m 35s. Rate: 141.7 symbols/min [2025-09-29T02:22:58.377630] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:58.377979] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:58.377781] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:58.397205] [DEBUG] [LOCAL ] SPXX: Loaded 9166 existing records from primary storage. [2025-09-29T02:22:58.397601] [INFO ] [MAIN ] SPXX: Loaded 9166 primary data records. [2025-09-29T02:22:58.565611] [DEBUG] [LOCAL ] SQNS: Loaded 26307 existing records from primary storage. [2025-09-29T02:22:58.571090] [INFO ] [MAIN ] SQNS: Loaded 26307 primary data records. [2025-09-29T02:22:58.704212] [DEBUG] [LOCAL ] SQM: Loaded 49278 existing records from primary storage. [2025-09-29T02:22:58.848568] [INFO ] [MAIN ] SQM: Loaded 49278 primary data records. [2025-09-29T02:22:59.495874] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:59.498672] [INFO ] [MAIN ] SPXX: Generated 1820 derivative records from 9166 primary records. [2025-09-29T02:22:59.499219] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-29T02:22:59.518571] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1820 records). [2025-09-29T02:22:59.518740] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-29T02:22:59.521393] [INFO ] [MAIN ] Derivative Progress: 1846/2211 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 35s. Rate: 141.5 symbols/min [2025-09-29T02:22:59.523305] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:59.562933] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:59.564983] [INFO ] [MAIN ] SQM: Generated 1820 derivative records from 49278 primary records. [2025-09-29T02:22:59.565984] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:59.567016] [INFO ] [MAIN ] SQNS: Generated 1820 derivative records from 26307 primary records. [2025-09-29T02:22:59.566100] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-29T02:22:59.567217] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-29T02:22:59.609260] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1820 records). [2025-09-29T02:22:59.613235] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-29T02:22:59.616619] [INFO ] [MAIN ] Derivative Progress: 1847/2211 symbols completed. SQNS took 1.2s. Estimated remaining: 2m 34s. Rate: 141.6 symbols/min [2025-09-29T02:22:59.616963] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:59.618397] [DEBUG] [LOCAL ] SQM: Derivative data saved (1820 records). [2025-09-29T02:22:59.618694] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-29T02:22:59.622287] [INFO ] [MAIN ] Derivative Progress: 1848/2211 symbols completed. SQM took 1.2s. Estimated remaining: 2m 34s. Rate: 141.7 symbols/min [2025-09-29T02:22:59.622639] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:59.637090] [DEBUG] [LOCAL ] SR: Loaded 33411 existing records from primary storage. [2025-09-29T02:22:59.637286] [INFO ] [MAIN ] SR: Loaded 33411 primary data records. [2025-09-29T02:22:59.743722] [DEBUG] [LOCAL ] SREA: Loaded 10561 existing records from primary storage. [2025-09-29T02:22:59.764308] [INFO ] [MAIN ] SREA: Loaded 10561 primary data records. [2025-09-29T02:23:00.195959] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-29T02:23:00.233782] [INFO ] [MAIN ] SRE: Loaded 54202 primary data records. [2025-09-29T02:23:00.779297] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:00.780294] [INFO ] [MAIN ] SR: Generated 1820 derivative records from 33411 primary records. [2025-09-29T02:23:00.780813] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-29T02:23:00.803739] [DEBUG] [LOCAL ] SR: Derivative data saved (1820 records). [2025-09-29T02:23:00.804798] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-29T02:23:00.809786] [INFO ] [MAIN ] Derivative Progress: 1849/2211 symbols completed. SR took 1.3s. Estimated remaining: 2m 33s. Rate: 141.5 symbols/min [2025-09-29T02:23:00.810953] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:00.827090] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:00.828057] [INFO ] [MAIN ] SREA: Generated 1820 derivative records from 10561 primary records. [2025-09-29T02:23:00.828695] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-29T02:23:00.847974] [DEBUG] [LOCAL ] SREA: Derivative data saved (1820 records). [2025-09-29T02:23:00.851443] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-29T02:23:00.854253] [INFO ] [MAIN ] Derivative Progress: 1850/2211 symbols completed. SREA took 1.2s. Estimated remaining: 2m 33s. Rate: 141.6 symbols/min [2025-09-29T02:23:00.854575] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:00.870466] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:00.871210] [INFO ] [MAIN ] SRE: Generated 1820 derivative records from 54202 primary records. [2025-09-29T02:23:00.871352] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-29T02:23:00.920392] [DEBUG] [LOCAL ] SRG: Loaded 15859 existing records from primary storage. [2025-09-29T02:23:00.922517] [DEBUG] [LOCAL ] SRE: Derivative data saved (1820 records). [2025-09-29T02:23:00.921520] [DEBUG] [LOCAL ] SRFM: Loaded 36431 existing records from primary storage. [2025-09-29T02:23:00.922883] [INFO ] [MAIN ] SRG: Loaded 15859 primary data records. [2025-09-29T02:23:00.923010] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-29T02:23:00.926202] [INFO ] [MAIN ] Derivative Progress: 1851/2211 symbols completed. SRE took 1.3s. Estimated remaining: 2m 32s. Rate: 141.7 symbols/min [2025-09-29T02:23:00.923073] [INFO ] [MAIN ] SRFM: Loaded 36431 primary data records. [2025-09-29T02:23:00.939419] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:01.486781] [DEBUG] [LOCAL ] SRI: Loaded 27810 existing records from primary storage. [2025-09-29T02:23:01.604370] [INFO ] [MAIN ] SRI: Loaded 27810 primary data records. [2025-09-29T02:23:02.054065] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:02.058380] [INFO ] [MAIN ] SRFM: Generated 1820 derivative records from 36431 primary records. [2025-09-29T02:23:02.075225] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:02.074696] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-29T02:23:02.076281] [INFO ] [MAIN ] SRG: Generated 1820 derivative records from 15859 primary records. [2025-09-29T02:23:02.076389] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-29T02:23:02.112080] [DEBUG] [LOCAL ] SRG: Derivative data saved (1820 records). [2025-09-29T02:23:02.112211] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-29T02:23:02.108766] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1820 records). [2025-09-29T02:23:02.115230] [INFO ] [MAIN ] Derivative Progress: 1852/2211 symbols completed. SRG took 1.3s. Estimated remaining: 2m 32s. Rate: 141.5 symbols/min [2025-09-29T02:23:02.115334] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-29T02:23:02.116028] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:02.118712] [INFO ] [MAIN ] Derivative Progress: 1853/2211 symbols completed. SRFM took 1.3s. Estimated remaining: 2m 32s. Rate: 141.6 symbols/min [2025-09-29T02:23:02.120122] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:02.142428] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:02.144359] [INFO ] [MAIN ] SRI: Generated 1820 derivative records from 27810 primary records. [2025-09-29T02:23:02.148468] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-29T02:23:02.148727] [DEBUG] [LOCAL ] SRV: Loaded 7631 existing records from primary storage. [2025-09-29T02:23:02.149769] [INFO ] [MAIN ] SRV: Loaded 7631 primary data records. [2025-09-29T02:23:02.254310] [DEBUG] [LOCAL ] SRI: Derivative data saved (1820 records). [2025-09-29T02:23:02.271556] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-29T02:23:02.281612] [INFO ] [MAIN ] Derivative Progress: 1854/2211 symbols completed. SRI took 1.3s. Estimated remaining: 2m 31s. Rate: 141.6 symbols/min [2025-09-29T02:23:02.304879] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:02.545908] [DEBUG] [LOCAL ] SSB: Loaded 43377 existing records from primary storage. [2025-09-29T02:23:02.563590] [INFO ] [MAIN ] SSB: Loaded 43377 primary data records. [2025-09-29T02:23:02.681709] [DEBUG] [LOCAL ] SSD: Loaded 22631 existing records from primary storage. [2025-09-29T02:23:02.696874] [INFO ] [MAIN ] SSD: Loaded 22631 primary data records. [2025-09-29T02:23:03.338031] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:03.341114] [INFO ] [MAIN ] SRV: Generated 1820 derivative records from 7631 primary records. [2025-09-29T02:23:03.341717] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-29T02:23:03.364453] [DEBUG] [LOCAL ] SRV: Derivative data saved (1820 records). [2025-09-29T02:23:03.382510] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-29T02:23:03.382965] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:03.386336] [INFO ] [MAIN ] Derivative Progress: 1855/2211 symbols completed. SRV took 1.3s. Estimated remaining: 2m 31s. Rate: 141.5 symbols/min [2025-09-29T02:23:03.387353] [INFO ] [MAIN ] SSB: Generated 1820 derivative records from 43377 primary records. [2025-09-29T02:23:03.387947] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:03.388284] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-29T02:23:03.406923] [DEBUG] [LOCAL ] SSB: Derivative data saved (1820 records). [2025-09-29T02:23:03.407077] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-29T02:23:03.409993] [INFO ] [MAIN ] Derivative Progress: 1856/2211 symbols completed. SSB took 1.3s. Estimated remaining: 2m 30s. Rate: 141.6 symbols/min [2025-09-29T02:23:03.410345] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:03.428514] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:03.429565] [INFO ] [MAIN ] SSD: Generated 1820 derivative records from 22631 primary records. [2025-09-29T02:23:03.429811] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-29T02:23:03.451718] [DEBUG] [LOCAL ] SSD: Derivative data saved (1820 records). [2025-09-29T02:23:03.468947] [DEBUG] [LOCAL ] SST: Loaded 12166 existing records from primary storage. [2025-09-29T02:23:03.468523] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-29T02:23:03.469106] [INFO ] [MAIN ] SST: Loaded 12166 primary data records. [2025-09-29T02:23:03.472483] [INFO ] [MAIN ] Derivative Progress: 1857/2211 symbols completed. SSD took 1.2s. Estimated remaining: 2m 30s. Rate: 141.7 symbols/min [2025-09-29T02:23:03.517719] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:03.575590] [DEBUG] [LOCAL ] SSL: Loaded 41830 existing records from primary storage. [2025-09-29T02:23:03.604000] [INFO ] [MAIN ] SSL: Loaded 41830 primary data records. [2025-09-29T02:23:04.006899] [DEBUG] [LOCAL ] SSTK: Loaded 26762 existing records from primary storage. [2025-09-29T02:23:04.055188] [INFO ] [MAIN ] SSTK: Loaded 26762 primary data records. [2025-09-29T02:23:04.610987] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:04.612816] [INFO ] [MAIN ] SST: Generated 1820 derivative records from 12166 primary records. [2025-09-29T02:23:04.631857] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-29T02:23:04.633727] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:04.648390] [INFO ] [MAIN ] SSL: Generated 1820 derivative records from 41830 primary records. [2025-09-29T02:23:04.654040] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-29T02:23:04.672728] [DEBUG] [LOCAL ] SST: Derivative data saved (1820 records). [2025-09-29T02:23:04.677802] [DEBUG] [LOCAL ] SSL: Derivative data saved (1820 records). [2025-09-29T02:23:04.677884] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-29T02:23:04.678264] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-29T02:23:04.681761] [INFO ] [MAIN ] Derivative Progress: 1858/2211 symbols completed. SSL took 1.3s. Estimated remaining: 2m 30s. Rate: 141.5 symbols/min [2025-09-29T02:23:04.685358] [INFO ] [MAIN ] Derivative Progress: 1859/2211 symbols completed. SST took 1.3s. Estimated remaining: 2m 29s. Rate: 141.6 symbols/min [2025-09-29T02:23:04.701939] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:04.702776] [INFO ] [MAIN ] SSTK: Generated 1820 derivative records from 26762 primary records. [2025-09-29T02:23:04.702866] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-29T02:23:04.719383] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1820 records). [2025-09-29T02:23:04.719546] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-29T02:23:04.723583] [INFO ] [MAIN ] Derivative Progress: 1860/2211 symbols completed. SSTK took 1.2s. Estimated remaining: 2m 29s. Rate: 141.7 symbols/min [2025-09-29T02:23:04.724368] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:04.724269] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:04.724438] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:04.751146] [DEBUG] [LOCAL ] STC: Loaded 17878 existing records from primary storage. [2025-09-29T02:23:04.751493] [INFO ] [MAIN ] STC: Loaded 17878 primary data records. [2025-09-29T02:23:05.150015] [DEBUG] [LOCAL ] ST: Loaded 50505 existing records from primary storage. [2025-09-29T02:23:05.222377] [DEBUG] [LOCAL ] STAG: Loaded 50799 existing records from primary storage. [2025-09-29T02:23:05.222638] [INFO ] [MAIN ] ST: Loaded 50505 primary data records. [2025-09-29T02:23:05.223069] [INFO ] [MAIN ] STAG: Loaded 50799 primary data records. [2025-09-29T02:23:05.970538] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:05.972748] [INFO ] [MAIN ] STC: Generated 1820 derivative records from 17878 primary records. [2025-09-29T02:23:05.973972] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-29T02:23:05.997385] [DEBUG] [LOCAL ] STC: Derivative data saved (1820 records). [2025-09-29T02:23:05.997829] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-29T02:23:06.001285] [INFO ] [MAIN ] Derivative Progress: 1861/2211 symbols completed. STC took 1.3s. Estimated remaining: 2m 28s. Rate: 141.5 symbols/min [2025-09-29T02:23:06.002639] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:06.031982] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:06.041925] [INFO ] [MAIN ] ST: Generated 1820 derivative records from 50505 primary records. [2025-09-29T02:23:06.048629] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:06.048792] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-29T02:23:06.051069] [INFO ] [MAIN ] STAG: Generated 1820 derivative records from 50799 primary records. [2025-09-29T02:23:06.051318] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-29T02:23:06.092166] [DEBUG] [LOCAL ] ST: Derivative data saved (1820 records). [2025-09-29T02:23:06.093769] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-29T02:23:06.097915] [INFO ] [MAIN ] Derivative Progress: 1862/2211 symbols completed. ST took 1.4s. Estimated remaining: 2m 28s. Rate: 141.6 symbols/min [2025-09-29T02:23:06.098436] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:06.101425] [DEBUG] [LOCAL ] STAG: Derivative data saved (1820 records). [2025-09-29T02:23:06.101742] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-29T02:23:06.105843] [INFO ] [MAIN ] Derivative Progress: 1863/2211 symbols completed. STAG took 1.4s. Estimated remaining: 2m 27s. Rate: 141.6 symbols/min [2025-09-29T02:23:06.107548] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:06.121278] [DEBUG] [LOCAL ] STE: Loaded 35822 existing records from primary storage. [2025-09-29T02:23:06.121626] [INFO ] [MAIN ] STE: Loaded 35822 primary data records. [2025-09-29T02:23:06.274216] [DEBUG] [LOCAL ] STEL: Loaded 23823 existing records from primary storage. [2025-09-29T02:23:06.291823] [INFO ] [MAIN ] STEL: Loaded 23823 primary data records. [2025-09-29T02:23:06.413933] [DEBUG] [LOCAL ] STEM: Loaded 40374 existing records from primary storage. [2025-09-29T02:23:06.477236] [INFO ] [MAIN ] STEM: Loaded 40374 primary data records. [2025-09-29T02:23:07.362105] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:07.363928] [INFO ] [MAIN ] STE: Generated 1820 derivative records from 35822 primary records. [2025-09-29T02:23:07.364338] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-29T02:23:07.386044] [DEBUG] [LOCAL ] STE: Derivative data saved (1820 records). [2025-09-29T02:23:07.386678] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-29T02:23:07.389609] [INFO ] [MAIN ] Derivative Progress: 1864/2211 symbols completed. STE took 1.4s. Estimated remaining: 2m 27s. Rate: 141.5 symbols/min [2025-09-29T02:23:07.390189] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:07.410314] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:07.412234] [INFO ] [MAIN ] STEL: Generated 1820 derivative records from 23823 primary records. [2025-09-29T02:23:07.426671] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:07.427697] [INFO ] [MAIN ] STEM: Generated 1820 derivative records from 40374 primary records. [2025-09-29T02:23:07.427860] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-29T02:23:07.426767] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-29T02:23:07.465764] [DEBUG] [LOCAL ] STEL: Derivative data saved (1820 records). [2025-09-29T02:23:07.467468] [DEBUG] [LOCAL ] STEM: Derivative data saved (1820 records). [2025-09-29T02:23:07.467778] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-29T02:23:07.467896] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-29T02:23:07.471053] [INFO ] [MAIN ] Derivative Progress: 1865/2211 symbols completed. STEL took 1.4s. Estimated remaining: 2m 27s. Rate: 141.6 symbols/min [2025-09-29T02:23:07.481766] [INFO ] [MAIN ] Derivative Progress: 1866/2211 symbols completed. STEM took 1.4s. Estimated remaining: 2m 26s. Rate: 141.6 symbols/min [2025-09-29T02:23:07.481578] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:07.482057] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:07.482943] [DEBUG] [LOCAL ] STEW: Loaded 16354 existing records from primary storage. [2025-09-29T02:23:07.483543] [INFO ] [MAIN ] STEW: Loaded 16354 primary data records. [2025-09-29T02:23:07.622561] [DEBUG] [LOCAL ] STK: Loaded 9550 existing records from primary storage. [2025-09-29T02:23:07.628619] [INFO ] [MAIN ] STK: Loaded 9550 primary data records. [2025-09-29T02:23:08.113109] [DEBUG] [LOCAL ] STLA: Loaded 54322 existing records from primary storage. [2025-09-29T02:23:08.227932] [INFO ] [MAIN ] STLA: Loaded 54322 primary data records. [2025-09-29T02:23:08.613823] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:08.614699] [INFO ] [MAIN ] STEW: Generated 1820 derivative records from 16354 primary records. [2025-09-29T02:23:08.615020] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-29T02:23:08.636596] [DEBUG] [LOCAL ] STEW: Derivative data saved (1820 records). [2025-09-29T02:23:08.637139] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-29T02:23:08.647594] [INFO ] [MAIN ] Derivative Progress: 1867/2211 symbols completed. STEW took 1.3s. Estimated remaining: 2m 26s. Rate: 141.5 symbols/min [2025-09-29T02:23:08.653748] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:08.654986] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:08.655854] [INFO ] [MAIN ] STK: Generated 1820 derivative records from 9550 primary records. [2025-09-29T02:23:08.656112] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-29T02:23:08.675482] [DEBUG] [LOCAL ] STK: Derivative data saved (1820 records). [2025-09-29T02:23:08.676040] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-29T02:23:08.678764] [INFO ] [MAIN ] Derivative Progress: 1868/2211 symbols completed. STK took 1.2s. Estimated remaining: 2m 25s. Rate: 141.6 symbols/min [2025-09-29T02:23:08.679405] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:08.701552] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:08.702753] [INFO ] [MAIN ] STLA: Generated 1820 derivative records from 54322 primary records. [2025-09-29T02:23:08.703166] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-29T02:23:08.729425] [DEBUG] [LOCAL ] STLA: Derivative data saved (1820 records). [2025-09-29T02:23:08.729687] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-29T02:23:08.734270] [INFO ] [MAIN ] Derivative Progress: 1869/2211 symbols completed. STLA took 1.3s. Estimated remaining: 2m 25s. Rate: 141.6 symbols/min [2025-09-29T02:23:08.759027] [DEBUG] [LOCAL ] STN: Loaded 23436 existing records from primary storage. [2025-09-29T02:23:08.759313] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:08.759502] [INFO ] [MAIN ] STN: Loaded 23436 primary data records. [2025-09-29T02:23:08.901261] [DEBUG] [LOCAL ] STM: Loaded 54362 existing records from primary storage. [2025-09-29T02:23:08.928743] [INFO ] [MAIN ] STM: Loaded 54362 primary data records. [2025-09-29T02:23:09.260952] [DEBUG] [LOCAL ] STNG: Loaded 44620 existing records from primary storage. [2025-09-29T02:23:09.279573] [INFO ] [MAIN ] STNG: Loaded 44620 primary data records. [2025-09-29T02:23:09.959275] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:09.960278] [INFO ] [MAIN ] STN: Generated 1820 derivative records from 23436 primary records. [2025-09-29T02:23:09.961735] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-29T02:23:09.983744] [DEBUG] [LOCAL ] STN: Derivative data saved (1820 records). [2025-09-29T02:23:09.984061] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-29T02:23:09.986301] [INFO ] [MAIN ] Derivative Progress: 1870/2211 symbols completed. STN took 1.3s. Estimated remaining: 2m 25s. Rate: 141.5 symbols/min [2025-09-29T02:23:09.987358] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:10.009369] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:10.010461] [INFO ] [MAIN ] STM: Generated 1820 derivative records from 54362 primary records. [2025-09-29T02:23:10.010626] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-29T02:23:10.036963] [DEBUG] [LOCAL ] STRV: Loaded 11754 existing records from primary storage. [2025-09-29T02:23:10.039687] [DEBUG] [LOCAL ] STM: Derivative data saved (1820 records). [2025-09-29T02:23:10.039872] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-29T02:23:10.043928] [INFO ] [MAIN ] Derivative Progress: 1871/2211 symbols completed. STM took 1.4s. Estimated remaining: 2m 24s. Rate: 141.5 symbols/min [2025-09-29T02:23:10.045348] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:10.039929] [INFO ] [MAIN ] STRV: Loaded 11754 primary data records. [2025-09-29T02:23:10.122325] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:10.169166] [INFO ] [MAIN ] STNG: Generated 1820 derivative records from 44620 primary records. [2025-09-29T02:23:10.191789] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-29T02:23:10.278521] [DEBUG] [LOCAL ] STNG: Derivative data saved (1820 records). [2025-09-29T02:23:10.302467] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-29T02:23:10.307007] [INFO ] [MAIN ] Derivative Progress: 1872/2211 symbols completed. STNG took 1.5s. Estimated remaining: 2m 24s. Rate: 141.6 symbols/min [2025-09-29T02:23:10.449704] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:10.478373] [DEBUG] [LOCAL ] STT: Loaded 51793 existing records from primary storage. [2025-09-29T02:23:10.478631] [INFO ] [MAIN ] STT: Loaded 51793 primary data records. [2025-09-29T02:23:10.654160] [DEBUG] [LOCAL ] STVN: Loaded 26677 existing records from primary storage. [2025-09-29T02:23:10.696810] [INFO ] [MAIN ] STVN: Loaded 26677 primary data records. [2025-09-29T02:23:10.970535] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:10.995492] [INFO ] [MAIN ] STRV: Generated 1820 derivative records from 11754 primary records. [2025-09-29T02:23:11.000540] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-29T02:23:11.104221] [DEBUG] [LOCAL ] STRV: Derivative data saved (1820 records). [2025-09-29T02:23:11.229422] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-29T02:23:11.243171] [INFO ] [MAIN ] Derivative Progress: 1873/2211 symbols completed. STRV took 1.3s. Estimated remaining: 2m 23s. Rate: 141.5 symbols/min [2025-09-29T02:23:11.264494] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:11.265840] [INFO ] [MAIN ] STT: Generated 1820 derivative records from 51793 primary records. [2025-09-29T02:23:11.265965] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-29T02:23:11.284908] [DEBUG] [LOCAL ] STT: Derivative data saved (1820 records). [2025-09-29T02:23:11.285311] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-29T02:23:11.288453] [INFO ] [MAIN ] Derivative Progress: 1874/2211 symbols completed. STT took 1.2s. Estimated remaining: 2m 23s. Rate: 141.6 symbols/min [2025-09-29T02:23:11.306467] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:11.307281] [INFO ] [MAIN ] STVN: Generated 1820 derivative records from 26677 primary records. [2025-09-29T02:23:11.307376] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-29T02:23:11.326598] [DEBUG] [LOCAL ] STVN: Derivative data saved (1820 records). [2025-09-29T02:23:11.326746] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-29T02:23:11.329924] [INFO ] [MAIN ] Derivative Progress: 1875/2211 symbols completed. STVN took 0.9s. Estimated remaining: 2m 22s. Rate: 141.6 symbols/min [2025-09-29T02:23:11.330395] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:11.330520] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:11.330563] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:11.339455] [DEBUG] [LOCAL ] STXD: Loaded 1341 existing records from primary storage. [2025-09-29T02:23:11.339767] [DEBUG] [LOCAL ] STXE: Loaded 2234 existing records from primary storage. [2025-09-29T02:23:11.340039] [INFO ] [MAIN ] STXD: Loaded 1341 primary data records. [2025-09-29T02:23:11.340114] [INFO ] [MAIN ] STXE: Loaded 2234 primary data records. [2025-09-29T02:23:12.084978] [DEBUG] [LOCAL ] STWD: Loaded 52643 existing records from primary storage. [2025-09-29T02:23:12.103580] [INFO ] [MAIN ] STWD: Loaded 52643 primary data records. [2025-09-29T02:23:12.506635] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:12.521567] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:12.522514] [INFO ] [MAIN ] STXD: Generated 1819 derivative records from 1341 primary records. [2025-09-29T02:23:12.523548] [INFO ] [MAIN ] STXE: Generated 1819 derivative records from 2234 primary records. [2025-09-29T02:23:12.523884] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-29T02:23:12.523813] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-29T02:23:12.558499] [DEBUG] [LOCAL ] STXE: Derivative data saved (1819 records). [2025-09-29T02:23:12.560855] [DEBUG] [LOCAL ] STXD: Derivative data saved (1819 records). [2025-09-29T02:23:12.561029] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-29T02:23:12.563571] [INFO ] [MAIN ] Derivative Progress: 1876/2211 symbols completed. STXD took 1.2s. Estimated remaining: 2m 22s. Rate: 141.5 symbols/min [2025-09-29T02:23:12.558946] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-29T02:23:12.564548] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:12.568394] [INFO ] [MAIN ] Derivative Progress: 1877/2211 symbols completed. STXE took 1.2s. Estimated remaining: 2m 22s. Rate: 141.5 symbols/min [2025-09-29T02:23:12.569584] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:12.578933] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-29T02:23:12.579225] [INFO ] [MAIN ] STXG: Loaded 2612 primary data records. [2025-09-29T02:23:12.593796] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:12.597524] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-09-29T02:23:12.637152] [INFO ] [MAIN ] STWD: Generated 1820 derivative records from 52643 primary records. [2025-09-29T02:23:12.655497] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-29T02:23:12.664205] [INFO ] [MAIN ] STXK: Loaded 1535 primary data records. [2025-09-29T02:23:12.873093] [DEBUG] [LOCAL ] STWD: Derivative data saved (1820 records). [2025-09-29T02:23:12.957675] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-29T02:23:13.126937] [INFO ] [MAIN ] Derivative Progress: 1878/2211 symbols completed. STWD took 1.8s. Estimated remaining: 2m 21s. Rate: 141.5 symbols/min [2025-09-29T02:23:13.175626] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:13.346400] [DEBUG] [LOCAL ] STXT: Loaded 2592 existing records from primary storage. [2025-09-29T02:23:13.347628] [INFO ] [MAIN ] STXT: Loaded 2592 primary data records. [2025-09-29T02:23:13.552559] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:13.585304] [INFO ] [MAIN ] STXG: Generated 1819 derivative records from 2612 primary records. [2025-09-29T02:23:13.628508] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-29T02:23:13.794866] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:13.797897] [INFO ] [MAIN ] STXK: Generated 1819 derivative records from 1535 primary records. [2025-09-29T02:23:13.798546] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-29T02:23:13.796973] [DEBUG] [LOCAL ] STXG: Derivative data saved (1819 records). [2025-09-29T02:23:13.799275] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-29T02:23:13.802772] [INFO ] [MAIN ] Derivative Progress: 1879/2211 symbols completed. STXG took 1.2s. Estimated remaining: 2m 21s. Rate: 141.5 symbols/min [2025-09-29T02:23:13.803405] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:13.820922] [DEBUG] [LOCAL ] STXK: Derivative data saved (1819 records). [2025-09-29T02:23:13.821271] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-29T02:23:13.824140] [INFO ] [MAIN ] Derivative Progress: 1880/2211 symbols completed. STXK took 1.3s. Estimated remaining: 2m 20s. Rate: 141.6 symbols/min [2025-09-29T02:23:13.824562] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:13.826923] [DEBUG] [LOCAL ] STXV: Loaded 1648 existing records from primary storage. [2025-09-29T02:23:13.827864] [INFO ] [MAIN ] STXV: Loaded 1648 primary data records. [2025-09-29T02:23:14.036598] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:14.151098] [INFO ] [MAIN ] STXT: Generated 1819 derivative records from 2592 primary records. [2025-09-29T02:23:14.234225] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-29T02:23:14.262855] [DEBUG] [LOCAL ] STXT: Derivative data saved (1819 records). [2025-09-29T02:23:14.278569] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-29T02:23:14.283389] [INFO ] [MAIN ] Derivative Progress: 1881/2211 symbols completed. STXT took 1.1s. Estimated remaining: 2m 20s. Rate: 141.5 symbols/min [2025-09-29T02:23:14.286413] [DEBUG] [LOCAL ] STZ: Loaded 53035 existing records from primary storage. [2025-09-29T02:23:14.286988] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:14.287074] [INFO ] [MAIN ] STZ: Loaded 53035 primary data records. [2025-09-29T02:23:14.651761] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:14.652958] [INFO ] [MAIN ] STXV: Generated 1819 derivative records from 1648 primary records. [2025-09-29T02:23:14.653793] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-29T02:23:14.689060] [DEBUG] [LOCAL ] STXV: Derivative data saved (1819 records). [2025-09-29T02:23:14.689893] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-29T02:23:14.692481] [INFO ] [MAIN ] Derivative Progress: 1882/2211 symbols completed. STXV took 0.9s. Estimated remaining: 2m 19s. Rate: 141.5 symbols/min [2025-09-29T02:23:14.692726] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:14.694767] [DEBUG] [LOCAL ] SU: Loaded 54234 existing records from primary storage. [2025-09-29T02:23:14.696513] [INFO ] [MAIN ] SU: Loaded 54234 primary data records. [2025-09-29T02:23:15.088239] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:15.089904] [DEBUG] [LOCAL ] SUI: Loaded 42505 existing records from primary storage. [2025-09-29T02:23:15.090756] [INFO ] [MAIN ] SUI: Loaded 42505 primary data records. [2025-09-29T02:23:15.091696] [INFO ] [MAIN ] STZ: Generated 1820 derivative records from 53035 primary records. [2025-09-29T02:23:15.091977] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-29T02:23:15.229949] [DEBUG] [LOCAL ] STZ: Derivative data saved (1820 records). [2025-09-29T02:23:15.230332] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-29T02:23:15.285873] [INFO ] [MAIN ] Derivative Progress: 1883/2211 symbols completed. STZ took 1.5s. Estimated remaining: 2m 19s. Rate: 141.5 symbols/min [2025-09-29T02:23:15.433999] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:15.474458] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:15.475794] [INFO ] [MAIN ] SU: Generated 1820 derivative records from 54234 primary records. [2025-09-29T02:23:15.476003] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-29T02:23:15.499036] [DEBUG] [LOCAL ] SU: Derivative data saved (1820 records). [2025-09-29T02:23:15.499541] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-29T02:23:15.503218] [INFO ] [MAIN ] Derivative Progress: 1884/2211 symbols completed. SU took 1.2s. Estimated remaining: 2m 19s. Rate: 141.6 symbols/min [2025-09-29T02:23:15.503769] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:15.544681] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:15.546566] [INFO ] [MAIN ] SUI: Generated 1820 derivative records from 42505 primary records. [2025-09-29T02:23:15.546699] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-29T02:23:15.547772] [DEBUG] [LOCAL ] SUN: Loaded 37928 existing records from primary storage. [2025-09-29T02:23:15.548049] [INFO ] [MAIN ] SUN: Loaded 37928 primary data records. [2025-09-29T02:23:15.650936] [DEBUG] [LOCAL ] SUI: Derivative data saved (1820 records). [2025-09-29T02:23:15.663108] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-29T02:23:15.688308] [INFO ] [MAIN ] Derivative Progress: 1885/2211 symbols completed. SUI took 1.0s. Estimated remaining: 2m 18s. Rate: 141.6 symbols/min [2025-09-29T02:23:15.711036] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:15.973445] [DEBUG] [LOCAL ] SUPV: Loaded 47961 existing records from primary storage. [2025-09-29T02:23:15.973989] [INFO ] [MAIN ] SUPV: Loaded 47961 primary data records. [2025-09-29T02:23:16.161631] [DEBUG] [LOCAL ] SUZ: Loaded 46428 existing records from primary storage. [2025-09-29T02:23:16.162372] [INFO ] [MAIN ] SUZ: Loaded 46428 primary data records. [2025-09-29T02:23:16.350331] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:16.552776] [INFO ] [MAIN ] SUN: Generated 1820 derivative records from 37928 primary records. [2025-09-29T02:23:16.573160] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-29T02:23:16.715407] [DEBUG] [LOCAL ] SUN: Derivative data saved (1820 records). [2025-09-29T02:23:16.807434] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-29T02:23:16.825494] [INFO ] [MAIN ] Derivative Progress: 1886/2211 symbols completed. SUN took 1.4s. Estimated remaining: 2m 18s. Rate: 141.5 symbols/min [2025-09-29T02:23:16.826702] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:16.854191] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:16.855082] [INFO ] [MAIN ] SUPV: Generated 1820 derivative records from 47961 primary records. [2025-09-29T02:23:16.855356] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-29T02:23:16.873463] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1820 records). [2025-09-29T02:23:16.883376] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-29T02:23:16.888435] [INFO ] [MAIN ] Derivative Progress: 1887/2211 symbols completed. SUPV took 1.4s. Estimated remaining: 2m 17s. Rate: 141.5 symbols/min [2025-09-29T02:23:16.889103] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:16.907910] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:16.920397] [INFO ] [MAIN ] SUZ: Generated 1820 derivative records from 46428 primary records. [2025-09-29T02:23:16.920701] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-29T02:23:16.932996] [DEBUG] [LOCAL ] SVV: Loaded 40221 existing records from primary storage. [2025-09-29T02:23:16.936859] [INFO ] [MAIN ] SVV: Loaded 40221 primary data records. [2025-09-29T02:23:16.998201] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1820 records). [2025-09-29T02:23:17.030430] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-29T02:23:17.060342] [INFO ] [MAIN ] Derivative Progress: 1888/2211 symbols completed. SUZ took 1.3s. Estimated remaining: 2m 17s. Rate: 141.6 symbols/min [2025-09-29T02:23:17.326749] [DEBUG] [LOCAL ] SW: Loaded 53939 existing records from primary storage. [2025-09-29T02:23:17.327007] [INFO ] [MAIN ] SW: Loaded 53939 primary data records. [2025-09-29T02:23:17.696514] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:17.698003] [INFO ] [MAIN ] SVV: Generated 1820 derivative records from 40221 primary records. [2025-09-29T02:23:17.698335] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-29T02:23:17.717022] [DEBUG] [LOCAL ] SVV: Derivative data saved (1820 records). [2025-09-29T02:23:17.717521] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-29T02:23:17.720630] [INFO ] [MAIN ] Derivative Progress: 1889/2211 symbols completed. SVV took 0.9s. Estimated remaining: 2m 17s. Rate: 141.5 symbols/min [2025-09-29T02:23:17.738470] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:17.739136] [INFO ] [MAIN ] SW: Generated 1820 derivative records from 53939 primary records. [2025-09-29T02:23:17.739221] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-29T02:23:17.754700] [DEBUG] [LOCAL ] SW: Derivative data saved (1820 records). [2025-09-29T02:23:17.754821] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-29T02:23:17.757551] [INFO ] [MAIN ] Derivative Progress: 1890/2211 symbols completed. SW took 0.9s. Estimated remaining: 2m 16s. Rate: 141.6 symbols/min [2025-09-29T02:23:17.758676] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:17.758554] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:17.758759] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:17.770472] [DEBUG] [LOCAL ] SWZ: Loaded 6074 existing records from primary storage. [2025-09-29T02:23:17.770934] [INFO ] [MAIN ] SWZ: Loaded 6074 primary data records. [2025-09-29T02:23:18.015590] [DEBUG] [LOCAL ] SWX: Loaded 31735 existing records from primary storage. [2025-09-29T02:23:18.133217] [INFO ] [MAIN ] SWX: Loaded 31735 primary data records. [2025-09-29T02:23:18.255008] [DEBUG] [LOCAL ] SWK: Loaded 53178 existing records from primary storage. [2025-09-29T02:23:18.276613] [INFO ] [MAIN ] SWK: Loaded 53178 primary data records. [2025-09-29T02:23:18.947044] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:18.949038] [INFO ] [MAIN ] SWZ: Generated 1820 derivative records from 6074 primary records. [2025-09-29T02:23:18.949963] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-29T02:23:18.968408] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1820 records). [2025-09-29T02:23:18.974614] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-29T02:23:18.991745] [INFO ] [MAIN ] Derivative Progress: 1891/2211 symbols completed. SWZ took 1.2s. Estimated remaining: 2m 16s. Rate: 141.5 symbols/min [2025-09-29T02:23:18.992350] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:18.994064] [INFO ] [MAIN ] SWX: Generated 1820 derivative records from 31735 primary records. [2025-09-29T02:23:18.994219] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-29T02:23:18.992879] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:19.015235] [DEBUG] [LOCAL ] SWX: Derivative data saved (1820 records). [2025-09-29T02:23:19.015609] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-29T02:23:19.018126] [INFO ] [MAIN ] Derivative Progress: 1892/2211 symbols completed. SWX took 1.3s. Estimated remaining: 2m 15s. Rate: 141.5 symbols/min [2025-09-29T02:23:19.019002] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:19.036488] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:19.037547] [INFO ] [MAIN ] SWK: Generated 1820 derivative records from 53178 primary records. [2025-09-29T02:23:19.037888] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-29T02:23:19.069371] [DEBUG] [LOCAL ] SWK: Derivative data saved (1820 records). [2025-09-29T02:23:19.075445] [DEBUG] [LOCAL ] SXI: Loaded 11685 existing records from primary storage. [2025-09-29T02:23:19.075765] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-29T02:23:19.075844] [INFO ] [MAIN ] SXI: Loaded 11685 primary data records. [2025-09-29T02:23:19.079254] [INFO ] [MAIN ] Derivative Progress: 1893/2211 symbols completed. SWK took 1.3s. Estimated remaining: 2m 15s. Rate: 141.6 symbols/min [2025-09-29T02:23:19.105970] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:19.172102] [DEBUG] [LOCAL ] SXC: Loaded 42142 existing records from primary storage. [2025-09-29T02:23:19.191362] [INFO ] [MAIN ] SXC: Loaded 42142 primary data records. [2025-09-29T02:23:19.643856] [DEBUG] [LOCAL ] SXT: Loaded 29557 existing records from primary storage. [2025-09-29T02:23:19.801399] [INFO ] [MAIN ] SXT: Loaded 29557 primary data records. [2025-09-29T02:23:20.176885] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:20.179809] [INFO ] [MAIN ] SXI: Generated 1820 derivative records from 11685 primary records. [2025-09-29T02:23:20.180979] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-29T02:23:20.195127] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:20.196913] [INFO ] [MAIN ] SXC: Generated 1820 derivative records from 42142 primary records. [2025-09-29T02:23:20.211065] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-29T02:23:20.236610] [DEBUG] [LOCAL ] SXC: Derivative data saved (1820 records). [2025-09-29T02:23:20.237308] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-29T02:23:20.235698] [DEBUG] [LOCAL ] SXI: Derivative data saved (1820 records). [2025-09-29T02:23:20.240250] [INFO ] [MAIN ] Derivative Progress: 1894/2211 symbols completed. SXC took 1.2s. Estimated remaining: 2m 14s. Rate: 141.5 symbols/min [2025-09-29T02:23:20.240985] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:20.240637] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-29T02:23:20.244061] [INFO ] [MAIN ] Derivative Progress: 1895/2211 symbols completed. SXI took 1.2s. Estimated remaining: 2m 14s. Rate: 141.5 symbols/min [2025-09-29T02:23:20.244905] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:20.266137] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:20.267285] [INFO ] [MAIN ] SXT: Generated 1820 derivative records from 29557 primary records. [2025-09-29T02:23:20.267471] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-29T02:23:20.291950] [DEBUG] [LOCAL ] SXT: Derivative data saved (1820 records). [2025-09-29T02:23:20.292253] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-29T02:23:20.295359] [INFO ] [MAIN ] Derivative Progress: 1896/2211 symbols completed. SXT took 1.2s. Estimated remaining: 2m 13s. Rate: 141.6 symbols/min [2025-09-29T02:23:20.295637] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:20.359740] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-09-29T02:23:20.361529] [INFO ] [MAIN ] SYF: Loaded 54222 primary data records. [2025-09-29T02:23:20.452349] [DEBUG] [LOCAL ] SYK: Loaded 47699 existing records from primary storage. [2025-09-29T02:23:20.491276] [INFO ] [MAIN ] SYK: Loaded 47699 primary data records. [2025-09-29T02:23:20.701373] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-09-29T02:23:20.728153] [INFO ] [MAIN ] SYY: Loaded 54009 primary data records. [2025-09-29T02:23:21.551323] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:21.553589] [INFO ] [MAIN ] SYF: Generated 1820 derivative records from 54222 primary records. [2025-09-29T02:23:21.554697] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-29T02:23:21.580768] [DEBUG] [LOCAL ] SYF: Derivative data saved (1820 records). [2025-09-29T02:23:21.595233] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:21.589734] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-29T02:23:21.599321] [INFO ] [MAIN ] Derivative Progress: 1897/2211 symbols completed. SYF took 1.4s. Estimated remaining: 2m 13s. Rate: 141.5 symbols/min [2025-09-29T02:23:21.596148] [INFO ] [MAIN ] SYK: Generated 1820 derivative records from 47699 primary records. [2025-09-29T02:23:21.599829] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:21.599945] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-29T02:23:21.621666] [DEBUG] [LOCAL ] SYK: Derivative data saved (1820 records). [2025-09-29T02:23:21.623404] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-29T02:23:21.626924] [INFO ] [MAIN ] Derivative Progress: 1898/2211 symbols completed. SYK took 1.4s. Estimated remaining: 2m 13s. Rate: 141.5 symbols/min [2025-09-29T02:23:21.627302] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:21.641217] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:21.642084] [INFO ] [MAIN ] SYY: Generated 1820 derivative records from 54009 primary records. [2025-09-29T02:23:21.642239] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-29T02:23:21.662064] [DEBUG] [LOCAL ] SYY: Derivative data saved (1820 records). [2025-09-29T02:23:21.662442] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-29T02:23:21.666512] [INFO ] [MAIN ] Derivative Progress: 1899/2211 symbols completed. SYY took 1.4s. Estimated remaining: 2m 12s. Rate: 141.6 symbols/min [2025-09-29T02:23:21.666925] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:21.726630] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-29T02:23:21.728291] [INFO ] [MAIN ] T: Loaded 54578 primary data records. [2025-09-29T02:23:21.792450] [DEBUG] [LOCAL ] TAC: Loaded 43441 existing records from primary storage. [2025-09-29T02:23:21.850581] [INFO ] [MAIN ] TAC: Loaded 43441 primary data records. [2025-09-29T02:23:21.946486] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-09-29T02:23:21.981232] [INFO ] [MAIN ] TAK: Loaded 50538 primary data records. [2025-09-29T02:23:22.868961] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:22.871375] [INFO ] [MAIN ] T: Generated 1820 derivative records from 54578 primary records. [2025-09-29T02:23:22.871728] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-29T02:23:22.916723] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:22.916869] [DEBUG] [LOCAL ] T: Derivative data saved (1820 records). [2025-09-29T02:23:22.918433] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-29T02:23:22.919787] [INFO ] [MAIN ] TAC: Generated 1820 derivative records from 43441 primary records. [2025-09-29T02:23:22.922446] [INFO ] [MAIN ] Derivative Progress: 1900/2211 symbols completed. T took 1.3s. Estimated remaining: 2m 12s. Rate: 141.4 symbols/min [2025-09-29T02:23:22.922869] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:22.923705] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-29T02:23:22.939179] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:22.963403] [DEBUG] [LOCAL ] TAC: Derivative data saved (1820 records). [2025-09-29T02:23:22.958752] [INFO ] [MAIN ] TAK: Generated 1820 derivative records from 50538 primary records. [2025-09-29T02:23:22.963671] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-29T02:23:22.966663] [INFO ] [MAIN ] Derivative Progress: 1901/2211 symbols completed. TAC took 1.3s. Estimated remaining: 2m 11s. Rate: 141.5 symbols/min [2025-09-29T02:23:22.966928] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:22.963775] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-29T02:23:22.985902] [DEBUG] [LOCAL ] TAK: Derivative data saved (1820 records). [2025-09-29T02:23:22.986111] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-29T02:23:22.988956] [INFO ] [MAIN ] Derivative Progress: 1902/2211 symbols completed. TAK took 1.3s. Estimated remaining: 2m 11s. Rate: 141.6 symbols/min [2025-09-29T02:23:22.989308] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:23.056466] [DEBUG] [LOCAL ] TAL: Loaded 52783 existing records from primary storage. [2025-09-29T02:23:23.057047] [INFO ] [MAIN ] TAL: Loaded 52783 primary data records. [2025-09-29T02:23:23.226373] [DEBUG] [LOCAL ] TALO: Loaded 51575 existing records from primary storage. [2025-09-29T02:23:23.290984] [INFO ] [MAIN ] TALO: Loaded 51575 primary data records. [2025-09-29T02:23:23.327355] [DEBUG] [LOCAL ] TAP: Loaded 53648 existing records from primary storage. [2025-09-29T02:23:23.497606] [INFO ] [MAIN ] TAP: Loaded 53648 primary data records. [2025-09-29T02:23:24.286052] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:24.288093] [INFO ] [MAIN ] TAL: Generated 1820 derivative records from 52783 primary records. [2025-09-29T02:23:24.288211] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-29T02:23:24.308176] [DEBUG] [LOCAL ] TAL: Derivative data saved (1820 records). [2025-09-29T02:23:24.308769] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-29T02:23:24.311510] [INFO ] [MAIN ] Derivative Progress: 1903/2211 symbols completed. TAL took 1.4s. Estimated remaining: 2m 11s. Rate: 141.4 symbols/min [2025-09-29T02:23:24.332899] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:24.334424] [INFO ] [MAIN ] TALO: Generated 1820 derivative records from 51575 primary records. [2025-09-29T02:23:24.334527] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-29T02:23:24.367315] [DEBUG] [LOCAL ] TALO: Derivative data saved (1820 records). [2025-09-29T02:23:24.367452] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-29T02:23:24.378764] [INFO ] [MAIN ] Derivative Progress: 1904/2211 symbols completed. TALO took 1.4s. Estimated remaining: 2m 10s. Rate: 141.5 symbols/min [2025-09-29T02:23:24.379600] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:24.380581] [INFO ] [MAIN ] TAP: Generated 1820 derivative records from 53648 primary records. [2025-09-29T02:23:24.380694] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-29T02:23:24.397427] [DEBUG] [LOCAL ] TAP: Derivative data saved (1820 records). [2025-09-29T02:23:24.397529] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-29T02:23:24.400494] [INFO ] [MAIN ] Derivative Progress: 1905/2211 symbols completed. TAP took 1.4s. Estimated remaining: 2m 10s. Rate: 141.6 symbols/min [2025-09-29T02:23:24.401039] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:24.401093] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:24.401154] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:24.420399] [DEBUG] [LOCAL ] TBB: Loaded 11828 existing records from primary storage. [2025-09-29T02:23:24.425683] [INFO ] [MAIN ] TBB: Loaded 11828 primary data records. [2025-09-29T02:23:24.497588] [DEBUG] [LOCAL ] TBI: Loaded 22937 existing records from primary storage. [2025-09-29T02:23:24.536668] [INFO ] [MAIN ] TBI: Loaded 22937 primary data records. [2025-09-29T02:23:24.767545] [DEBUG] [LOCAL ] TBBB: Loaded 36262 existing records from primary storage. [2025-09-29T02:23:24.924581] [INFO ] [MAIN ] TBBB: Loaded 36262 primary data records. [2025-09-29T02:23:25.556784] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:25.558779] [INFO ] [MAIN ] TBB: Generated 1820 derivative records from 11828 primary records. [2025-09-29T02:23:25.559084] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-29T02:23:25.581683] [DEBUG] [LOCAL ] TBB: Derivative data saved (1820 records). [2025-09-29T02:23:25.595894] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-29T02:23:25.599034] [INFO ] [MAIN ] Derivative Progress: 1906/2211 symbols completed. TBB took 1.2s. Estimated remaining: 2m 9s. Rate: 141.4 symbols/min [2025-09-29T02:23:25.599860] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:25.599531] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:25.601504] [INFO ] [MAIN ] TBI: Generated 1820 derivative records from 22937 primary records. [2025-09-29T02:23:25.602111] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-29T02:23:25.622786] [DEBUG] [LOCAL ] TBN: Loaded 3044 existing records from primary storage. [2025-09-29T02:23:25.624672] [INFO ] [MAIN ] TBN: Loaded 3044 primary data records. [2025-09-29T02:23:25.626712] [DEBUG] [LOCAL ] TBI: Derivative data saved (1820 records). [2025-09-29T02:23:25.644193] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-29T02:23:25.695223] [INFO ] [MAIN ] Derivative Progress: 1907/2211 symbols completed. TBI took 1.3s. Estimated remaining: 2m 9s. Rate: 141.5 symbols/min [2025-09-29T02:23:25.720880] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:25.793022] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:25.811560] [INFO ] [MAIN ] TBBB: Generated 1820 derivative records from 36262 primary records. [2025-09-29T02:23:25.833564] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-29T02:23:26.006604] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1820 records). [2025-09-29T02:23:26.007128] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-29T02:23:26.010946] [INFO ] [MAIN ] Derivative Progress: 1908/2211 symbols completed. TBBB took 1.6s. Estimated remaining: 2m 8s. Rate: 141.5 symbols/min [2025-09-29T02:23:26.012292] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:26.061251] [DEBUG] [LOCAL ] TD: Loaded 53036 existing records from primary storage. [2025-09-29T02:23:26.061571] [INFO ] [MAIN ] TD: Loaded 53036 primary data records. [2025-09-29T02:23:26.113001] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:23:26.140699] [INFO ] [MAIN ] TBN: Generated 1818 derivative records from 3044 primary records. [2025-09-29T02:23:26.205034] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-29T02:23:26.320784] [DEBUG] [LOCAL ] TDC: Loaded 47501 existing records from primary storage. [2025-09-29T02:23:26.447734] [INFO ] [MAIN ] TDC: Loaded 47501 primary data records. [2025-09-29T02:23:26.451491] [DEBUG] [LOCAL ] TBN: Derivative data saved (1818 records). [2025-09-29T02:23:26.451776] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-29T02:23:26.472502] [INFO ] [MAIN ] Derivative Progress: 1909/2211 symbols completed. TBN took 0.9s. Estimated remaining: 2m 8s. Rate: 141.5 symbols/min [2025-09-29T02:23:26.511202] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:26.814605] [DEBUG] [LOCAL ] TDF: Loaded 6595 existing records from primary storage. [2025-09-29T02:23:26.815722] [INFO ] [MAIN ] TDF: Loaded 6595 primary data records. [2025-09-29T02:23:27.170666] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:27.172012] [INFO ] [MAIN ] TD: Generated 1820 derivative records from 53036 primary records. [2025-09-29T02:23:27.172442] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-29T02:23:27.191382] [DEBUG] [LOCAL ] TD: Derivative data saved (1820 records). [2025-09-29T02:23:27.193039] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-29T02:23:27.196435] [INFO ] [MAIN ] Derivative Progress: 1910/2211 symbols completed. TD took 1.5s. Estimated remaining: 2m 8s. Rate: 141.4 symbols/min [2025-09-29T02:23:27.196721] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:27.215311] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:27.216448] [INFO ] [MAIN ] TDC: Generated 1820 derivative records from 47501 primary records. [2025-09-29T02:23:27.216775] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-29T02:23:27.242155] [DEBUG] [LOCAL ] TDC: Derivative data saved (1820 records). [2025-09-29T02:23:27.242618] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-29T02:23:27.264036] [INFO ] [MAIN ] Derivative Progress: 1911/2211 symbols completed. TDC took 1.3s. Estimated remaining: 2m 7s. Rate: 141.5 symbols/min [2025-09-29T02:23:27.264508] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:27.265590] [INFO ] [MAIN ] TDF: Generated 1820 derivative records from 6595 primary records. [2025-09-29T02:23:27.265770] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:27.265904] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-29T02:23:27.294336] [DEBUG] [LOCAL ] TDG: Loaded 22314 existing records from primary storage. [2025-09-29T02:23:27.294872] [INFO ] [MAIN ] TDG: Loaded 22314 primary data records. [2025-09-29T02:23:27.375885] [DEBUG] [LOCAL ] TDF: Derivative data saved (1820 records). [2025-09-29T02:23:27.395595] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-29T02:23:27.429632] [INFO ] [MAIN ] Derivative Progress: 1912/2211 symbols completed. TDF took 0.9s. Estimated remaining: 2m 7s. Rate: 141.5 symbols/min [2025-09-29T02:23:27.447070] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:27.671525] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-09-29T02:23:27.672740] [INFO ] [MAIN ] TDOC: Loaded 54125 primary data records. [2025-09-29T02:23:28.088396] [DEBUG] [LOCAL ] TDS: Loaded 43435 existing records from primary storage. [2025-09-29T02:23:28.089041] [INFO ] [MAIN ] TDS: Loaded 43435 primary data records. [2025-09-29T02:23:28.281044] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:28.316428] [INFO ] [MAIN ] TDG: Generated 1820 derivative records from 22314 primary records. [2025-09-29T02:23:28.316744] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-29T02:23:28.470679] [DEBUG] [LOCAL ] TDG: Derivative data saved (1820 records). [2025-09-29T02:23:28.470992] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-29T02:23:28.474515] [INFO ] [MAIN ] Derivative Progress: 1913/2211 symbols completed. TDG took 1.3s. Estimated remaining: 2m 6s. Rate: 141.4 symbols/min [2025-09-29T02:23:28.476022] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:28.497633] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:28.500818] [INFO ] [MAIN ] TDOC: Generated 1820 derivative records from 54125 primary records. [2025-09-29T02:23:28.501278] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-29T02:23:28.518948] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1820 records). [2025-09-29T02:23:28.519608] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-29T02:23:28.522963] [INFO ] [MAIN ] Derivative Progress: 1914/2211 symbols completed. TDOC took 1.3s. Estimated remaining: 2m 6s. Rate: 141.5 symbols/min [2025-09-29T02:23:28.523410] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:28.541711] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:28.542553] [INFO ] [MAIN ] TDS: Generated 1820 derivative records from 43435 primary records. [2025-09-29T02:23:28.542744] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-29T02:23:28.578410] [DEBUG] [LOCAL ] TDS: Derivative data saved (1820 records). [2025-09-29T02:23:28.593151] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-29T02:23:28.597538] [INFO ] [MAIN ] Derivative Progress: 1915/2211 symbols completed. TDS took 1.2s. Estimated remaining: 2m 5s. Rate: 141.6 symbols/min [2025-09-29T02:23:28.598003] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:28.601860] [DEBUG] [LOCAL ] TDW: Loaded 46091 existing records from primary storage. [2025-09-29T02:23:28.610869] [INFO ] [MAIN ] TDW: Loaded 46091 primary data records. [2025-09-29T02:23:28.617447] [DEBUG] [LOCAL ] TDY: Loaded 22979 existing records from primary storage. [2025-09-29T02:23:28.630583] [INFO ] [MAIN ] TDY: Loaded 22979 primary data records. [2025-09-29T02:23:28.821583] [DEBUG] [LOCAL ] TEAF: Loaded 7529 existing records from primary storage. [2025-09-29T02:23:28.849828] [INFO ] [MAIN ] TEAF: Loaded 7529 primary data records. [2025-09-29T02:23:29.694762] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:29.696064] [INFO ] [MAIN ] TDW: Generated 1820 derivative records from 46091 primary records. [2025-09-29T02:23:29.696260] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-29T02:23:29.695098] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:29.710045] [INFO ] [MAIN ] TDY: Generated 1820 derivative records from 22979 primary records. [2025-09-29T02:23:29.711076] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-29T02:23:29.710418] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:29.724570] [INFO ] [MAIN ] TEAF: Generated 1820 derivative records from 7529 primary records. [2025-09-29T02:23:29.732752] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-29T02:23:29.741974] [DEBUG] [LOCAL ] TDW: Derivative data saved (1820 records). [2025-09-29T02:23:29.746322] [DEBUG] [LOCAL ] TDY: Derivative data saved (1820 records). [2025-09-29T02:23:29.746699] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-29T02:23:29.750272] [INFO ] [MAIN ] Derivative Progress: 1916/2211 symbols completed. TDW took 1.3s. Estimated remaining: 2m 5s. Rate: 141.4 symbols/min [2025-09-29T02:23:29.757998] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:29.759267] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-29T02:23:29.765588] [INFO ] [MAIN ] Derivative Progress: 1917/2211 symbols completed. TDY took 1.2s. Estimated remaining: 2m 5s. Rate: 141.5 symbols/min [2025-09-29T02:23:29.767124] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:29.772373] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1820 records). [2025-09-29T02:23:29.772776] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-29T02:23:29.778331] [INFO ] [MAIN ] Derivative Progress: 1918/2211 symbols completed. TEAF took 1.2s. Estimated remaining: 2m 4s. Rate: 141.6 symbols/min [2025-09-29T02:23:29.822840] [DEBUG] [LOCAL ] TEF: Loaded 37944 existing records from primary storage. [2025-09-29T02:23:29.823066] [INFO ] [MAIN ] TEF: Loaded 37944 primary data records. [2025-09-29T02:23:30.025140] [DEBUG] [LOCAL ] TECK: Loaded 54216 existing records from primary storage. [2025-09-29T02:23:30.057367] [INFO ] [MAIN ] TECK: Loaded 54216 primary data records. [2025-09-29T02:23:30.580330] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:30.581526] [INFO ] [MAIN ] TEF: Generated 1820 derivative records from 37944 primary records. [2025-09-29T02:23:30.581624] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-29T02:23:30.599730] [DEBUG] [LOCAL ] TEF: Derivative data saved (1820 records). [2025-09-29T02:23:30.600091] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-29T02:23:30.603628] [INFO ] [MAIN ] Derivative Progress: 1919/2211 symbols completed. TEF took 0.8s. Estimated remaining: 2m 4s. Rate: 141.5 symbols/min [2025-09-29T02:23:30.621045] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:30.621772] [INFO ] [MAIN ] TECK: Generated 1820 derivative records from 54216 primary records. [2025-09-29T02:23:30.621857] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-29T02:23:30.638756] [DEBUG] [LOCAL ] TECK: Derivative data saved (1820 records). [2025-09-29T02:23:30.638848] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-29T02:23:30.642888] [INFO ] [MAIN ] Derivative Progress: 1920/2211 symbols completed. TECK took 0.9s. Estimated remaining: 2m 3s. Rate: 141.6 symbols/min [2025-09-29T02:23:30.643591] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:30.643543] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:30.643681] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:30.669799] [DEBUG] [LOCAL ] TEI: Loaded 20910 existing records from primary storage. [2025-09-29T02:23:30.670323] [INFO ] [MAIN ] TEI: Loaded 20910 primary data records. [2025-09-29T02:23:30.853317] [DEBUG] [LOCAL ] TEN: Loaded 31383 existing records from primary storage. [2025-09-29T02:23:30.920259] [INFO ] [MAIN ] TEN: Loaded 31383 primary data records. [2025-09-29T02:23:31.093491] [DEBUG] [LOCAL ] TEL: Loaded 51898 existing records from primary storage. [2025-09-29T02:23:31.117168] [INFO ] [MAIN ] TEL: Loaded 51898 primary data records. [2025-09-29T02:23:31.805386] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:31.809124] [INFO ] [MAIN ] TEI: Generated 1820 derivative records from 20910 primary records. [2025-09-29T02:23:31.810103] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-29T02:23:31.834956] [DEBUG] [LOCAL ] TEI: Derivative data saved (1820 records). [2025-09-29T02:23:31.836666] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-29T02:23:31.840609] [INFO ] [MAIN ] Derivative Progress: 1921/2211 symbols completed. TEI took 1.2s. Estimated remaining: 2m 3s. Rate: 141.4 symbols/min [2025-09-29T02:23:31.841060] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:31.858836] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:31.859896] [INFO ] [MAIN ] TEN: Generated 1820 derivative records from 31383 primary records. [2025-09-29T02:23:31.860076] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-29T02:23:31.895533] [DEBUG] [LOCAL ] TEN: Derivative data saved (1820 records). [2025-09-29T02:23:31.901056] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-29T02:23:31.904271] [INFO ] [MAIN ] Derivative Progress: 1922/2211 symbols completed. TEN took 1.3s. Estimated remaining: 2m 3s. Rate: 141.5 symbols/min [2025-09-29T02:23:31.901492] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:31.904683] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:31.906143] [INFO ] [MAIN ] TEL: Generated 1820 derivative records from 51898 primary records. [2025-09-29T02:23:31.914502] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-29T02:23:31.915299] [DEBUG] [LOCAL ] TEO: Loaded 22345 existing records from primary storage. [2025-09-29T02:23:31.917839] [INFO ] [MAIN ] TEO: Loaded 22345 primary data records. [2025-09-29T02:23:32.005509] [DEBUG] [LOCAL ] TEL: Derivative data saved (1820 records). [2025-09-29T02:23:32.044585] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-29T02:23:32.053719] [INFO ] [MAIN ] Derivative Progress: 1923/2211 symbols completed. TEL took 1.4s. Estimated remaining: 2m 2s. Rate: 141.6 symbols/min [2025-09-29T02:23:32.075272] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:32.361254] [DEBUG] [LOCAL ] TEVA: Loaded 54413 existing records from primary storage. [2025-09-29T02:23:32.362796] [INFO ] [MAIN ] TEVA: Loaded 54413 primary data records. [2025-09-29T02:23:32.591478] [DEBUG] [LOCAL ] TEX: Loaded 45170 existing records from primary storage. [2025-09-29T02:23:32.615274] [INFO ] [MAIN ] TEX: Loaded 45170 primary data records. [2025-09-29T02:23:32.832573] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:32.863968] [INFO ] [MAIN ] TEO: Generated 1820 derivative records from 22345 primary records. [2025-09-29T02:23:32.894164] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-29T02:23:33.183214] [DEBUG] [LOCAL ] TEO: Derivative data saved (1820 records). [2025-09-29T02:23:33.183700] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-29T02:23:33.189089] [INFO ] [MAIN ] Derivative Progress: 1924/2211 symbols completed. TEO took 1.3s. Estimated remaining: 2m 2s. Rate: 141.4 symbols/min [2025-09-29T02:23:33.193299] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:33.225797] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:33.227732] [INFO ] [MAIN ] TEVA: Generated 1820 derivative records from 54413 primary records. [2025-09-29T02:23:33.228077] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-29T02:23:33.251294] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1820 records). [2025-09-29T02:23:33.252694] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-29T02:23:33.257433] [INFO ] [MAIN ] Derivative Progress: 1925/2211 symbols completed. TEVA took 1.4s. Estimated remaining: 2m 1s. Rate: 141.5 symbols/min [2025-09-29T02:23:33.258226] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:33.289701] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:33.290838] [INFO ] [MAIN ] TEX: Generated 1820 derivative records from 45170 primary records. [2025-09-29T02:23:33.291289] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-29T02:23:33.311061] [DEBUG] [LOCAL ] TEX: Derivative data saved (1820 records). [2025-09-29T02:23:33.312357] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-29T02:23:33.333228] [INFO ] [MAIN ] Derivative Progress: 1926/2211 symbols completed. TEX took 1.3s. Estimated remaining: 2m 1s. Rate: 141.5 symbols/min [2025-09-29T02:23:33.333715] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:33.335487] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-29T02:23:33.335988] [INFO ] [MAIN ] TFC: Loaded 54447 primary data records. [2025-09-29T02:23:33.527011] [DEBUG] [LOCAL ] TFII: Loaded 34733 existing records from primary storage. [2025-09-29T02:23:33.555869] [INFO ] [MAIN ] TFII: Loaded 34733 primary data records. [2025-09-29T02:23:33.543429] [DEBUG] [LOCAL ] TFIN: Loaded 23896 existing records from primary storage. [2025-09-29T02:23:33.767195] [INFO ] [MAIN ] TFIN: Loaded 23896 primary data records. [2025-09-29T02:23:34.623984] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:34.624988] [INFO ] [MAIN ] TFC: Generated 1820 derivative records from 54447 primary records. [2025-09-29T02:23:34.625121] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-29T02:23:34.647166] [DEBUG] [LOCAL ] TFC: Derivative data saved (1820 records). [2025-09-29T02:23:34.648294] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-29T02:23:34.651556] [INFO ] [MAIN ] Derivative Progress: 1927/2211 symbols completed. TFC took 1.5s. Estimated remaining: 2m 1s. Rate: 141.4 symbols/min [2025-09-29T02:23:34.654776] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:34.692895] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:34.693326] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:34.695536] [INFO ] [MAIN ] TFIN: Generated 1820 derivative records from 23896 primary records. [2025-09-29T02:23:34.695687] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-29T02:23:34.694775] [INFO ] [MAIN ] TFII: Generated 1820 derivative records from 34733 primary records. [2025-09-29T02:23:34.696252] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-29T02:23:34.732184] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1820 records). [2025-09-29T02:23:34.742140] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-29T02:23:34.747150] [INFO ] [MAIN ] Derivative Progress: 1928/2211 symbols completed. TFIN took 1.4s. Estimated remaining: 2m 0s. Rate: 141.5 symbols/min [2025-09-29T02:23:34.744055] [DEBUG] [LOCAL ] TFII: Derivative data saved (1820 records). [2025-09-29T02:23:34.747606] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:34.747975] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-29T02:23:34.751923] [INFO ] [MAIN ] Derivative Progress: 1929/2211 symbols completed. TFII took 1.5s. Estimated remaining: 1m 60s. Rate: 141.5 symbols/min [2025-09-29T02:23:34.752490] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:34.770430] [DEBUG] [LOCAL ] TFPM: Loaded 37997 existing records from primary storage. [2025-09-29T02:23:34.770861] [INFO ] [MAIN ] TFPM: Loaded 37997 primary data records. [2025-09-29T02:23:34.894491] [DEBUG] [LOCAL ] TG: Loaded 10581 existing records from primary storage. [2025-09-29T02:23:34.935446] [INFO ] [MAIN ] TG: Loaded 10581 primary data records. [2025-09-29T02:23:35.114604] [DEBUG] [LOCAL ] TFX: Loaded 37936 existing records from primary storage. [2025-09-29T02:23:35.207740] [INFO ] [MAIN ] TFX: Loaded 37936 primary data records. [2025-09-29T02:23:36.144262] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:36.145483] [INFO ] [MAIN ] TFPM: Generated 1820 derivative records from 37997 primary records. [2025-09-29T02:23:36.147194] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-29T02:23:36.183849] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:36.185847] [INFO ] [MAIN ] TG: Generated 1820 derivative records from 10581 primary records. [2025-09-29T02:23:36.186512] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-29T02:23:36.189789] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1820 records). [2025-09-29T02:23:36.189900] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-29T02:23:36.208362] [DEBUG] [LOCAL ] TG: Derivative data saved (1820 records). [2025-09-29T02:23:36.207040] [INFO ] [MAIN ] Derivative Progress: 1930/2211 symbols completed. TFPM took 1.6s. Estimated remaining: 1m 59s. Rate: 141.3 symbols/min [2025-09-29T02:23:36.208804] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:36.208668] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-29T02:23:36.211587] [INFO ] [MAIN ] Derivative Progress: 1931/2211 symbols completed. TG took 1.5s. Estimated remaining: 1m 59s. Rate: 141.4 symbols/min [2025-09-29T02:23:36.212765] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:36.234858] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:36.235588] [INFO ] [MAIN ] TFX: Generated 1820 derivative records from 37936 primary records. [2025-09-29T02:23:36.235700] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-29T02:23:36.252934] [DEBUG] [LOCAL ] TFX: Derivative data saved (1820 records). [2025-09-29T02:23:36.253518] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-29T02:23:36.256803] [INFO ] [MAIN ] Derivative Progress: 1932/2211 symbols completed. TFX took 1.5s. Estimated remaining: 1m 58s. Rate: 141.5 symbols/min [2025-09-29T02:23:36.257236] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:36.281368] [DEBUG] [LOCAL ] TGLS: Loaded 28709 existing records from primary storage. [2025-09-29T02:23:36.281748] [INFO ] [MAIN ] TGLS: Loaded 28709 primary data records. [2025-09-29T02:23:36.518631] [DEBUG] [LOCAL ] TGNA: Loaded 49444 existing records from primary storage. [2025-09-29T02:23:36.530063] [DEBUG] [LOCAL ] TGS: Loaded 33072 existing records from primary storage. [2025-09-29T02:23:36.666260] [INFO ] [MAIN ] TGNA: Loaded 49444 primary data records. [2025-09-29T02:23:36.666097] [INFO ] [MAIN ] TGS: Loaded 33072 primary data records. [2025-09-29T02:23:37.443294] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:37.444774] [INFO ] [MAIN ] TGLS: Generated 1820 derivative records from 28709 primary records. [2025-09-29T02:23:37.445117] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-29T02:23:37.464579] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1820 records). [2025-09-29T02:23:37.465311] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-29T02:23:37.467761] [INFO ] [MAIN ] Derivative Progress: 1933/2211 symbols completed. TGLS took 1.3s. Estimated remaining: 1m 58s. Rate: 141.3 symbols/min [2025-09-29T02:23:37.491175] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:37.494869] [INFO ] [MAIN ] TGS: Generated 1820 derivative records from 33072 primary records. [2025-09-29T02:23:37.495455] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-29T02:23:37.518521] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:37.523512] [INFO ] [MAIN ] TGNA: Generated 1820 derivative records from 49444 primary records. [2025-09-29T02:23:37.528304] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-29T02:23:37.528437] [DEBUG] [LOCAL ] TGS: Derivative data saved (1820 records). [2025-09-29T02:23:37.529508] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-29T02:23:37.543016] [INFO ] [MAIN ] Derivative Progress: 1934/2211 symbols completed. TGS took 1.3s. Estimated remaining: 1m 58s. Rate: 141.4 symbols/min [2025-09-29T02:23:37.551922] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1820 records). [2025-09-29T02:23:37.552121] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-29T02:23:37.556430] [INFO ] [MAIN ] Derivative Progress: 1935/2211 symbols completed. TGNA took 1.3s. Estimated remaining: 1m 57s. Rate: 141.5 symbols/min [2025-09-29T02:23:37.557211] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:37.557379] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:37.557571] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:37.594278] [DEBUG] [LOCAL ] THG: Loaded 22081 existing records from primary storage. [2025-09-29T02:23:37.595540] [INFO ] [MAIN ] THG: Loaded 22081 primary data records. [2025-09-29T02:23:37.787494] [DEBUG] [LOCAL ] THC: Loaded 48617 existing records from primary storage. [2025-09-29T02:23:37.853925] [INFO ] [MAIN ] THC: Loaded 48617 primary data records. [2025-09-29T02:23:38.086408] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-29T02:23:38.118156] [INFO ] [MAIN ] TGT: Loaded 54558 primary data records. [2025-09-29T02:23:38.688048] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:38.689736] [INFO ] [MAIN ] THG: Generated 1820 derivative records from 22081 primary records. [2025-09-29T02:23:38.689986] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-29T02:23:38.711048] [DEBUG] [LOCAL ] THG: Derivative data saved (1820 records). [2025-09-29T02:23:38.711446] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-29T02:23:38.716258] [INFO ] [MAIN ] Derivative Progress: 1936/2211 symbols completed. THG took 1.2s. Estimated remaining: 1m 57s. Rate: 141.4 symbols/min [2025-09-29T02:23:38.717976] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:38.736103] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:38.737333] [INFO ] [MAIN ] THC: Generated 1820 derivative records from 48617 primary records. [2025-09-29T02:23:38.737475] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-29T02:23:38.740425] [DEBUG] [LOCAL ] THIR: Loaded 2238 existing records from primary storage. [2025-09-29T02:23:38.742135] [INFO ] [MAIN ] THIR: Loaded 2238 primary data records. [2025-09-29T02:23:38.819985] [DEBUG] [LOCAL ] THC: Derivative data saved (1820 records). [2025-09-29T02:23:38.824904] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-29T02:23:38.860613] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:38.860041] [INFO ] [MAIN ] Derivative Progress: 1937/2211 symbols completed. THC took 1.3s. Estimated remaining: 1m 56s. Rate: 141.4 symbols/min [2025-09-29T02:23:38.861617] [INFO ] [MAIN ] TGT: Generated 1820 derivative records from 54558 primary records. [2025-09-29T02:23:38.861786] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:38.872239] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-29T02:23:38.983022] [DEBUG] [LOCAL ] THLV: Loaded 1614 existing records from primary storage. [2025-09-29T02:23:39.144514] [DEBUG] [LOCAL ] TGT: Derivative data saved (1820 records). [2025-09-29T02:23:39.155351] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-29T02:23:39.155098] [INFO ] [MAIN ] THLV: Loaded 1614 primary data records. [2025-09-29T02:23:39.172315] [INFO ] [MAIN ] Derivative Progress: 1938/2211 symbols completed. TGT took 1.6s. Estimated remaining: 1m 56s. Rate: 141.4 symbols/min [2025-09-29T02:23:39.205090] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:39.574281] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:39.586472] [INFO ] [MAIN ] THIR: Generated 1819 derivative records from 2238 primary records. [2025-09-29T02:23:39.587200] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-29T02:23:39.605339] [DEBUG] [LOCAL ] THIR: Derivative data saved (1819 records). [2025-09-29T02:23:39.605766] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-29T02:23:39.620321] [INFO ] [MAIN ] Derivative Progress: 1939/2211 symbols completed. THIR took 0.9s. Estimated remaining: 1m 55s. Rate: 141.4 symbols/min [2025-09-29T02:23:39.622078] [DEBUG] [LOCAL ] THO: Loaded 42957 existing records from primary storage. [2025-09-29T02:23:39.622621] [INFO ] [MAIN ] THO: Loaded 42957 primary data records. [2025-09-29T02:23:39.620574] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:39.989903] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:23:39.991461] [DEBUG] [LOCAL ] THQ: Loaded 24879 existing records from primary storage. [2025-09-29T02:23:39.993251] [INFO ] [MAIN ] THQ: Loaded 24879 primary data records. [2025-09-29T02:23:39.993131] [INFO ] [MAIN ] THLV: Generated 1818 derivative records from 1614 primary records. [2025-09-29T02:23:39.999621] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-29T02:23:40.104797] [DEBUG] [LOCAL ] THLV: Derivative data saved (1818 records). [2025-09-29T02:23:40.130980] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-29T02:23:40.135984] [INFO ] [MAIN ] Derivative Progress: 1940/2211 symbols completed. THLV took 1.3s. Estimated remaining: 1m 55s. Rate: 141.4 symbols/min [2025-09-29T02:23:40.141537] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:40.369032] [DEBUG] [LOCAL ] THR: Loaded 20218 existing records from primary storage. [2025-09-29T02:23:40.369633] [INFO ] [MAIN ] THR: Loaded 20218 primary data records. [2025-09-29T02:23:40.448866] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:40.477681] [INFO ] [MAIN ] THO: Generated 1820 derivative records from 42957 primary records. [2025-09-29T02:23:40.490715] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-29T02:23:40.541987] [DEBUG] [LOCAL ] THO: Derivative data saved (1820 records). [2025-09-29T02:23:40.584325] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-29T02:23:40.605321] [INFO ] [MAIN ] Derivative Progress: 1941/2211 symbols completed. THO took 1.4s. Estimated remaining: 1m 55s. Rate: 141.4 symbols/min [2025-09-29T02:23:40.739334] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:40.761387] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:40.764144] [INFO ] [MAIN ] THQ: Generated 1820 derivative records from 24879 primary records. [2025-09-29T02:23:40.764595] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-29T02:23:40.784816] [DEBUG] [LOCAL ] THQ: Derivative data saved (1820 records). [2025-09-29T02:23:40.785726] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-29T02:23:40.789113] [INFO ] [MAIN ] Derivative Progress: 1942/2211 symbols completed. THQ took 1.2s. Estimated remaining: 1m 54s. Rate: 141.4 symbols/min [2025-09-29T02:23:40.789530] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:40.819859] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:40.834495] [INFO ] [MAIN ] THR: Generated 1820 derivative records from 20218 primary records. [2025-09-29T02:23:40.834764] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-29T02:23:40.836200] [DEBUG] [LOCAL ] THS: Loaded 38565 existing records from primary storage. [2025-09-29T02:23:40.842174] [INFO ] [MAIN ] THS: Loaded 38565 primary data records. [2025-09-29T02:23:40.943451] [DEBUG] [LOCAL ] THR: Derivative data saved (1820 records). [2025-09-29T02:23:40.949785] [DEBUG] [LOCAL ] THW: Loaded 19392 existing records from primary storage. [2025-09-29T02:23:40.968934] [INFO ] [MAIN ] THW: Loaded 19392 primary data records. [2025-09-29T02:23:40.958326] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-29T02:23:41.028340] [INFO ] [MAIN ] Derivative Progress: 1943/2211 symbols completed. THR took 0.9s. Estimated remaining: 1m 54s. Rate: 141.5 symbols/min [2025-09-29T02:23:41.084887] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:41.629416] [DEBUG] [LOCAL ] TIMB: Loaded 36983 existing records from primary storage. [2025-09-29T02:23:41.629883] [INFO ] [MAIN ] TIMB: Loaded 36983 primary data records. [2025-09-29T02:23:41.770976] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:41.783822] [INFO ] [MAIN ] THS: Generated 1820 derivative records from 38565 primary records. [2025-09-29T02:23:41.795107] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-29T02:23:42.042111] [DEBUG] [LOCAL ] THS: Derivative data saved (1820 records). [2025-09-29T02:23:42.042823] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-29T02:23:42.046775] [INFO ] [MAIN ] Derivative Progress: 1944/2211 symbols completed. THS took 1.3s. Estimated remaining: 1m 53s. Rate: 141.4 symbols/min [2025-09-29T02:23:42.047279] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:42.040542] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:42.048373] [INFO ] [MAIN ] THW: Generated 1820 derivative records from 19392 primary records. [2025-09-29T02:23:42.050825] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-29T02:23:42.070008] [DEBUG] [LOCAL ] TISI: Loaded 3805 existing records from primary storage. [2025-09-29T02:23:42.072360] [DEBUG] [LOCAL ] THW: Derivative data saved (1820 records). [2025-09-29T02:23:42.072454] [INFO ] [MAIN ] TISI: Loaded 3805 primary data records. [2025-09-29T02:23:42.072583] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-29T02:23:42.078297] [INFO ] [MAIN ] Derivative Progress: 1945/2211 symbols completed. THW took 1.3s. Estimated remaining: 1m 53s. Rate: 141.4 symbols/min [2025-09-29T02:23:42.101970] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:42.433983] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:42.445336] [INFO ] [MAIN ] TIMB: Generated 1820 derivative records from 36983 primary records. [2025-09-29T02:23:42.446017] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-29T02:23:42.447828] [DEBUG] [LOCAL ] TIXT: Loaded 31824 existing records from primary storage. [2025-09-29T02:23:42.451306] [INFO ] [MAIN ] TIXT: Loaded 31824 primary data records. [2025-09-29T02:23:42.568341] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1820 records). [2025-09-29T02:23:42.586682] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-29T02:23:42.612817] [INFO ] [MAIN ] Derivative Progress: 1946/2211 symbols completed. TIMB took 1.5s. Estimated remaining: 1m 52s. Rate: 141.4 symbols/min [2025-09-29T02:23:42.676975] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:42.825458] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:42.827364] [INFO ] [MAIN ] TISI: Generated 1820 derivative records from 3805 primary records. [2025-09-29T02:23:42.827709] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-29T02:23:42.847899] [DEBUG] [LOCAL ] TISI: Derivative data saved (1820 records). [2025-09-29T02:23:42.848278] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-29T02:23:42.851063] [INFO ] [MAIN ] Derivative Progress: 1947/2211 symbols completed. TISI took 0.8s. Estimated remaining: 1m 52s. Rate: 141.4 symbols/min [2025-09-29T02:23:42.851312] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:42.870135] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:42.870923] [INFO ] [MAIN ] TIXT: Generated 1820 derivative records from 31824 primary records. [2025-09-29T02:23:42.871042] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-29T02:23:42.903127] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1820 records). [2025-09-29T02:23:42.903403] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-29T02:23:42.906282] [INFO ] [MAIN ] Derivative Progress: 1948/2211 symbols completed. TIXT took 0.8s. Estimated remaining: 1m 52s. Rate: 141.5 symbols/min [2025-09-29T02:23:42.938517] [DEBUG] [LOCAL ] TJX: Loaded 54449 existing records from primary storage. [2025-09-29T02:23:42.938821] [INFO ] [MAIN ] TJX: Loaded 54449 primary data records. [2025-09-29T02:23:43.065201] [DEBUG] [LOCAL ] TK: Loaded 40151 existing records from primary storage. [2025-09-29T02:23:43.071134] [INFO ] [MAIN ] TK: Loaded 40151 primary data records. [2025-09-29T02:23:43.685858] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:43.686872] [INFO ] [MAIN ] TJX: Generated 1820 derivative records from 54449 primary records. [2025-09-29T02:23:43.687076] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-29T02:23:43.705261] [DEBUG] [LOCAL ] TJX: Derivative data saved (1820 records). [2025-09-29T02:23:43.705541] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-29T02:23:43.708277] [INFO ] [MAIN ] Derivative Progress: 1949/2211 symbols completed. TJX took 1.0s. Estimated remaining: 1m 51s. Rate: 141.4 symbols/min [2025-09-29T02:23:43.726515] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:43.727491] [INFO ] [MAIN ] TK: Generated 1820 derivative records from 40151 primary records. [2025-09-29T02:23:43.727611] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-29T02:23:43.743447] [DEBUG] [LOCAL ] TK: Derivative data saved (1820 records). [2025-09-29T02:23:43.743541] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-29T02:23:43.746682] [INFO ] [MAIN ] Derivative Progress: 1950/2211 symbols completed. TK took 0.9s. Estimated remaining: 1m 51s. Rate: 141.5 symbols/min [2025-09-29T02:23:43.747208] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:43.747336] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:43.747999] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:43.802152] [DEBUG] [LOCAL ] TKC: Loaded 39062 existing records from primary storage. [2025-09-29T02:23:43.802532] [INFO ] [MAIN ] TKC: Loaded 39062 primary data records. [2025-09-29T02:23:43.950626] [DEBUG] [LOCAL ] TKR: Loaded 40832 existing records from primary storage. [2025-09-29T02:23:43.980315] [DEBUG] [LOCAL ] TKO: Loaded 44814 existing records from primary storage. [2025-09-29T02:23:44.038372] [INFO ] [MAIN ] TKR: Loaded 40832 primary data records. [2025-09-29T02:23:44.159256] [INFO ] [MAIN ] TKO: Loaded 44814 primary data records. [2025-09-29T02:23:44.875733] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:44.877291] [INFO ] [MAIN ] TKC: Generated 1820 derivative records from 39062 primary records. [2025-09-29T02:23:44.878135] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-29T02:23:44.895614] [DEBUG] [LOCAL ] TKC: Derivative data saved (1820 records). [2025-09-29T02:23:44.897010] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-29T02:23:44.901004] [INFO ] [MAIN ] Derivative Progress: 1951/2211 symbols completed. TKC took 1.2s. Estimated remaining: 1m 50s. Rate: 141.4 symbols/min [2025-09-29T02:23:44.902966] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:44.931319] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:44.932177] [INFO ] [MAIN ] TKO: Generated 1820 derivative records from 44814 primary records. [2025-09-29T02:23:44.932356] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-29T02:23:44.930966] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:44.933069] [INFO ] [MAIN ] TKR: Generated 1820 derivative records from 40832 primary records. [2025-09-29T02:23:44.933267] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-29T02:23:44.964813] [DEBUG] [LOCAL ] TKO: Derivative data saved (1820 records). [2025-09-29T02:23:44.969078] [DEBUG] [LOCAL ] TKR: Derivative data saved (1820 records). [2025-09-29T02:23:44.965845] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-29T02:23:44.972106] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-29T02:23:44.972005] [INFO ] [MAIN ] Derivative Progress: 1952/2211 symbols completed. TKO took 1.2s. Estimated remaining: 1m 50s. Rate: 141.4 symbols/min [2025-09-29T02:23:44.975351] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:44.975520] [INFO ] [MAIN ] Derivative Progress: 1953/2211 symbols completed. TKR took 1.2s. Estimated remaining: 1m 49s. Rate: 141.5 symbols/min [2025-09-29T02:23:44.975924] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:45.012515] [DEBUG] [LOCAL ] TLK: Loaded 39925 existing records from primary storage. [2025-09-29T02:23:45.013036] [INFO ] [MAIN ] TLK: Loaded 39925 primary data records. [2025-09-29T02:23:45.064863] [DEBUG] [LOCAL ] TLYS: Loaded 17064 existing records from primary storage. [2025-09-29T02:23:45.091621] [INFO ] [MAIN ] TLYS: Loaded 17064 primary data records. [2025-09-29T02:23:45.292249] [DEBUG] [LOCAL ] TM: Loaded 36992 existing records from primary storage. [2025-09-29T02:23:45.331721] [INFO ] [MAIN ] TM: Loaded 36992 primary data records. [2025-09-29T02:23:46.140012] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:46.143075] [INFO ] [MAIN ] TLK: Generated 1820 derivative records from 39925 primary records. [2025-09-29T02:23:46.144121] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-29T02:23:46.167758] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:46.176566] [INFO ] [MAIN ] TLYS: Generated 1820 derivative records from 17064 primary records. [2025-09-29T02:23:46.178224] [DEBUG] [LOCAL ] TLK: Derivative data saved (1820 records). [2025-09-29T02:23:46.178496] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-29T02:23:46.178708] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-29T02:23:46.181347] [INFO ] [MAIN ] Derivative Progress: 1954/2211 symbols completed. TLK took 1.3s. Estimated remaining: 1m 49s. Rate: 141.4 symbols/min [2025-09-29T02:23:46.182808] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:46.201086] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1820 records). [2025-09-29T02:23:46.202958] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-29T02:23:46.206149] [INFO ] [MAIN ] Derivative Progress: 1955/2211 symbols completed. TLYS took 1.2s. Estimated remaining: 1m 49s. Rate: 141.5 symbols/min [2025-09-29T02:23:46.206577] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:46.221263] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:46.222464] [INFO ] [MAIN ] TM: Generated 1820 derivative records from 36992 primary records. [2025-09-29T02:23:46.222729] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-29T02:23:46.245928] [DEBUG] [LOCAL ] TM: Derivative data saved (1820 records). [2025-09-29T02:23:46.246125] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-29T02:23:46.249861] [INFO ] [MAIN ] Derivative Progress: 1956/2211 symbols completed. TM took 1.3s. Estimated remaining: 1m 48s. Rate: 141.5 symbols/min [2025-09-29T02:23:46.250261] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:46.296515] [DEBUG] [LOCAL ] TME: Loaded 53979 existing records from primary storage. [2025-09-29T02:23:46.296867] [INFO ] [MAIN ] TME: Loaded 53979 primary data records. [2025-09-29T02:23:46.513314] [DEBUG] [LOCAL ] TMHC: Loaded 46274 existing records from primary storage. [2025-09-29T02:23:46.691120] [INFO ] [MAIN ] TMHC: Loaded 46274 primary data records. [2025-09-29T02:23:46.759799] [DEBUG] [LOCAL ] TMO: Loaded 53089 existing records from primary storage. [2025-09-29T02:23:46.799152] [INFO ] [MAIN ] TMO: Loaded 53089 primary data records. [2025-09-29T02:23:47.437712] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:47.438896] [INFO ] [MAIN ] TME: Generated 1820 derivative records from 53979 primary records. [2025-09-29T02:23:47.440746] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-29T02:23:47.460966] [DEBUG] [LOCAL ] TME: Derivative data saved (1820 records). [2025-09-29T02:23:47.461603] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-29T02:23:47.466992] [INFO ] [MAIN ] Derivative Progress: 1957/2211 symbols completed. TME took 1.3s. Estimated remaining: 1m 48s. Rate: 141.4 symbols/min [2025-09-29T02:23:47.467700] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:47.496318] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:47.497410] [INFO ] [MAIN ] TMHC: Generated 1820 derivative records from 46274 primary records. [2025-09-29T02:23:47.497531] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-29T02:23:47.523528] [DEBUG] [LOCAL ] TNC: Loaded 15334 existing records from primary storage. [2025-09-29T02:23:47.539193] [INFO ] [MAIN ] TNC: Loaded 15334 primary data records. [2025-09-29T02:23:47.546747] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:47.540499] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1820 records). [2025-09-29T02:23:47.565556] [INFO ] [MAIN ] TMO: Generated 1820 derivative records from 53089 primary records. [2025-09-29T02:23:47.578755] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-29T02:23:47.607092] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-29T02:23:47.619941] [INFO ] [MAIN ] Derivative Progress: 1958/2211 symbols completed. TMHC took 1.4s. Estimated remaining: 1m 47s. Rate: 141.4 symbols/min [2025-09-29T02:23:47.661675] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:47.726124] [DEBUG] [LOCAL ] TMO: Derivative data saved (1820 records). [2025-09-29T02:23:47.769975] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-29T02:23:47.890539] [INFO ] [MAIN ] Derivative Progress: 1959/2211 symbols completed. TMO took 1.6s. Estimated remaining: 1m 47s. Rate: 141.5 symbols/min [2025-09-29T02:23:47.901602] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:47.952468] [DEBUG] [LOCAL ] TNET: Loaded 29247 existing records from primary storage. [2025-09-29T02:23:47.966328] [INFO ] [MAIN ] TNET: Loaded 29247 primary data records. [2025-09-29T02:23:47.966911] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:47.984207] [INFO ] [MAIN ] TNC: Generated 1820 derivative records from 15334 primary records. [2025-09-29T02:23:47.997544] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-29T02:23:48.089942] [DEBUG] [LOCAL ] TNK: Loaded 35701 existing records from primary storage. [2025-09-29T02:23:48.112704] [DEBUG] [LOCAL ] TNC: Derivative data saved (1820 records). [2025-09-29T02:23:48.113250] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-29T02:23:48.113128] [INFO ] [MAIN ] TNK: Loaded 35701 primary data records. [2025-09-29T02:23:48.120775] [INFO ] [MAIN ] Derivative Progress: 1960/2211 symbols completed. TNC took 0.7s. Estimated remaining: 1m 46s. Rate: 141.5 symbols/min [2025-09-29T02:23:48.133407] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:48.760330] [DEBUG] [LOCAL ] TNL: Loaded 42474 existing records from primary storage. [2025-09-29T02:23:48.761725] [INFO ] [MAIN ] TNL: Loaded 42474 primary data records. [2025-09-29T02:23:48.898453] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:48.899404] [INFO ] [MAIN ] TNET: Generated 1820 derivative records from 29247 primary records. [2025-09-29T02:23:48.899776] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-29T02:23:49.131959] [DEBUG] [LOCAL ] TNET: Derivative data saved (1820 records). [2025-09-29T02:23:49.132587] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-29T02:23:49.150312] [INFO ] [MAIN ] Derivative Progress: 1961/2211 symbols completed. TNET took 1.5s. Estimated remaining: 1m 46s. Rate: 141.4 symbols/min [2025-09-29T02:23:49.151260] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:49.151092] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:49.152346] [INFO ] [MAIN ] TNK: Generated 1820 derivative records from 35701 primary records. [2025-09-29T02:23:49.153046] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-29T02:23:49.174069] [DEBUG] [LOCAL ] TNK: Derivative data saved (1820 records). [2025-09-29T02:23:49.174308] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-29T02:23:49.177549] [INFO ] [MAIN ] Derivative Progress: 1962/2211 symbols completed. TNK took 1.3s. Estimated remaining: 1m 46s. Rate: 141.5 symbols/min [2025-09-29T02:23:49.178026] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:49.203833] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:49.204851] [INFO ] [MAIN ] TNL: Generated 1820 derivative records from 42474 primary records. [2025-09-29T02:23:49.204942] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-29T02:23:49.236884] [DEBUG] [LOCAL ] TNL: Derivative data saved (1820 records). [2025-09-29T02:23:49.237058] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-29T02:23:49.241126] [INFO ] [MAIN ] Derivative Progress: 1963/2211 symbols completed. TNL took 1.1s. Estimated remaining: 1m 45s. Rate: 141.5 symbols/min [2025-09-29T02:23:49.278971] [DEBUG] [LOCAL ] TOL: Loaded 51738 existing records from primary storage. [2025-09-29T02:23:49.295392] [INFO ] [MAIN ] TOL: Loaded 51738 primary data records. [2025-09-29T02:23:49.337028] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-29T02:23:49.377738] [INFO ] [MAIN ] TOST: Loaded 54461 primary data records. [2025-09-29T02:23:49.998117] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:50.001358] [INFO ] [MAIN ] TOL: Generated 1820 derivative records from 51738 primary records. [2025-09-29T02:23:50.001735] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-29T02:23:50.025195] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:50.031425] [INFO ] [MAIN ] TOST: Generated 1820 derivative records from 54461 primary records. [2025-09-29T02:23:50.032713] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-29T02:23:50.033671] [DEBUG] [LOCAL ] TOL: Derivative data saved (1820 records). [2025-09-29T02:23:50.034242] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-29T02:23:50.036843] [INFO ] [MAIN ] Derivative Progress: 1964/2211 symbols completed. TOL took 0.9s. Estimated remaining: 1m 45s. Rate: 141.4 symbols/min [2025-09-29T02:23:50.053101] [DEBUG] [LOCAL ] TOST: Derivative data saved (1820 records). [2025-09-29T02:23:50.053204] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-29T02:23:50.056486] [INFO ] [MAIN ] Derivative Progress: 1965/2211 symbols completed. TOST took 0.9s. Estimated remaining: 1m 44s. Rate: 141.5 symbols/min [2025-09-29T02:23:50.057158] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:50.057219] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:50.057066] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:50.091666] [DEBUG] [LOCAL ] TPB: Loaded 25409 existing records from primary storage. [2025-09-29T02:23:50.102047] [INFO ] [MAIN ] TPB: Loaded 25409 primary data records. [2025-09-29T02:23:50.242080] [DEBUG] [LOCAL ] TPC: Loaded 39311 existing records from primary storage. [2025-09-29T02:23:50.258917] [DEBUG] [LOCAL ] TPH: Loaded 45821 existing records from primary storage. [2025-09-29T02:23:50.263748] [INFO ] [MAIN ] TPC: Loaded 39311 primary data records. [2025-09-29T02:23:50.263609] [INFO ] [MAIN ] TPH: Loaded 45821 primary data records. [2025-09-29T02:23:51.267285] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:51.270157] [INFO ] [MAIN ] TPB: Generated 1820 derivative records from 25409 primary records. [2025-09-29T02:23:51.270995] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-29T02:23:51.291973] [DEBUG] [LOCAL ] TPB: Derivative data saved (1820 records). [2025-09-29T02:23:51.293055] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-29T02:23:51.309177] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:51.308246] [INFO ] [MAIN ] Derivative Progress: 1966/2211 symbols completed. TPB took 1.3s. Estimated remaining: 1m 44s. Rate: 141.4 symbols/min [2025-09-29T02:23:51.309595] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:51.310432] [INFO ] [MAIN ] TPC: Generated 1820 derivative records from 39311 primary records. [2025-09-29T02:23:51.311081] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-29T02:23:51.330059] [DEBUG] [LOCAL ] TPC: Derivative data saved (1820 records). [2025-09-29T02:23:51.330598] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-29T02:23:51.334733] [INFO ] [MAIN ] Derivative Progress: 1967/2211 symbols completed. TPC took 1.3s. Estimated remaining: 1m 44s. Rate: 141.4 symbols/min [2025-09-29T02:23:51.335233] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:51.357461] [DEBUG] [LOCAL ] TPL: Loaded 12533 existing records from primary storage. [2025-09-29T02:23:51.363404] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:51.363485] [INFO ] [MAIN ] TPL: Loaded 12533 primary data records. [2025-09-29T02:23:51.364326] [INFO ] [MAIN ] TPH: Generated 1820 derivative records from 45821 primary records. [2025-09-29T02:23:51.397908] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-29T02:23:51.516982] [DEBUG] [LOCAL ] TPH: Derivative data saved (1820 records). [2025-09-29T02:23:51.548105] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-29T02:23:51.714205] [INFO ] [MAIN ] Derivative Progress: 1968/2211 symbols completed. TPH took 1.7s. Estimated remaining: 1m 43s. Rate: 141.5 symbols/min [2025-09-29T02:23:51.729282] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:51.769628] [DEBUG] [LOCAL ] TPR: Loaded 54252 existing records from primary storage. [2025-09-29T02:23:51.771057] [INFO ] [MAIN ] TPR: Loaded 54252 primary data records. [2025-09-29T02:23:51.896990] [DEBUG] [LOCAL ] TPVG: Loaded 27400 existing records from primary storage. [2025-09-29T02:23:51.918033] [INFO ] [MAIN ] TPVG: Loaded 27400 primary data records. [2025-09-29T02:23:52.272831] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:52.284496] [INFO ] [MAIN ] TPL: Generated 1820 derivative records from 12533 primary records. [2025-09-29T02:23:52.284920] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-29T02:23:52.594074] [DEBUG] [LOCAL ] TPL: Derivative data saved (1820 records). [2025-09-29T02:23:52.594486] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-29T02:23:52.597490] [INFO ] [MAIN ] Derivative Progress: 1969/2211 symbols completed. TPL took 1.3s. Estimated remaining: 1m 43s. Rate: 141.4 symbols/min [2025-09-29T02:23:52.597705] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:52.613466] [DEBUG] [LOCAL ] TPYP: Loaded 8039 existing records from primary storage. [2025-09-29T02:23:52.615339] [INFO ] [MAIN ] TPYP: Loaded 8039 primary data records. [2025-09-29T02:23:52.756352] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:52.778089] [INFO ] [MAIN ] TPR: Generated 1820 derivative records from 54252 primary records. [2025-09-29T02:23:52.778587] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-29T02:23:53.001502] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:53.004822] [INFO ] [MAIN ] TPVG: Generated 1820 derivative records from 27400 primary records. [2025-09-29T02:23:53.005837] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-29T02:23:53.011303] [DEBUG] [LOCAL ] TPR: Derivative data saved (1820 records). [2025-09-29T02:23:53.011673] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-29T02:23:53.015918] [INFO ] [MAIN ] Derivative Progress: 1970/2211 symbols completed. TPR took 1.7s. Estimated remaining: 1m 42s. Rate: 141.4 symbols/min [2025-09-29T02:23:53.016239] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:53.038868] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1820 records). [2025-09-29T02:23:53.042927] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-29T02:23:53.042691] [DEBUG] [LOCAL ] TPZ: Loaded 5095 existing records from primary storage. [2025-09-29T02:23:53.045946] [INFO ] [MAIN ] TPZ: Loaded 5095 primary data records. [2025-09-29T02:23:53.045876] [INFO ] [MAIN ] Derivative Progress: 1971/2211 symbols completed. TPVG took 1.3s. Estimated remaining: 1m 42s. Rate: 141.4 symbols/min [2025-09-29T02:23:53.070231] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:53.410913] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:53.409967] [DEBUG] [LOCAL ] TR: Loaded 18494 existing records from primary storage. [2025-09-29T02:23:53.413362] [INFO ] [MAIN ] TPYP: Generated 1820 derivative records from 8039 primary records. [2025-09-29T02:23:53.413490] [INFO ] [MAIN ] TR: Loaded 18494 primary data records. [2025-09-29T02:23:53.413864] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-29T02:23:53.604990] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1820 records). [2025-09-29T02:23:53.621515] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-29T02:23:53.641912] [INFO ] [MAIN ] Derivative Progress: 1972/2211 symbols completed. TPYP took 1.0s. Estimated remaining: 1m 41s. Rate: 141.4 symbols/min [2025-09-29T02:23:53.679963] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:53.837501] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:53.838573] [INFO ] [MAIN ] TPZ: Generated 1819 derivative records from 5095 primary records. [2025-09-29T02:23:53.839334] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-29T02:23:53.844556] [DEBUG] [LOCAL ] TRAK: Loaded 9383 existing records from primary storage. [2025-09-29T02:23:53.847201] [INFO ] [MAIN ] TRAK: Loaded 9383 primary data records. [2025-09-29T02:23:53.916320] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1819 records). [2025-09-29T02:23:53.977212] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-29T02:23:53.984287] [INFO ] [MAIN ] Derivative Progress: 1973/2211 symbols completed. TPZ took 1.0s. Estimated remaining: 1m 41s. Rate: 141.4 symbols/min [2025-09-29T02:23:53.995366] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:54.225572] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:54.234853] [DEBUG] [LOCAL ] TRC: Loaded 16189 existing records from primary storage. [2025-09-29T02:23:54.236222] [INFO ] [MAIN ] TR: Generated 1820 derivative records from 18494 primary records. [2025-09-29T02:23:54.236779] [INFO ] [MAIN ] TRC: Loaded 16189 primary data records. [2025-09-29T02:23:54.237029] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-29T02:23:54.368548] [DEBUG] [LOCAL ] TR: Derivative data saved (1820 records). [2025-09-29T02:23:54.383892] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-29T02:23:54.397961] [INFO ] [MAIN ] Derivative Progress: 1974/2211 symbols completed. TR took 1.3s. Estimated remaining: 1m 41s. Rate: 141.4 symbols/min [2025-09-29T02:23:54.403560] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:54.638740] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:54.639824] [INFO ] [MAIN ] TRAK: Generated 1820 derivative records from 9383 primary records. [2025-09-29T02:23:54.640018] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-29T02:23:54.660123] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1820 records). [2025-09-29T02:23:54.660513] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-29T02:23:54.663464] [INFO ] [MAIN ] Derivative Progress: 1975/2211 symbols completed. TRAK took 1.0s. Estimated remaining: 1m 40s. Rate: 141.5 symbols/min [2025-09-29T02:23:54.664113] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:54.725472] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:54.725032] [DEBUG] [LOCAL ] TREX: Loaded 50733 existing records from primary storage. [2025-09-29T02:23:54.725817] [INFO ] [MAIN ] TREX: Loaded 50733 primary data records. [2025-09-29T02:23:54.726872] [INFO ] [MAIN ] TRC: Generated 1820 derivative records from 16189 primary records. [2025-09-29T02:23:54.739398] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-29T02:23:54.945895] [DEBUG] [LOCAL ] TRC: Derivative data saved (1820 records). [2025-09-29T02:23:55.002686] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-29T02:23:55.028432] [DEBUG] [LOCAL ] TRGP: Loaded 51504 existing records from primary storage. [2025-09-29T02:23:55.147549] [INFO ] [MAIN ] TRGP: Loaded 51504 primary data records. [2025-09-29T02:23:55.150400] [INFO ] [MAIN ] Derivative Progress: 1976/2211 symbols completed. TRC took 1.2s. Estimated remaining: 1m 40s. Rate: 141.4 symbols/min [2025-09-29T02:23:55.167037] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:55.567376] [DEBUG] [LOCAL ] TRN: Loaded 37786 existing records from primary storage. [2025-09-29T02:23:55.568061] [INFO ] [MAIN ] TRN: Loaded 37786 primary data records. [2025-09-29T02:23:55.706429] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:55.719018] [INFO ] [MAIN ] TREX: Generated 1820 derivative records from 50733 primary records. [2025-09-29T02:23:55.739897] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-29T02:23:55.943722] [DEBUG] [LOCAL ] TREX: Derivative data saved (1820 records). [2025-09-29T02:23:55.944066] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-29T02:23:55.947503] [INFO ] [MAIN ] Derivative Progress: 1977/2211 symbols completed. TREX took 1.5s. Estimated remaining: 1m 39s. Rate: 141.4 symbols/min [2025-09-29T02:23:55.948001] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:55.973301] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:55.974290] [INFO ] [MAIN ] TRGP: Generated 1820 derivative records from 51504 primary records. [2025-09-29T02:23:55.974545] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-29T02:23:55.995079] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1820 records). [2025-09-29T02:23:56.006521] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-29T02:23:56.010871] [INFO ] [MAIN ] Derivative Progress: 1978/2211 symbols completed. TRGP took 1.3s. Estimated remaining: 1m 39s. Rate: 141.4 symbols/min [2025-09-29T02:23:56.031191] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:56.032211] [INFO ] [MAIN ] TRN: Generated 1820 derivative records from 37786 primary records. [2025-09-29T02:23:56.045109] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-29T02:23:56.047046] [DEBUG] [LOCAL ] TRNO: Loaded 44598 existing records from primary storage. [2025-09-29T02:23:56.054825] [INFO ] [MAIN ] TRNO: Loaded 44598 primary data records. [2025-09-29T02:23:56.124755] [DEBUG] [LOCAL ] TRN: Derivative data saved (1820 records). [2025-09-29T02:23:56.158548] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-29T02:23:56.188287] [INFO ] [MAIN ] Derivative Progress: 1979/2211 symbols completed. TRN took 1.0s. Estimated remaining: 1m 38s. Rate: 141.5 symbols/min [2025-09-29T02:23:56.406054] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:56.406885] [INFO ] [MAIN ] TRNO: Generated 1820 derivative records from 44598 primary records. [2025-09-29T02:23:56.406976] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-29T02:23:56.422846] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1820 records). [2025-09-29T02:23:56.422944] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-29T02:23:56.425572] [INFO ] [MAIN ] Derivative Progress: 1980/2211 symbols completed. TRNO took 0.5s. Estimated remaining: 1m 38s. Rate: 141.5 symbols/min [2025-09-29T02:23:56.426059] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:56.426204] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:56.426695] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:56.513298] [DEBUG] [LOCAL ] TRTX: Loaded 38058 existing records from primary storage. [2025-09-29T02:23:56.513726] [INFO ] [MAIN ] TRTX: Loaded 38058 primary data records. [2025-09-29T02:23:56.515402] [DEBUG] [LOCAL ] TROX: Loaded 52550 existing records from primary storage. [2025-09-29T02:23:56.528719] [INFO ] [MAIN ] TROX: Loaded 52550 primary data records. [2025-09-29T02:23:56.845583] [DEBUG] [LOCAL ] TRP: Loaded 52891 existing records from primary storage. [2025-09-29T02:23:56.875907] [INFO ] [MAIN ] TRP: Loaded 52891 primary data records. [2025-09-29T02:23:57.658404] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:57.660467] [INFO ] [MAIN ] TRTX: Generated 1820 derivative records from 38058 primary records. [2025-09-29T02:23:57.661090] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-29T02:23:57.690809] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1820 records). [2025-09-29T02:23:57.697035] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:57.698452] [INFO ] [MAIN ] TROX: Generated 1820 derivative records from 52550 primary records. [2025-09-29T02:23:57.697236] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-29T02:23:57.701246] [INFO ] [MAIN ] Derivative Progress: 1981/2211 symbols completed. TRTX took 1.3s. Estimated remaining: 1m 38s. Rate: 141.4 symbols/min [2025-09-29T02:23:57.701467] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:57.701905] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-29T02:23:57.720430] [DEBUG] [LOCAL ] TROX: Derivative data saved (1820 records). [2025-09-29T02:23:57.720610] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-29T02:23:57.723250] [INFO ] [MAIN ] Derivative Progress: 1982/2211 symbols completed. TROX took 1.3s. Estimated remaining: 1m 37s. Rate: 141.4 symbols/min [2025-09-29T02:23:57.723843] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:57.742376] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:57.743585] [INFO ] [MAIN ] TRP: Generated 1820 derivative records from 52891 primary records. [2025-09-29T02:23:57.743843] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-29T02:23:57.763365] [DEBUG] [LOCAL ] TRP: Derivative data saved (1820 records). [2025-09-29T02:23:57.763556] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-29T02:23:57.768114] [INFO ] [MAIN ] Derivative Progress: 1983/2211 symbols completed. TRP took 1.3s. Estimated remaining: 1m 37s. Rate: 141.5 symbols/min [2025-09-29T02:23:57.768633] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:57.821548] [DEBUG] [LOCAL ] TRU: Loaded 51965 existing records from primary storage. [2025-09-29T02:23:57.823222] [INFO ] [MAIN ] TRU: Loaded 51965 primary data records. [2025-09-29T02:23:57.873602] [DEBUG] [LOCAL ] TRV: Loaded 48744 existing records from primary storage. [2025-09-29T02:23:57.886591] [INFO ] [MAIN ] TRV: Loaded 48744 primary data records. [2025-09-29T02:23:58.152762] [DEBUG] [LOCAL ] TS: Loaded 52425 existing records from primary storage. [2025-09-29T02:23:58.181404] [INFO ] [MAIN ] TS: Loaded 52425 primary data records. [2025-09-29T02:23:58.932762] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:58.932481] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:58.933700] [INFO ] [MAIN ] TRV: Generated 1820 derivative records from 48744 primary records. [2025-09-29T02:23:58.934345] [INFO ] [MAIN ] TRU: Generated 1819 derivative records from 51965 primary records. [2025-09-29T02:23:58.935991] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-29T02:23:58.934971] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-29T02:23:58.967579] [DEBUG] [LOCAL ] TRU: Derivative data saved (1819 records). [2025-09-29T02:23:58.968969] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-29T02:23:58.971870] [INFO ] [MAIN ] Derivative Progress: 1984/2211 symbols completed. TRU took 1.3s. Estimated remaining: 1m 36s. Rate: 141.4 symbols/min [2025-09-29T02:23:58.976100] [DEBUG] [LOCAL ] TRV: Derivative data saved (1820 records). [2025-09-29T02:23:58.974886] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:58.976687] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-29T02:23:58.980882] [INFO ] [MAIN ] Derivative Progress: 1985/2211 symbols completed. TRV took 1.3s. Estimated remaining: 1m 36s. Rate: 141.4 symbols/min [2025-09-29T02:23:58.981390] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:58.999789] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:59.000674] [INFO ] [MAIN ] TS: Generated 1820 derivative records from 52425 primary records. [2025-09-29T02:23:59.000843] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-29T02:23:59.020156] [DEBUG] [LOCAL ] TS: Derivative data saved (1820 records). [2025-09-29T02:23:59.020421] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-29T02:23:59.024564] [INFO ] [MAIN ] Derivative Progress: 1986/2211 symbols completed. TS took 1.3s. Estimated remaining: 1m 35s. Rate: 141.5 symbols/min [2025-09-29T02:23:59.037547] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:59.038349] [DEBUG] [LOCAL ] TSI: Loaded 8090 existing records from primary storage. [2025-09-29T02:23:59.039555] [INFO ] [MAIN ] TSI: Loaded 8090 primary data records. [2025-09-29T02:23:59.171785] [DEBUG] [LOCAL ] TSE: Loaded 29074 existing records from primary storage. [2025-09-29T02:23:59.184551] [INFO ] [MAIN ] TSE: Loaded 29074 primary data records. [2025-09-29T02:23:59.560566] [DEBUG] [LOCAL ] TSLX: Loaded 35752 existing records from primary storage. [2025-09-29T02:23:59.588763] [INFO ] [MAIN ] TSLX: Loaded 35752 primary data records. [2025-09-29T02:24:00.142078] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:00.144829] [INFO ] [MAIN ] TSI: Generated 1820 derivative records from 8090 primary records. [2025-09-29T02:24:00.145420] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-29T02:24:00.167880] [DEBUG] [LOCAL ] TSI: Derivative data saved (1820 records). [2025-09-29T02:24:00.181830] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-29T02:24:00.185687] [INFO ] [MAIN ] Derivative Progress: 1987/2211 symbols completed. TSI took 1.2s. Estimated remaining: 1m 35s. Rate: 141.4 symbols/min [2025-09-29T02:24:00.186616] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:00.188361] [INFO ] [MAIN ] TSE: Generated 1820 derivative records from 29074 primary records. [2025-09-29T02:24:00.187255] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:00.188855] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-29T02:24:00.209099] [DEBUG] [LOCAL ] TSE: Derivative data saved (1820 records). [2025-09-29T02:24:00.211856] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-29T02:24:00.217586] [INFO ] [MAIN ] Derivative Progress: 1988/2211 symbols completed. TSE took 1.2s. Estimated remaining: 1m 35s. Rate: 141.4 symbols/min [2025-09-29T02:24:00.218172] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:00.235054] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:00.236353] [INFO ] [MAIN ] TSLX: Generated 1820 derivative records from 35752 primary records. [2025-09-29T02:24:00.236694] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-29T02:24:00.254950] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1820 records). [2025-09-29T02:24:00.255254] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-29T02:24:00.259364] [INFO ] [MAIN ] Derivative Progress: 1989/2211 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 34s. Rate: 141.5 symbols/min [2025-09-29T02:24:00.259777] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:00.292599] [DEBUG] [LOCAL ] TSQ: Loaded 12195 existing records from primary storage. [2025-09-29T02:24:00.292956] [INFO ] [MAIN ] TSQ: Loaded 12195 primary data records. [2025-09-29T02:24:00.482285] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-29T02:24:00.489071] [INFO ] [MAIN ] TSM: Loaded 54599 primary data records. [2025-09-29T02:24:00.551286] [DEBUG] [LOCAL ] TSN: Loaded 53638 existing records from primary storage. [2025-09-29T02:24:00.712082] [INFO ] [MAIN ] TSN: Loaded 53638 primary data records. [2025-09-29T02:24:01.441514] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:01.443423] [INFO ] [MAIN ] TSQ: Generated 1820 derivative records from 12195 primary records. [2025-09-29T02:24:01.443755] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-29T02:24:01.462508] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1820 records). [2025-09-29T02:24:01.462985] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-29T02:24:01.466364] [INFO ] [MAIN ] Derivative Progress: 1990/2211 symbols completed. TSQ took 1.2s. Estimated remaining: 1m 34s. Rate: 141.4 symbols/min [2025-09-29T02:24:01.466788] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:01.485467] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:01.486380] [INFO ] [MAIN ] TSM: Generated 1820 derivative records from 54599 primary records. [2025-09-29T02:24:01.486549] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-29T02:24:01.519573] [DEBUG] [LOCAL ] TSM: Derivative data saved (1820 records). [2025-09-29T02:24:01.525276] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:01.525687] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-29T02:24:01.531776] [INFO ] [MAIN ] Derivative Progress: 1991/2211 symbols completed. TSM took 1.3s. Estimated remaining: 1m 33s. Rate: 141.4 symbols/min [2025-09-29T02:24:01.527298] [INFO ] [MAIN ] TSN: Generated 1820 derivative records from 53638 primary records. [2025-09-29T02:24:01.532248] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:01.532965] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-29T02:24:01.553621] [DEBUG] [LOCAL ] TSN: Derivative data saved (1820 records). [2025-09-29T02:24:01.553818] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-29T02:24:01.558621] [INFO ] [MAIN ] Derivative Progress: 1992/2211 symbols completed. TSN took 1.3s. Estimated remaining: 1m 33s. Rate: 141.5 symbols/min [2025-09-29T02:24:01.559248] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:01.616966] [DEBUG] [LOCAL ] TT: Loaded 48538 existing records from primary storage. [2025-09-29T02:24:01.617211] [INFO ] [MAIN ] TT: Loaded 48538 primary data records. [2025-09-29T02:24:01.761538] [DEBUG] [LOCAL ] TTC: Loaded 43005 existing records from primary storage. [2025-09-29T02:24:01.787937] [INFO ] [MAIN ] TTC: Loaded 43005 primary data records. [2025-09-29T02:24:01.888112] [DEBUG] [LOCAL ] TTE: Loaded 52395 existing records from primary storage. [2025-09-29T02:24:01.966736] [INFO ] [MAIN ] TTE: Loaded 52395 primary data records. [2025-09-29T02:24:02.804246] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:24:02.805181] [INFO ] [MAIN ] TT: Generated 1819 derivative records from 48538 primary records. [2025-09-29T02:24:02.805294] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-29T02:24:02.825613] [DEBUG] [LOCAL ] TT: Derivative data saved (1819 records). [2025-09-29T02:24:02.827792] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-29T02:24:02.832095] [INFO ] [MAIN ] Derivative Progress: 1993/2211 symbols completed. TT took 1.4s. Estimated remaining: 1m 33s. Rate: 141.4 symbols/min [2025-09-29T02:24:02.849454] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:02.850451] [INFO ] [MAIN ] TTC: Generated 1820 derivative records from 43005 primary records. [2025-09-29T02:24:02.850775] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-29T02:24:02.868051] [DEBUG] [LOCAL ] TTC: Derivative data saved (1820 records). [2025-09-29T02:24:02.868333] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-29T02:24:02.872083] [INFO ] [MAIN ] Derivative Progress: 1994/2211 symbols completed. TTC took 1.3s. Estimated remaining: 1m 32s. Rate: 141.4 symbols/min [2025-09-29T02:24:02.890475] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:02.891719] [INFO ] [MAIN ] TTE: Generated 1820 derivative records from 52395 primary records. [2025-09-29T02:24:02.891812] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-29T02:24:02.909286] [DEBUG] [LOCAL ] TTE: Derivative data saved (1820 records). [2025-09-29T02:24:02.909405] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-29T02:24:02.913701] [INFO ] [MAIN ] Derivative Progress: 1995/2211 symbols completed. TTE took 1.4s. Estimated remaining: 1m 32s. Rate: 141.5 symbols/min [2025-09-29T02:24:02.914234] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:02.914398] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:02.914700] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:02.998042] [DEBUG] [LOCAL ] TU: Loaded 50606 existing records from primary storage. [2025-09-29T02:24:03.025170] [INFO ] [MAIN ] TU: Loaded 50606 primary data records. [2025-09-29T02:24:03.066342] [DEBUG] [LOCAL ] TUYA: Loaded 47185 existing records from primary storage. [2025-09-29T02:24:03.087399] [INFO ] [MAIN ] TUYA: Loaded 47185 primary data records. [2025-09-29T02:24:03.074439] [DEBUG] [LOCAL ] TTI: Loaded 46112 existing records from primary storage. [2025-09-29T02:24:03.132339] [INFO ] [MAIN ] TTI: Loaded 46112 primary data records. [2025-09-29T02:24:04.172062] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:04.172903] [INFO ] [MAIN ] TU: Generated 1820 derivative records from 50606 primary records. [2025-09-29T02:24:04.173260] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-29T02:24:04.192947] [DEBUG] [LOCAL ] TU: Derivative data saved (1820 records). [2025-09-29T02:24:04.197130] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-29T02:24:04.199669] [INFO ] [MAIN ] Derivative Progress: 1996/2211 symbols completed. TU took 1.3s. Estimated remaining: 1m 31s. Rate: 141.4 symbols/min [2025-09-29T02:24:04.213521] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:04.216628] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:04.218050] [INFO ] [MAIN ] TUYA: Generated 1820 derivative records from 47185 primary records. [2025-09-29T02:24:04.231734] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:04.231185] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-29T02:24:04.232563] [INFO ] [MAIN ] TTI: Generated 1820 derivative records from 46112 primary records. [2025-09-29T02:24:04.233140] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-29T02:24:04.264872] [DEBUG] [LOCAL ] TTI: Derivative data saved (1820 records). [2025-09-29T02:24:04.266929] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-29T02:24:04.272836] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1820 records). [2025-09-29T02:24:04.271355] [INFO ] [MAIN ] Derivative Progress: 1997/2211 symbols completed. TTI took 1.4s. Estimated remaining: 1m 31s. Rate: 141.4 symbols/min [2025-09-29T02:24:04.272969] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-29T02:24:04.276355] [INFO ] [MAIN ] Derivative Progress: 1998/2211 symbols completed. TUYA took 1.4s. Estimated remaining: 1m 30s. Rate: 141.5 symbols/min [2025-09-29T02:24:04.273408] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:04.276999] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:04.295996] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-29T02:24:04.296328] [INFO ] [MAIN ] TVE: Loaded 2795 primary data records. [2025-09-29T02:24:04.311929] [DEBUG] [LOCAL ] TVC: Loaded 3466 existing records from primary storage. [2025-09-29T02:24:04.362713] [INFO ] [MAIN ] TVC: Loaded 3466 primary data records. [2025-09-29T02:24:04.424512] [DEBUG] [LOCAL ] TV: Loaded 43514 existing records from primary storage. [2025-09-29T02:24:04.531007] [INFO ] [MAIN ] TV: Loaded 43514 primary data records. [2025-09-29T02:24:05.406618] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:05.411846] [INFO ] [MAIN ] TVE: Generated 1820 derivative records from 2795 primary records. [2025-09-29T02:24:05.425883] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-29T02:24:05.426229] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-29T02:24:05.428038] [INFO ] [MAIN ] TVC: Generated 1817 derivative records from 3466 primary records. [2025-09-29T02:24:05.428836] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-29T02:24:05.458215] [DEBUG] [LOCAL ] TVE: Derivative data saved (1820 records). [2025-09-29T02:24:05.461820] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-29T02:24:05.466351] [INFO ] [MAIN ] Derivative Progress: 1999/2211 symbols completed. TVE took 1.2s. Estimated remaining: 1m 30s. Rate: 141.4 symbols/min [2025-09-29T02:24:05.462754] [DEBUG] [LOCAL ] TVC: Derivative data saved (1817 records). [2025-09-29T02:24:05.466659] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:05.467389] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-29T02:24:05.471673] [INFO ] [MAIN ] Derivative Progress: 2000/2211 symbols completed. TVC took 1.2s. Estimated remaining: 1m 30s. Rate: 141.4 symbols/min [2025-09-29T02:24:05.473921] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:05.493942] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:05.495508] [INFO ] [MAIN ] TV: Generated 1820 derivative records from 43514 primary records. [2025-09-29T02:24:05.495710] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-29T02:24:05.516765] [DEBUG] [LOCAL ] TV: Derivative data saved (1820 records). [2025-09-29T02:24:05.517030] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-29T02:24:05.519815] [INFO ] [MAIN ] Derivative Progress: 2001/2211 symbols completed. TV took 1.3s. Estimated remaining: 1m 29s. Rate: 141.5 symbols/min [2025-09-29T02:24:05.530739] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:05.537115] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-29T02:24:05.537348] [INFO ] [MAIN ] TWN: Loaded 3250 primary data records. [2025-09-29T02:24:05.649497] [DEBUG] [LOCAL ] TWI: Loaded 34981 existing records from primary storage. [2025-09-29T02:24:05.677794] [INFO ] [MAIN ] TWI: Loaded 34981 primary data records. [2025-09-29T02:24:06.034239] [DEBUG] [LOCAL ] TWLO: Loaded 53501 existing records from primary storage. [2025-09-29T02:24:06.071091] [INFO ] [MAIN ] TWLO: Loaded 53501 primary data records. [2025-09-29T02:24:06.687790] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:06.690057] [INFO ] [MAIN ] TWN: Generated 1820 derivative records from 3250 primary records. [2025-09-29T02:24:06.690759] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-29T02:24:06.719721] [DEBUG] [LOCAL ] TWN: Derivative data saved (1820 records). [2025-09-29T02:24:06.734386] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:06.734503] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-29T02:24:06.735496] [INFO ] [MAIN ] TWI: Generated 1820 derivative records from 34981 primary records. [2025-09-29T02:24:06.738743] [INFO ] [MAIN ] Derivative Progress: 2002/2211 symbols completed. TWN took 1.2s. Estimated remaining: 1m 29s. Rate: 141.4 symbols/min [2025-09-29T02:24:06.739368] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-29T02:24:06.740323] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:06.763874] [DEBUG] [LOCAL ] TWI: Derivative data saved (1820 records). [2025-09-29T02:24:06.777234] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:06.777297] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-29T02:24:06.781135] [INFO ] [MAIN ] Derivative Progress: 2003/2211 symbols completed. TWI took 1.3s. Estimated remaining: 1m 28s. Rate: 141.4 symbols/min [2025-09-29T02:24:06.778239] [INFO ] [MAIN ] TWLO: Generated 1820 derivative records from 53501 primary records. [2025-09-29T02:24:06.781506] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-29T02:24:06.781605] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:06.800325] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1820 records). [2025-09-29T02:24:06.800491] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-29T02:24:06.803920] [INFO ] [MAIN ] Derivative Progress: 2004/2211 symbols completed. TWLO took 1.3s. Estimated remaining: 1m 28s. Rate: 141.5 symbols/min [2025-09-29T02:24:06.804245] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:06.835841] [DEBUG] [LOCAL ] TX: Loaded 23932 existing records from primary storage. [2025-09-29T02:24:06.836057] [INFO ] [MAIN ] TX: Loaded 23932 primary data records. [2025-09-29T02:24:06.947825] [DEBUG] [LOCAL ] TWO: Loaded 49002 existing records from primary storage. [2025-09-29T02:24:06.984633] [INFO ] [MAIN ] TWO: Loaded 49002 primary data records. [2025-09-29T02:24:07.192681] [DEBUG] [LOCAL ] TXNM: Loaded 44463 existing records from primary storage. [2025-09-29T02:24:07.343831] [INFO ] [MAIN ] TXNM: Loaded 44463 primary data records. [2025-09-29T02:24:07.956783] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:07.958342] [INFO ] [MAIN ] TX: Generated 1820 derivative records from 23932 primary records. [2025-09-29T02:24:07.958885] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-29T02:24:07.981987] [DEBUG] [LOCAL ] TX: Derivative data saved (1820 records). [2025-09-29T02:24:07.983074] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-29T02:24:07.985427] [INFO ] [MAIN ] Derivative Progress: 2005/2211 symbols completed. TX took 1.2s. Estimated remaining: 1m 27s. Rate: 141.4 symbols/min [2025-09-29T02:24:07.985855] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:08.000469] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:08.001638] [INFO ] [MAIN ] TWO: Generated 1820 derivative records from 49002 primary records. [2025-09-29T02:24:08.002015] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-29T02:24:08.027937] [DEBUG] [LOCAL ] TWO: Derivative data saved (1820 records). [2025-09-29T02:24:08.028170] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-29T02:24:08.031108] [INFO ] [MAIN ] Derivative Progress: 2006/2211 symbols completed. TWO took 1.3s. Estimated remaining: 1m 27s. Rate: 141.4 symbols/min [2025-09-29T02:24:08.031558] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:08.054063] [DEBUG] [LOCAL ] TXO: Loaded 19060 existing records from primary storage. [2025-09-29T02:24:08.054767] [INFO ] [MAIN ] TXO: Loaded 19060 primary data records. [2025-09-29T02:24:08.054462] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:08.106515] [INFO ] [MAIN ] TXNM: Generated 1820 derivative records from 44463 primary records. [2025-09-29T02:24:08.121683] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-29T02:24:08.197385] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1820 records). [2025-09-29T02:24:08.219085] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-29T02:24:08.270638] [INFO ] [MAIN ] Derivative Progress: 2007/2211 symbols completed. TXNM took 1.5s. Estimated remaining: 1m 27s. Rate: 141.4 symbols/min [2025-09-29T02:24:08.280407] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:08.486342] [DEBUG] [LOCAL ] TXT: Loaded 50470 existing records from primary storage. [2025-09-29T02:24:08.491337] [DEBUG] [LOCAL ] TY: Loaded 7756 existing records from primary storage. [2025-09-29T02:24:08.491585] [INFO ] [MAIN ] TXT: Loaded 50470 primary data records. [2025-09-29T02:24:08.491828] [INFO ] [MAIN ] TY: Loaded 7756 primary data records. [2025-09-29T02:24:09.223254] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:09.224164] [INFO ] [MAIN ] TXO: Generated 1820 derivative records from 19060 primary records. [2025-09-29T02:24:09.225102] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-29T02:24:09.247488] [DEBUG] [LOCAL ] TXO: Derivative data saved (1820 records). [2025-09-29T02:24:09.248997] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-29T02:24:09.251554] [INFO ] [MAIN ] Derivative Progress: 2008/2211 symbols completed. TXO took 1.3s. Estimated remaining: 1m 26s. Rate: 141.4 symbols/min [2025-09-29T02:24:09.289621] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:09.289272] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:09.291076] [INFO ] [MAIN ] TXT: Generated 1820 derivative records from 50470 primary records. [2025-09-29T02:24:09.290460] [INFO ] [MAIN ] TY: Generated 1820 derivative records from 7756 primary records. [2025-09-29T02:24:09.291262] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-29T02:24:09.291290] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-29T02:24:09.321484] [DEBUG] [LOCAL ] TXT: Derivative data saved (1820 records). [2025-09-29T02:24:09.322906] [DEBUG] [LOCAL ] TY: Derivative data saved (1820 records). [2025-09-29T02:24:09.323083] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-29T02:24:09.325831] [INFO ] [MAIN ] Derivative Progress: 2009/2211 symbols completed. TY took 1.0s. Estimated remaining: 1m 26s. Rate: 141.4 symbols/min [2025-09-29T02:24:09.325955] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-29T02:24:09.330484] [INFO ] [MAIN ] Derivative Progress: 2010/2211 symbols completed. TXT took 1.3s. Estimated remaining: 1m 25s. Rate: 141.5 symbols/min [2025-09-29T02:24:09.331061] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:09.331156] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:09.331221] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:09.359264] [DEBUG] [LOCAL ] TYG: Loaded 14410 existing records from primary storage. [2025-09-29T02:24:09.359466] [INFO ] [MAIN ] TYG: Loaded 14410 primary data records. [2025-09-29T02:24:09.420221] [DEBUG] [LOCAL ] TYL: Loaded 22582 existing records from primary storage. [2025-09-29T02:24:09.432934] [INFO ] [MAIN ] TYL: Loaded 22582 primary data records. [2025-09-29T02:24:09.749563] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-29T02:24:09.928816] [INFO ] [MAIN ] U: Loaded 54579 primary data records. [2025-09-29T02:24:10.534114] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:10.535182] [INFO ] [MAIN ] TYG: Generated 1820 derivative records from 14410 primary records. [2025-09-29T02:24:10.535704] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-29T02:24:10.565993] [DEBUG] [LOCAL ] TYG: Derivative data saved (1820 records). [2025-09-29T02:24:10.571495] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-29T02:24:10.574338] [INFO ] [MAIN ] Derivative Progress: 2011/2211 symbols completed. TYG took 1.2s. Estimated remaining: 1m 25s. Rate: 141.3 symbols/min [2025-09-29T02:24:10.575126] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:10.571969] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:10.577359] [INFO ] [MAIN ] TYL: Generated 1820 derivative records from 22582 primary records. [2025-09-29T02:24:10.577798] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-29T02:24:10.597722] [DEBUG] [LOCAL ] TYL: Derivative data saved (1820 records). [2025-09-29T02:24:10.598011] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-29T02:24:10.602484] [INFO ] [MAIN ] Derivative Progress: 2012/2211 symbols completed. TYL took 1.3s. Estimated remaining: 1m 24s. Rate: 141.4 symbols/min [2025-09-29T02:24:10.603134] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:10.625376] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:10.627052] [INFO ] [MAIN ] U: Generated 1820 derivative records from 54579 primary records. [2025-09-29T02:24:10.627145] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-29T02:24:10.645606] [DEBUG] [LOCAL ] U: Derivative data saved (1820 records). [2025-09-29T02:24:10.659996] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-29T02:24:10.664445] [INFO ] [MAIN ] Derivative Progress: 2013/2211 symbols completed. U took 1.3s. Estimated remaining: 1m 24s. Rate: 141.5 symbols/min [2025-09-29T02:24:10.664805] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:10.688061] [DEBUG] [LOCAL ] UA: Loaded 51189 existing records from primary storage. [2025-09-29T02:24:10.688284] [INFO ] [MAIN ] UA: Loaded 51189 primary data records. [2025-09-29T02:24:10.714527] [DEBUG] [LOCAL ] UAN: Loaded 5507 existing records from primary storage. [2025-09-29T02:24:10.775419] [INFO ] [MAIN ] UAN: Loaded 5507 primary data records. [2025-09-29T02:24:10.997246] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-09-29T02:24:11.045233] [INFO ] [MAIN ] UAA: Loaded 54287 primary data records. [2025-09-29T02:24:11.785270] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:11.787481] [INFO ] [MAIN ] UA: Generated 1820 derivative records from 51189 primary records. [2025-09-29T02:24:11.788037] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-29T02:24:11.813136] [DEBUG] [LOCAL ] UA: Derivative data saved (1820 records). [2025-09-29T02:24:11.813954] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-29T02:24:11.817205] [INFO ] [MAIN ] Derivative Progress: 2014/2211 symbols completed. UA took 1.2s. Estimated remaining: 1m 24s. Rate: 141.4 symbols/min [2025-09-29T02:24:11.818325] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:11.834507] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:11.835939] [INFO ] [MAIN ] UAN: Generated 1820 derivative records from 5507 primary records. [2025-09-29T02:24:11.836262] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-29T02:24:11.855783] [DEBUG] [LOCAL ] UAN: Derivative data saved (1820 records). [2025-09-29T02:24:11.855966] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-29T02:24:11.861276] [INFO ] [MAIN ] Derivative Progress: 2015/2211 symbols completed. UAN took 1.2s. Estimated remaining: 1m 23s. Rate: 141.4 symbols/min [2025-09-29T02:24:11.862471] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:11.879010] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:11.879953] [INFO ] [MAIN ] UAA: Generated 1820 derivative records from 54287 primary records. [2025-09-29T02:24:11.880089] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-29T02:24:11.898524] [DEBUG] [LOCAL ] UAA: Derivative data saved (1820 records). [2025-09-29T02:24:11.898695] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-29T02:24:11.903627] [INFO ] [MAIN ] Derivative Progress: 2016/2211 symbols completed. UAA took 1.3s. Estimated remaining: 1m 23s. Rate: 141.5 symbols/min [2025-09-29T02:24:11.904023] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:11.951397] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-29T02:24:11.951933] [INFO ] [MAIN ] UBER: Loaded 54586 primary data records. [2025-09-29T02:24:12.147970] [DEBUG] [LOCAL ] UCB: Loaded 38555 existing records from primary storage. [2025-09-29T02:24:12.190261] [DEBUG] [LOCAL ] UBS: Loaded 53187 existing records from primary storage. [2025-09-29T02:24:12.193575] [INFO ] [MAIN ] UBS: Loaded 53187 primary data records. [2025-09-29T02:24:12.213368] [INFO ] [MAIN ] UCB: Loaded 38555 primary data records. [2025-09-29T02:24:13.148474] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:13.151630] [INFO ] [MAIN ] UBER: Generated 1820 derivative records from 54586 primary records. [2025-09-29T02:24:13.151813] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-29T02:24:13.172856] [DEBUG] [LOCAL ] UBER: Derivative data saved (1820 records). [2025-09-29T02:24:13.174458] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-29T02:24:13.177429] [INFO ] [MAIN ] Derivative Progress: 2017/2211 symbols completed. UBER took 1.4s. Estimated remaining: 1m 22s. Rate: 141.3 symbols/min [2025-09-29T02:24:13.177826] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:13.199850] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:13.203288] [INFO ] [MAIN ] UBS: Generated 1820 derivative records from 53187 primary records. [2025-09-29T02:24:13.203611] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-29T02:24:13.218688] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:13.219742] [INFO ] [MAIN ] UCB: Generated 1820 derivative records from 38555 primary records. [2025-09-29T02:24:13.219894] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-29T02:24:13.255511] [DEBUG] [LOCAL ] UCB: Derivative data saved (1820 records). [2025-09-29T02:24:13.258118] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-29T02:24:13.261914] [INFO ] [MAIN ] Derivative Progress: 2018/2211 symbols completed. UCB took 1.4s. Estimated remaining: 1m 22s. Rate: 141.4 symbols/min [2025-09-29T02:24:13.257694] [DEBUG] [LOCAL ] UBS: Derivative data saved (1820 records). [2025-09-29T02:24:13.262315] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:13.262679] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-29T02:24:13.267934] [INFO ] [MAIN ] Derivative Progress: 2019/2211 symbols completed. UBS took 1.4s. Estimated remaining: 1m 21s. Rate: 141.5 symbols/min [2025-09-29T02:24:13.268862] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:13.298863] [DEBUG] [LOCAL ] UFI: Loaded 8229 existing records from primary storage. [2025-09-29T02:24:13.299734] [INFO ] [MAIN ] UFI: Loaded 8229 primary data records. [2025-09-29T02:24:13.437983] [DEBUG] [LOCAL ] UDR: Loaded 52555 existing records from primary storage. [2025-09-29T02:24:13.443596] [INFO ] [MAIN ] UDR: Loaded 52555 primary data records. [2025-09-29T02:24:13.855827] [DEBUG] [LOCAL ] UE: Loaded 43513 existing records from primary storage. [2025-09-29T02:24:13.878785] [INFO ] [MAIN ] UE: Loaded 43513 primary data records. [2025-09-29T02:24:14.440545] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:14.441907] [INFO ] [MAIN ] UFI: Generated 1820 derivative records from 8229 primary records. [2025-09-29T02:24:14.442014] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-29T02:24:14.479976] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:14.480117] [DEBUG] [LOCAL ] UFI: Derivative data saved (1820 records). [2025-09-29T02:24:14.481348] [INFO ] [MAIN ] UDR: Generated 1820 derivative records from 52555 primary records. [2025-09-29T02:24:14.481605] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-29T02:24:14.482097] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-29T02:24:14.488181] [INFO ] [MAIN ] Derivative Progress: 2020/2211 symbols completed. UFI took 1.2s. Estimated remaining: 1m 21s. Rate: 141.3 symbols/min [2025-09-29T02:24:14.501254] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:14.506625] [DEBUG] [LOCAL ] UDR: Derivative data saved (1820 records). [2025-09-29T02:24:14.507908] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-29T02:24:14.513977] [INFO ] [MAIN ] Derivative Progress: 2021/2211 symbols completed. UDR took 1.3s. Estimated remaining: 1m 21s. Rate: 141.4 symbols/min [2025-09-29T02:24:14.514385] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:14.537156] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:14.538092] [INFO ] [MAIN ] UE: Generated 1820 derivative records from 43513 primary records. [2025-09-29T02:24:14.539178] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-29T02:24:14.559460] [DEBUG] [LOCAL ] UE: Derivative data saved (1820 records). [2025-09-29T02:24:14.559831] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-29T02:24:14.564708] [INFO ] [MAIN ] Derivative Progress: 2022/2211 symbols completed. UE took 1.3s. Estimated remaining: 1m 20s. Rate: 141.5 symbols/min [2025-09-29T02:24:14.565162] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:14.623709] [DEBUG] [LOCAL ] UGP: Loaded 43319 existing records from primary storage. [2025-09-29T02:24:14.624217] [INFO ] [MAIN ] UGP: Loaded 43319 primary data records. [2025-09-29T02:24:14.672463] [DEBUG] [LOCAL ] UHAL: Loaded 16817 existing records from primary storage. [2025-09-29T02:24:14.696432] [INFO ] [MAIN ] UHAL: Loaded 16817 primary data records. [2025-09-29T02:24:14.758838] [DEBUG] [LOCAL ] UGI: Loaded 51290 existing records from primary storage. [2025-09-29T02:24:14.805368] [INFO ] [MAIN ] UGI: Loaded 51290 primary data records. [2025-09-29T02:24:15.787033] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:15.789276] [INFO ] [MAIN ] UGP: Generated 1820 derivative records from 43319 primary records. [2025-09-29T02:24:15.789911] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-29T02:24:15.808278] [DEBUG] [LOCAL ] UGP: Derivative data saved (1820 records). [2025-09-29T02:24:15.809121] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-29T02:24:15.812330] [INFO ] [MAIN ] Derivative Progress: 2023/2211 symbols completed. UGP took 1.3s. Estimated remaining: 1m 20s. Rate: 141.3 symbols/min [2025-09-29T02:24:15.844509] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:15.844811] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:15.845702] [INFO ] [MAIN ] UHAL: Generated 1820 derivative records from 16817 primary records. [2025-09-29T02:24:15.846282] [INFO ] [MAIN ] UGI: Generated 1820 derivative records from 51290 primary records. [2025-09-29T02:24:15.846430] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-29T02:24:15.846854] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-29T02:24:15.876689] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1820 records). [2025-09-29T02:24:15.879935] [DEBUG] [LOCAL ] UGI: Derivative data saved (1820 records). [2025-09-29T02:24:15.880062] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-29T02:24:15.880279] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-29T02:24:15.884945] [INFO ] [MAIN ] Derivative Progress: 2024/2211 symbols completed. UHAL took 1.3s. Estimated remaining: 1m 19s. Rate: 141.4 symbols/min [2025-09-29T02:24:15.890173] [INFO ] [MAIN ] Derivative Progress: 2025/2211 symbols completed. UGI took 1.4s. Estimated remaining: 1m 19s. Rate: 141.5 symbols/min [2025-09-29T02:24:15.890979] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:15.890914] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:15.890806] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:15.915340] [DEBUG] [LOCAL ] UHT: Loaded 10131 existing records from primary storage. [2025-09-29T02:24:15.921523] [INFO ] [MAIN ] UHT: Loaded 10131 primary data records. [2025-09-29T02:24:15.921366] [DEBUG] [LOCAL ] UI: Loaded 13008 existing records from primary storage. [2025-09-29T02:24:15.927048] [INFO ] [MAIN ] UI: Loaded 13008 primary data records. [2025-09-29T02:24:16.184419] [DEBUG] [LOCAL ] UHS: Loaded 41674 existing records from primary storage. [2025-09-29T02:24:16.222502] [INFO ] [MAIN ] UHS: Loaded 41674 primary data records. [2025-09-29T02:24:17.028720] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:17.029743] [INFO ] [MAIN ] UHT: Generated 1820 derivative records from 10131 primary records. [2025-09-29T02:24:17.032189] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-29T02:24:17.067682] [DEBUG] [LOCAL ] UHT: Derivative data saved (1820 records). [2025-09-29T02:24:17.068072] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-29T02:24:17.065313] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:17.070608] [INFO ] [MAIN ] Derivative Progress: 2026/2211 symbols completed. UHT took 1.2s. Estimated remaining: 1m 19s. Rate: 141.3 symbols/min [2025-09-29T02:24:17.072762] [INFO ] [MAIN ] UI: Generated 1820 derivative records from 13008 primary records. [2025-09-29T02:24:17.073055] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:17.073144] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-29T02:24:17.117534] [DEBUG] [LOCAL ] UI: Derivative data saved (1820 records). [2025-09-29T02:24:17.118466] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-29T02:24:17.118123] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:17.122288] [INFO ] [MAIN ] Derivative Progress: 2027/2211 symbols completed. UI took 1.2s. Estimated remaining: 1m 18s. Rate: 141.4 symbols/min [2025-09-29T02:24:17.123503] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:17.123281] [INFO ] [MAIN ] UHS: Generated 1820 derivative records from 41674 primary records. [2025-09-29T02:24:17.124369] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-29T02:24:17.159818] [DEBUG] [LOCAL ] UHS: Derivative data saved (1820 records). [2025-09-29T02:24:17.160120] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-29T02:24:17.163266] [INFO ] [MAIN ] Derivative Progress: 2028/2211 symbols completed. UHS took 1.3s. Estimated remaining: 1m 18s. Rate: 141.5 symbols/min [2025-09-29T02:24:17.164700] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:17.177896] [DEBUG] [LOCAL ] UIS: Loaded 37552 existing records from primary storage. [2025-09-29T02:24:17.178092] [INFO ] [MAIN ] UIS: Loaded 37552 primary data records. [2025-09-29T02:24:17.600924] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-09-29T02:24:17.603143] [INFO ] [MAIN ] UL: Loaded 53843 primary data records. [2025-09-29T02:24:17.604393] [DEBUG] [LOCAL ] ULS: Loaded 39769 existing records from primary storage. [2025-09-29T02:24:17.645909] [INFO ] [MAIN ] ULS: Loaded 39769 primary data records. [2025-09-29T02:24:18.341209] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:18.343087] [INFO ] [MAIN ] UIS: Generated 1820 derivative records from 37552 primary records. [2025-09-29T02:24:18.343672] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-29T02:24:18.363149] [DEBUG] [LOCAL ] UIS: Derivative data saved (1820 records). [2025-09-29T02:24:18.363918] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-29T02:24:18.368248] [INFO ] [MAIN ] Derivative Progress: 2029/2211 symbols completed. UIS took 1.3s. Estimated remaining: 1m 17s. Rate: 141.3 symbols/min [2025-09-29T02:24:18.371550] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:18.388210] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:18.389060] [INFO ] [MAIN ] UL: Generated 1820 derivative records from 53843 primary records. [2025-09-29T02:24:18.389785] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-29T02:24:18.410319] [DEBUG] [LOCAL ] UL: Derivative data saved (1820 records). [2025-09-29T02:24:18.423897] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-29T02:24:18.424179] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:18.425812] [INFO ] [MAIN ] ULS: Generated 1820 derivative records from 39769 primary records. [2025-09-29T02:24:18.429049] [INFO ] [MAIN ] Derivative Progress: 2030/2211 symbols completed. UL took 1.3s. Estimated remaining: 1m 17s. Rate: 141.4 symbols/min [2025-09-29T02:24:18.429748] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:18.429906] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-29T02:24:18.453848] [DEBUG] [LOCAL ] ULS: Derivative data saved (1820 records). [2025-09-29T02:24:18.454078] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-29T02:24:18.457208] [INFO ] [MAIN ] Derivative Progress: 2031/2211 symbols completed. ULS took 1.3s. Estimated remaining: 1m 16s. Rate: 141.4 symbols/min [2025-09-29T02:24:18.457787] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:18.494491] [DEBUG] [LOCAL ] UNF: Loaded 12048 existing records from primary storage. [2025-09-29T02:24:18.510088] [INFO ] [MAIN ] UNF: Loaded 12048 primary data records. [2025-09-29T02:24:18.532231] [DEBUG] [LOCAL ] UMC: Loaded 53490 existing records from primary storage. [2025-09-29T02:24:18.560769] [INFO ] [MAIN ] UMC: Loaded 53490 primary data records. [2025-09-29T02:24:18.709624] [DEBUG] [LOCAL ] UMH: Loaded 34078 existing records from primary storage. [2025-09-29T02:24:18.759713] [INFO ] [MAIN ] UMH: Loaded 34078 primary data records. [2025-09-29T02:24:19.647737] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:19.649924] [INFO ] [MAIN ] UNF: Generated 1820 derivative records from 12048 primary records. [2025-09-29T02:24:19.650183] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-29T02:24:19.687247] [DEBUG] [LOCAL ] UNF: Derivative data saved (1820 records). [2025-09-29T02:24:19.688035] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-29T02:24:19.687965] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:19.689416] [INFO ] [MAIN ] UMC: Generated 1820 derivative records from 53490 primary records. [2025-09-29T02:24:19.689693] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-29T02:24:19.692497] [INFO ] [MAIN ] Derivative Progress: 2032/2211 symbols completed. UNF took 1.2s. Estimated remaining: 1m 16s. Rate: 141.3 symbols/min [2025-09-29T02:24:19.694152] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:19.715270] [DEBUG] [LOCAL ] UMC: Derivative data saved (1820 records). [2025-09-29T02:24:19.728123] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-29T02:24:19.732398] [INFO ] [MAIN ] Derivative Progress: 2033/2211 symbols completed. UMC took 1.4s. Estimated remaining: 1m 16s. Rate: 141.4 symbols/min [2025-09-29T02:24:19.732897] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:19.733152] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:19.734322] [INFO ] [MAIN ] UMH: Generated 1820 derivative records from 34078 primary records. [2025-09-29T02:24:19.734733] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-29T02:24:19.754736] [DEBUG] [LOCAL ] UMH: Derivative data saved (1820 records). [2025-09-29T02:24:19.764872] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-29T02:24:19.767894] [INFO ] [MAIN ] Derivative Progress: 2034/2211 symbols completed. UMH took 1.3s. Estimated remaining: 1m 15s. Rate: 141.4 symbols/min [2025-09-29T02:24:19.768359] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:19.787516] [DEBUG] [LOCAL ] UNFI: Loaded 42528 existing records from primary storage. [2025-09-29T02:24:19.787954] [INFO ] [MAIN ] UNFI: Loaded 42528 primary data records. [2025-09-29T02:24:20.199580] [DEBUG] [LOCAL ] UNH: Loaded 54574 existing records from primary storage. [2025-09-29T02:24:20.200010] [INFO ] [MAIN ] UNH: Loaded 54574 primary data records. [2025-09-29T02:24:20.201324] [DEBUG] [LOCAL ] UNM: Loaded 49368 existing records from primary storage. [2025-09-29T02:24:20.215169] [INFO ] [MAIN ] UNM: Loaded 49368 primary data records. [2025-09-29T02:24:20.941950] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:20.943978] [INFO ] [MAIN ] UNFI: Generated 1820 derivative records from 42528 primary records. [2025-09-29T02:24:20.944615] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-29T02:24:20.966279] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1820 records). [2025-09-29T02:24:20.966519] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-29T02:24:20.969440] [INFO ] [MAIN ] Derivative Progress: 2035/2211 symbols completed. UNFI took 1.3s. Estimated remaining: 1m 15s. Rate: 141.3 symbols/min [2025-09-29T02:24:20.969914] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:20.992897] [DEBUG] [LOCAL ] UNMA: Loaded 3627 existing records from primary storage. [2025-09-29T02:24:20.995250] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:20.995325] [INFO ] [MAIN ] UNMA: Loaded 3627 primary data records. [2025-09-29T02:24:20.997125] [INFO ] [MAIN ] UNH: Generated 1820 derivative records from 54574 primary records. [2025-09-29T02:24:20.997387] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-29T02:24:21.097389] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:21.121948] [INFO ] [MAIN ] UNM: Generated 1820 derivative records from 49368 primary records. [2025-09-29T02:24:21.144525] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-29T02:24:21.244372] [DEBUG] [LOCAL ] UNH: Derivative data saved (1820 records). [2025-09-29T02:24:21.278690] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-29T02:24:21.347672] [INFO ] [MAIN ] Derivative Progress: 2036/2211 symbols completed. UNH took 1.6s. Estimated remaining: 1m 14s. Rate: 141.3 symbols/min [2025-09-29T02:24:21.365508] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:21.382319] [DEBUG] [LOCAL ] UNM: Derivative data saved (1820 records). [2025-09-29T02:24:21.382481] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-29T02:24:21.385835] [INFO ] [MAIN ] Derivative Progress: 2037/2211 symbols completed. UNM took 1.6s. Estimated remaining: 1m 14s. Rate: 141.4 symbols/min [2025-09-29T02:24:21.386155] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:21.416682] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:21.417711] [INFO ] [MAIN ] UNMA: Generated 1820 derivative records from 3627 primary records. [2025-09-29T02:24:21.417969] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-29T02:24:21.447523] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1820 records). [2025-09-29T02:24:21.447793] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-29T02:24:21.450374] [INFO ] [MAIN ] Derivative Progress: 2038/2211 symbols completed. UNMA took 0.5s. Estimated remaining: 1m 13s. Rate: 141.4 symbols/min [2025-09-29T02:24:21.481701] [DEBUG] [LOCAL ] UP: Loaded 43857 existing records from primary storage. [2025-09-29T02:24:21.481955] [INFO ] [MAIN ] UP: Loaded 43857 primary data records. [2025-09-29T02:24:21.629722] [DEBUG] [LOCAL ] UNP: Loaded 54030 existing records from primary storage. [2025-09-29T02:24:21.645296] [INFO ] [MAIN ] UNP: Loaded 54030 primary data records. [2025-09-29T02:24:22.217116] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:22.218094] [INFO ] [MAIN ] UP: Generated 1820 derivative records from 43857 primary records. [2025-09-29T02:24:22.218307] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-29T02:24:22.237967] [DEBUG] [LOCAL ] UP: Derivative data saved (1820 records). [2025-09-29T02:24:22.238337] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-29T02:24:22.240696] [INFO ] [MAIN ] Derivative Progress: 2039/2211 symbols completed. UP took 0.9s. Estimated remaining: 1m 13s. Rate: 141.4 symbols/min [2025-09-29T02:24:22.253580] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:22.254268] [INFO ] [MAIN ] UNP: Generated 1820 derivative records from 54030 primary records. [2025-09-29T02:24:22.254370] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-29T02:24:22.270734] [DEBUG] [LOCAL ] UNP: Derivative data saved (1820 records). [2025-09-29T02:24:22.270849] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-29T02:24:22.274214] [INFO ] [MAIN ] Derivative Progress: 2040/2211 symbols completed. UNP took 0.9s. Estimated remaining: 1m 13s. Rate: 141.4 symbols/min [2025-09-29T02:24:22.274703] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:22.274791] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:22.275033] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:22.349481] [DEBUG] [LOCAL ] USA: Loaded 36524 existing records from primary storage. [2025-09-29T02:24:22.351226] [INFO ] [MAIN ] USA: Loaded 36524 primary data records. [2025-09-29T02:24:22.385130] [DEBUG] [LOCAL ] URI: Loaded 36669 existing records from primary storage. [2025-09-29T02:24:22.448181] [INFO ] [MAIN ] URI: Loaded 36669 primary data records. [2025-09-29T02:24:22.508355] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-29T02:24:22.531688] [INFO ] [MAIN ] UPS: Loaded 54490 primary data records. [2025-09-29T02:24:23.422907] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:23.423752] [INFO ] [MAIN ] USA: Generated 1820 derivative records from 36524 primary records. [2025-09-29T02:24:23.423967] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-29T02:24:23.446177] [DEBUG] [LOCAL ] USA: Derivative data saved (1820 records). [2025-09-29T02:24:23.446667] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-29T02:24:23.462062] [INFO ] [MAIN ] Derivative Progress: 2041/2211 symbols completed. USA took 1.2s. Estimated remaining: 1m 12s. Rate: 141.3 symbols/min [2025-09-29T02:24:23.459828] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:23.475371] [INFO ] [MAIN ] URI: Generated 1820 derivative records from 36669 primary records. [2025-09-29T02:24:23.475887] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:23.476020] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:23.476996] [INFO ] [MAIN ] UPS: Generated 1820 derivative records from 54490 primary records. [2025-09-29T02:24:23.476269] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-29T02:24:23.477435] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-29T02:24:23.510381] [DEBUG] [LOCAL ] UPS: Derivative data saved (1820 records). [2025-09-29T02:24:23.511500] [DEBUG] [LOCAL ] URI: Derivative data saved (1820 records). [2025-09-29T02:24:23.511778] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-29T02:24:23.515290] [INFO ] [MAIN ] Derivative Progress: 2042/2211 symbols completed. UPS took 1.2s. Estimated remaining: 1m 12s. Rate: 141.4 symbols/min [2025-09-29T02:24:23.515568] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:23.515782] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-29T02:24:23.519544] [INFO ] [MAIN ] Derivative Progress: 2043/2211 symbols completed. URI took 1.2s. Estimated remaining: 1m 11s. Rate: 141.5 symbols/min [2025-09-29T02:24:23.520027] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:23.543130] [DEBUG] [LOCAL ] USAC: Loaded 23060 existing records from primary storage. [2025-09-29T02:24:23.543354] [INFO ] [MAIN ] USAC: Loaded 23060 primary data records. [2025-09-29T02:24:23.958371] [DEBUG] [LOCAL ] USFD: Loaded 51959 existing records from primary storage. [2025-09-29T02:24:23.959406] [INFO ] [MAIN ] USFD: Loaded 51959 primary data records. [2025-09-29T02:24:23.994361] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-29T02:24:24.023945] [INFO ] [MAIN ] USB: Loaded 54468 primary data records. [2025-09-29T02:24:24.705513] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:24.706802] [INFO ] [MAIN ] USAC: Generated 1820 derivative records from 23060 primary records. [2025-09-29T02:24:24.707984] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-29T02:24:24.729192] [DEBUG] [LOCAL ] USAC: Derivative data saved (1820 records). [2025-09-29T02:24:24.730059] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-29T02:24:24.732904] [INFO ] [MAIN ] Derivative Progress: 2044/2211 symbols completed. USAC took 1.3s. Estimated remaining: 1m 11s. Rate: 141.3 symbols/min [2025-09-29T02:24:24.733714] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:24.758611] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:24.760008] [INFO ] [MAIN ] USFD: Generated 1820 derivative records from 51959 primary records. [2025-09-29T02:24:24.760151] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-29T02:24:24.793023] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:24.804905] [DEBUG] [LOCAL ] USNA: Loaded 18368 existing records from primary storage. [2025-09-29T02:24:24.806625] [INFO ] [MAIN ] USNA: Loaded 18368 primary data records. [2025-09-29T02:24:24.805634] [INFO ] [MAIN ] USB: Generated 1820 derivative records from 54468 primary records. [2025-09-29T02:24:24.807571] [DEBUG] [LOCAL ] USFD: Derivative data saved (1820 records). [2025-09-29T02:24:24.831015] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-29T02:24:24.847511] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-29T02:24:24.850905] [INFO ] [MAIN ] Derivative Progress: 2045/2211 symbols completed. USFD took 1.3s. Estimated remaining: 1m 10s. Rate: 141.4 symbols/min [2025-09-29T02:24:24.906554] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:24.950970] [DEBUG] [LOCAL ] USB: Derivative data saved (1820 records). [2025-09-29T02:24:24.962553] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-29T02:24:24.975968] [INFO ] [MAIN ] Derivative Progress: 2046/2211 symbols completed. USB took 1.5s. Estimated remaining: 1m 10s. Rate: 141.4 symbols/min [2025-09-29T02:24:25.011104] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:25.165180] [DEBUG] [LOCAL ] USPH: Loaded 16827 existing records from primary storage. [2025-09-29T02:24:25.181252] [INFO ] [MAIN ] USPH: Loaded 16827 primary data records. [2025-09-29T02:24:25.390221] [DEBUG] [LOCAL ] UTF: Loaded 29200 existing records from primary storage. [2025-09-29T02:24:25.418673] [INFO ] [MAIN ] UTF: Loaded 29200 primary data records. [2025-09-29T02:24:25.710350] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:25.724039] [INFO ] [MAIN ] USNA: Generated 1820 derivative records from 18368 primary records. [2025-09-29T02:24:25.734628] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-29T02:24:25.938676] [DEBUG] [LOCAL ] USNA: Derivative data saved (1820 records). [2025-09-29T02:24:25.940185] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-29T02:24:25.943036] [INFO ] [MAIN ] Derivative Progress: 2047/2211 symbols completed. USNA took 1.2s. Estimated remaining: 1m 10s. Rate: 141.3 symbols/min [2025-09-29T02:24:25.944296] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:25.964676] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:25.965629] [INFO ] [MAIN ] USPH: Generated 1820 derivative records from 16827 primary records. [2025-09-29T02:24:25.967631] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-29T02:24:25.987962] [DEBUG] [LOCAL ] USPH: Derivative data saved (1820 records). [2025-09-29T02:24:25.988389] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-29T02:24:25.991798] [INFO ] [MAIN ] Derivative Progress: 2048/2211 symbols completed. USPH took 1.1s. Estimated remaining: 1m 9s. Rate: 141.4 symbols/min [2025-09-29T02:24:25.992228] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:26.009679] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:26.021789] [INFO ] [MAIN ] UTF: Generated 1820 derivative records from 29200 primary records. [2025-09-29T02:24:26.022114] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-29T02:24:26.061898] [DEBUG] [LOCAL ] UTF: Derivative data saved (1820 records). [2025-09-29T02:24:26.062104] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-29T02:24:26.065305] [INFO ] [MAIN ] Derivative Progress: 2049/2211 symbols completed. UTF took 1.1s. Estimated remaining: 1m 9s. Rate: 141.5 symbols/min [2025-09-29T02:24:26.066428] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:26.066197] [DEBUG] [LOCAL ] UTL: Loaded 11273 existing records from primary storage. [2025-09-29T02:24:26.067158] [INFO ] [MAIN ] UTL: Loaded 11273 primary data records. [2025-09-29T02:24:26.068794] [DEBUG] [LOCAL ] UTI: Loaded 41146 existing records from primary storage. [2025-09-29T02:24:26.081495] [INFO ] [MAIN ] UTI: Loaded 41146 primary data records. [2025-09-29T02:24:26.793063] [DEBUG] [LOCAL ] UTZ: Loaded 45341 existing records from primary storage. [2025-09-29T02:24:26.794131] [INFO ] [MAIN ] UTZ: Loaded 45341 primary data records. [2025-09-29T02:24:27.198459] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:27.198083] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:27.199636] [INFO ] [MAIN ] UTI: Generated 1820 derivative records from 41146 primary records. [2025-09-29T02:24:27.200926] [INFO ] [MAIN ] UTL: Generated 1820 derivative records from 11273 primary records. [2025-09-29T02:24:27.202094] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-29T02:24:27.202166] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-29T02:24:27.238624] [DEBUG] [LOCAL ] UTL: Derivative data saved (1820 records). [2025-09-29T02:24:27.242548] [DEBUG] [LOCAL ] UTI: Derivative data saved (1820 records). [2025-09-29T02:24:27.242908] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-29T02:24:27.240030] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-29T02:24:27.246523] [INFO ] [MAIN ] Derivative Progress: 2050/2211 symbols completed. UTI took 1.3s. Estimated remaining: 1m 8s. Rate: 141.3 symbols/min [2025-09-29T02:24:27.250428] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:27.250592] [INFO ] [MAIN ] Derivative Progress: 2051/2211 symbols completed. UTL took 1.3s. Estimated remaining: 1m 8s. Rate: 141.4 symbols/min [2025-09-29T02:24:27.251452] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:27.271826] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:27.272613] [INFO ] [MAIN ] UTZ: Generated 1820 derivative records from 45341 primary records. [2025-09-29T02:24:27.272720] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-29T02:24:27.302418] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1820 records). [2025-09-29T02:24:27.302793] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-29T02:24:27.306100] [INFO ] [MAIN ] Derivative Progress: 2052/2211 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 7s. Rate: 141.5 symbols/min [2025-09-29T02:24:27.306524] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:27.332021] [DEBUG] [LOCAL ] UVE: Loaded 22124 existing records from primary storage. [2025-09-29T02:24:27.332361] [INFO ] [MAIN ] UVE: Loaded 22124 primary data records. [2025-09-29T02:24:27.401801] [DEBUG] [LOCAL ] UVV: Loaded 22660 existing records from primary storage. [2025-09-29T02:24:27.447262] [INFO ] [MAIN ] UVV: Loaded 22660 primary data records. [2025-09-29T02:24:28.015001] [DEBUG] [LOCAL ] UWMC: Loaded 53516 existing records from primary storage. [2025-09-29T02:24:28.037798] [INFO ] [MAIN ] UWMC: Loaded 53516 primary data records. [2025-09-29T02:24:28.774150] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:28.776623] [INFO ] [MAIN ] UVE: Generated 1820 derivative records from 22124 primary records. [2025-09-29T02:24:28.777336] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-29T02:24:28.809941] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:28.812722] [INFO ] [MAIN ] UVV: Generated 1820 derivative records from 22660 primary records. [2025-09-29T02:24:28.813143] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-29T02:24:28.814002] [DEBUG] [LOCAL ] UVE: Derivative data saved (1820 records). [2025-09-29T02:24:28.815321] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-29T02:24:28.818148] [INFO ] [MAIN ] Derivative Progress: 2053/2211 symbols completed. UVE took 1.6s. Estimated remaining: 1m 7s. Rate: 141.3 symbols/min [2025-09-29T02:24:28.835682] [DEBUG] [LOCAL ] UVV: Derivative data saved (1820 records). [2025-09-29T02:24:28.837035] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-29T02:24:28.840482] [INFO ] [MAIN ] Derivative Progress: 2054/2211 symbols completed. UVV took 1.6s. Estimated remaining: 1m 7s. Rate: 141.3 symbols/min [2025-09-29T02:24:28.855943] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:28.856747] [INFO ] [MAIN ] UWMC: Generated 1820 derivative records from 53516 primary records. [2025-09-29T02:24:28.856866] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-29T02:24:28.872575] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1820 records). [2025-09-29T02:24:28.872747] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-29T02:24:28.876197] [INFO ] [MAIN ] Derivative Progress: 2055/2211 symbols completed. UWMC took 1.6s. Estimated remaining: 1m 6s. Rate: 141.4 symbols/min [2025-09-29T02:24:28.876913] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:28.877109] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:28.877232] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:28.891221] [DEBUG] [LOCAL ] UZD: Loaded 6455 existing records from primary storage. [2025-09-29T02:24:28.891611] [INFO ] [MAIN ] UZD: Loaded 6455 primary data records. [2025-09-29T02:24:28.948354] [DEBUG] [LOCAL ] UZE: Loaded 7528 existing records from primary storage. [2025-09-29T02:24:28.991626] [DEBUG] [LOCAL ] UZF: Loaded 6574 existing records from primary storage. [2025-09-29T02:24:29.011777] [INFO ] [MAIN ] UZF: Loaded 6574 primary data records. [2025-09-29T02:24:28.997172] [INFO ] [MAIN ] UZE: Loaded 7528 primary data records. [2025-09-29T02:24:29.980000] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:29.981749] [INFO ] [MAIN ] UZD: Generated 1820 derivative records from 6455 primary records. [2025-09-29T02:24:29.981998] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-29T02:24:30.003889] [DEBUG] [LOCAL ] UZD: Derivative data saved (1820 records). [2025-09-29T02:24:30.005940] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-29T02:24:30.022699] [INFO ] [MAIN ] Derivative Progress: 2056/2211 symbols completed. UZD took 1.1s. Estimated remaining: 1m 6s. Rate: 141.3 symbols/min [2025-09-29T02:24:30.020212] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:30.041320] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:30.041889] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:30.043561] [INFO ] [MAIN ] UZF: Generated 1820 derivative records from 6574 primary records. [2025-09-29T02:24:30.044309] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-29T02:24:30.045454] [INFO ] [MAIN ] UZE: Generated 1820 derivative records from 7528 primary records. [2025-09-29T02:24:30.046566] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-29T02:24:30.063065] [DEBUG] [LOCAL ] UZF: Derivative data saved (1820 records). [2025-09-29T02:24:30.080053] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-29T02:24:30.084002] [INFO ] [MAIN ] Derivative Progress: 2057/2211 symbols completed. UZF took 1.2s. Estimated remaining: 1m 5s. Rate: 141.4 symbols/min [2025-09-29T02:24:30.084721] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:30.092027] [DEBUG] [LOCAL ] UZE: Derivative data saved (1820 records). [2025-09-29T02:24:30.092462] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-29T02:24:30.095933] [INFO ] [MAIN ] Derivative Progress: 2058/2211 symbols completed. UZE took 1.2s. Estimated remaining: 1m 5s. Rate: 141.4 symbols/min [2025-09-29T02:24:30.096192] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:30.183067] [DEBUG] [LOCAL ] VAC: Loaded 35026 existing records from primary storage. [2025-09-29T02:24:30.183369] [INFO ] [MAIN ] VAC: Loaded 35026 primary data records. [2025-09-29T02:24:30.190790] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-09-29T02:24:30.191161] [INFO ] [MAIN ] V: Loaded 54535 primary data records. [2025-09-29T02:24:30.434057] [DEBUG] [LOCAL ] VAL: Loaded 51142 existing records from primary storage. [2025-09-29T02:24:30.475961] [INFO ] [MAIN ] VAL: Loaded 51142 primary data records. [2025-09-29T02:24:31.310746] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:31.325384] [INFO ] [MAIN ] VAC: Generated 1820 derivative records from 35026 primary records. [2025-09-29T02:24:31.325840] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:31.326551] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-29T02:24:31.328978] [INFO ] [MAIN ] V: Generated 1820 derivative records from 54535 primary records. [2025-09-29T02:24:31.329508] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-29T02:24:31.360692] [DEBUG] [LOCAL ] VAC: Derivative data saved (1820 records). [2025-09-29T02:24:31.366139] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-29T02:24:31.367340] [DEBUG] [LOCAL ] V: Derivative data saved (1820 records). [2025-09-29T02:24:31.370882] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-29T02:24:31.370565] [INFO ] [MAIN ] Derivative Progress: 2059/2211 symbols completed. VAC took 1.3s. Estimated remaining: 1m 5s. Rate: 141.3 symbols/min [2025-09-29T02:24:31.374677] [INFO ] [MAIN ] Derivative Progress: 2060/2211 symbols completed. V took 1.3s. Estimated remaining: 1m 4s. Rate: 141.3 symbols/min [2025-09-29T02:24:31.371173] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:31.375200] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:31.403030] [DEBUG] [LOCAL ] VATE: Loaded 5658 existing records from primary storage. [2025-09-29T02:24:31.403778] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:31.404038] [INFO ] [MAIN ] VATE: Loaded 5658 primary data records. [2025-09-29T02:24:31.404893] [INFO ] [MAIN ] VAL: Generated 1820 derivative records from 51142 primary records. [2025-09-29T02:24:31.405285] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-29T02:24:31.576064] [DEBUG] [LOCAL ] VAL: Derivative data saved (1820 records). [2025-09-29T02:24:31.592012] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-29T02:24:31.635957] [INFO ] [MAIN ] Derivative Progress: 2061/2211 symbols completed. VAL took 1.5s. Estimated remaining: 1m 4s. Rate: 141.4 symbols/min [2025-09-29T02:24:31.661784] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:31.812788] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-29T02:24:31.814086] [INFO ] [MAIN ] VALE: Loaded 54474 primary data records. [2025-09-29T02:24:31.908802] [DEBUG] [LOCAL ] VBF: Loaded 7206 existing records from primary storage. [2025-09-29T02:24:31.939964] [INFO ] [MAIN ] VBF: Loaded 7206 primary data records. [2025-09-29T02:24:32.519167] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:32.520457] [INFO ] [MAIN ] VATE: Generated 1820 derivative records from 5658 primary records. [2025-09-29T02:24:32.520781] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-29T02:24:32.539919] [DEBUG] [LOCAL ] VATE: Derivative data saved (1820 records). [2025-09-29T02:24:32.542953] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-29T02:24:32.562303] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:32.548516] [INFO ] [MAIN ] Derivative Progress: 2062/2211 symbols completed. VATE took 1.2s. Estimated remaining: 1m 3s. Rate: 141.3 symbols/min [2025-09-29T02:24:32.563848] [INFO ] [MAIN ] VALE: Generated 1820 derivative records from 54474 primary records. [2025-09-29T02:24:32.564034] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:32.564099] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-29T02:24:32.583680] [DEBUG] [LOCAL ] VALE: Derivative data saved (1820 records). [2025-09-29T02:24:32.583972] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-29T02:24:32.587236] [INFO ] [MAIN ] Derivative Progress: 2063/2211 symbols completed. VALE took 1.2s. Estimated remaining: 1m 3s. Rate: 141.4 symbols/min [2025-09-29T02:24:32.587597] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:32.602946] [DEBUG] [LOCAL ] VCV: Loaded 13766 existing records from primary storage. [2025-09-29T02:24:32.603240] [INFO ] [MAIN ] VCV: Loaded 13766 primary data records. [2025-09-29T02:24:32.659013] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:32.700208] [INFO ] [MAIN ] VBF: Generated 1820 derivative records from 7206 primary records. [2025-09-29T02:24:32.738839] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-29T02:24:32.827080] [DEBUG] [LOCAL ] VBF: Derivative data saved (1820 records). [2025-09-29T02:24:32.853394] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-29T02:24:32.863286] [INFO ] [MAIN ] Derivative Progress: 2064/2211 symbols completed. VBF took 1.2s. Estimated remaining: 1m 2s. Rate: 141.4 symbols/min [2025-09-29T02:24:32.991991] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:33.016381] [DEBUG] [LOCAL ] VEEV: Loaded 47821 existing records from primary storage. [2025-09-29T02:24:33.020182] [INFO ] [MAIN ] VEEV: Loaded 47821 primary data records. [2025-09-29T02:24:33.089422] [DEBUG] [LOCAL ] VEL: Loaded 13299 existing records from primary storage. [2025-09-29T02:24:33.106217] [INFO ] [MAIN ] VEL: Loaded 13299 primary data records. [2025-09-29T02:24:33.603731] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:33.623573] [INFO ] [MAIN ] VCV: Generated 1820 derivative records from 13766 primary records. [2025-09-29T02:24:33.630563] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-29T02:24:33.775220] [DEBUG] [LOCAL ] VCV: Derivative data saved (1820 records). [2025-09-29T02:24:33.776735] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-29T02:24:33.780024] [INFO ] [MAIN ] Derivative Progress: 2065/2211 symbols completed. VCV took 1.2s. Estimated remaining: 1m 2s. Rate: 141.3 symbols/min [2025-09-29T02:24:33.780665] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:33.804180] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:33.805160] [INFO ] [MAIN ] VEEV: Generated 1820 derivative records from 47821 primary records. [2025-09-29T02:24:33.805364] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-29T02:24:33.838518] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:33.840141] [INFO ] [MAIN ] VEL: Generated 1820 derivative records from 13299 primary records. [2025-09-29T02:24:33.840387] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-29T02:24:33.840226] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1820 records). [2025-09-29T02:24:33.841075] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-29T02:24:33.862022] [INFO ] [MAIN ] Derivative Progress: 2066/2211 symbols completed. VEEV took 1.3s. Estimated remaining: 1m 2s. Rate: 141.4 symbols/min [2025-09-29T02:24:33.866540] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:33.873014] [DEBUG] [LOCAL ] VEL: Derivative data saved (1820 records). [2025-09-29T02:24:33.873416] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-29T02:24:33.876417] [INFO ] [MAIN ] Derivative Progress: 2067/2211 symbols completed. VEL took 0.9s. Estimated remaining: 1m 1s. Rate: 141.4 symbols/min [2025-09-29T02:24:33.878345] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:33.898723] [DEBUG] [LOCAL ] VET: Loaded 44749 existing records from primary storage. [2025-09-29T02:24:33.899126] [INFO ] [MAIN ] VET: Loaded 44749 primary data records. [2025-09-29T02:24:34.018888] [DEBUG] [LOCAL ] VGI: Loaded 5237 existing records from primary storage. [2025-09-29T02:24:34.023768] [INFO ] [MAIN ] VGI: Loaded 5237 primary data records. [2025-09-29T02:24:34.613919] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-09-29T02:24:34.629023] [INFO ] [MAIN ] VFC: Loaded 54390 primary data records. [2025-09-29T02:24:34.997452] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:35.001996] [INFO ] [MAIN ] VET: Generated 1820 derivative records from 44749 primary records. [2025-09-29T02:24:35.002420] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-29T02:24:35.027239] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:35.035094] [DEBUG] [LOCAL ] VET: Derivative data saved (1820 records). [2025-09-29T02:24:35.036009] [INFO ] [MAIN ] VGI: Generated 1820 derivative records from 5237 primary records. [2025-09-29T02:24:35.036106] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-29T02:24:35.039367] [INFO ] [MAIN ] Derivative Progress: 2068/2211 symbols completed. VET took 1.3s. Estimated remaining: 1m 1s. Rate: 141.3 symbols/min [2025-09-29T02:24:35.036288] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-29T02:24:35.055786] [DEBUG] [LOCAL ] VGI: Derivative data saved (1820 records). [2025-09-29T02:24:35.056049] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-29T02:24:35.058726] [INFO ] [MAIN ] Derivative Progress: 2069/2211 symbols completed. VGI took 1.2s. Estimated remaining: 1m 0s. Rate: 141.4 symbols/min [2025-09-29T02:24:35.076511] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:35.077246] [INFO ] [MAIN ] VFC: Generated 1820 derivative records from 54390 primary records. [2025-09-29T02:24:35.077354] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-29T02:24:35.094944] [DEBUG] [LOCAL ] VFC: Derivative data saved (1820 records). [2025-09-29T02:24:35.095033] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-29T02:24:35.098516] [INFO ] [MAIN ] Derivative Progress: 2070/2211 symbols completed. VFC took 1.2s. Estimated remaining: 59.8s. Rate: 141.4 symbols/min [2025-09-29T02:24:35.099034] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:35.098958] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:35.099240] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:35.106449] [DEBUG] [LOCAL ] VHI: Loaded 2905 existing records from primary storage. [2025-09-29T02:24:35.106753] [INFO ] [MAIN ] VHI: Loaded 2905 primary data records. [2025-09-29T02:24:35.234449] [DEBUG] [LOCAL ] VGM: Loaded 18384 existing records from primary storage. [2025-09-29T02:24:35.261273] [INFO ] [MAIN ] VGM: Loaded 18384 primary data records. [2025-09-29T02:24:35.713884] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-09-29T02:24:35.752977] [INFO ] [MAIN ] VICI: Loaded 54427 primary data records. [2025-09-29T02:24:36.267345] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:36.269215] [INFO ] [MAIN ] VHI: Generated 1820 derivative records from 2905 primary records. [2025-09-29T02:24:36.271126] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-29T02:24:36.290940] [DEBUG] [LOCAL ] VHI: Derivative data saved (1820 records). [2025-09-29T02:24:36.300455] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-29T02:24:36.308003] [INFO ] [MAIN ] Derivative Progress: 2071/2211 symbols completed. VHI took 1.2s. Estimated remaining: 59.4s. Rate: 141.3 symbols/min [2025-09-29T02:24:36.308898] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:36.309252] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:36.311153] [INFO ] [MAIN ] VGM: Generated 1820 derivative records from 18384 primary records. [2025-09-29T02:24:36.311478] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-29T02:24:36.333991] [DEBUG] [LOCAL ] VGM: Derivative data saved (1820 records). [2025-09-29T02:24:36.335274] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-29T02:24:36.338693] [INFO ] [MAIN ] Derivative Progress: 2072/2211 symbols completed. VGM took 1.2s. Estimated remaining: 59.0s. Rate: 141.4 symbols/min [2025-09-29T02:24:36.346977] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:36.353062] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:36.354501] [INFO ] [MAIN ] VICI: Generated 1820 derivative records from 54427 primary records. [2025-09-29T02:24:36.354714] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-29T02:24:36.376698] [DEBUG] [LOCAL ] VICI: Derivative data saved (1820 records). [2025-09-29T02:24:36.376923] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-29T02:24:36.379875] [INFO ] [MAIN ] Derivative Progress: 2073/2211 symbols completed. VICI took 1.3s. Estimated remaining: 58.5s. Rate: 141.4 symbols/min [2025-09-29T02:24:36.380197] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:36.421914] [DEBUG] [LOCAL ] VIK: Loaded 53250 existing records from primary storage. [2025-09-29T02:24:36.422340] [INFO ] [MAIN ] VIK: Loaded 53250 primary data records. [2025-09-29T02:24:36.662465] [DEBUG] [LOCAL ] VIPS: Loaded 52093 existing records from primary storage. [2025-09-29T02:24:36.804627] [INFO ] [MAIN ] VIPS: Loaded 52093 primary data records. [2025-09-29T02:24:36.799364] [DEBUG] [LOCAL ] VIRT: Loaded 47448 existing records from primary storage. [2025-09-29T02:24:36.814515] [INFO ] [MAIN ] VIRT: Loaded 47448 primary data records. [2025-09-29T02:24:37.570161] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:37.571260] [INFO ] [MAIN ] VIK: Generated 1820 derivative records from 53250 primary records. [2025-09-29T02:24:37.571383] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-29T02:24:37.591534] [DEBUG] [LOCAL ] VIK: Derivative data saved (1820 records). [2025-09-29T02:24:37.592029] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-29T02:24:37.595209] [INFO ] [MAIN ] Derivative Progress: 2074/2211 symbols completed. VIK took 1.3s. Estimated remaining: 58.2s. Rate: 141.3 symbols/min [2025-09-29T02:24:37.595790] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:37.615583] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:37.618336] [INFO ] [MAIN ] VIPS: Generated 1820 derivative records from 52093 primary records. [2025-09-29T02:24:37.619330] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-29T02:24:37.642692] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:37.648966] [INFO ] [MAIN ] VIRT: Generated 1820 derivative records from 47448 primary records. [2025-09-29T02:24:37.651866] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-29T02:24:37.653425] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1820 records). [2025-09-29T02:24:37.653973] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-29T02:24:37.658100] [INFO ] [MAIN ] Derivative Progress: 2075/2211 symbols completed. VIPS took 1.3s. Estimated remaining: 57.7s. Rate: 141.4 symbols/min [2025-09-29T02:24:37.665858] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:37.688025] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1820 records). [2025-09-29T02:24:37.688310] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-29T02:24:37.691033] [INFO ] [MAIN ] Derivative Progress: 2076/2211 symbols completed. VIRT took 1.3s. Estimated remaining: 57.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:37.691409] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:37.716418] [DEBUG] [LOCAL ] VIST: Loaded 46722 existing records from primary storage. [2025-09-29T02:24:37.716851] [INFO ] [MAIN ] VIST: Loaded 46722 primary data records. [2025-09-29T02:24:37.843265] [DEBUG] [LOCAL ] VKQ: Loaded 17552 existing records from primary storage. [2025-09-29T02:24:37.857316] [INFO ] [MAIN ] VKQ: Loaded 17552 primary data records. [2025-09-29T02:24:38.190914] [DEBUG] [LOCAL ] VIV: Loaded 45667 existing records from primary storage. [2025-09-29T02:24:38.204888] [INFO ] [MAIN ] VIV: Loaded 45667 primary data records. [2025-09-29T02:24:38.795117] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:38.797253] [INFO ] [MAIN ] VIST: Generated 1820 derivative records from 46722 primary records. [2025-09-29T02:24:38.798008] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-29T02:24:38.818684] [DEBUG] [LOCAL ] VIST: Derivative data saved (1820 records). [2025-09-29T02:24:38.820975] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-29T02:24:38.824045] [INFO ] [MAIN ] Derivative Progress: 2077/2211 symbols completed. VIST took 1.2s. Estimated remaining: 56.9s. Rate: 141.3 symbols/min [2025-09-29T02:24:38.824584] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:38.839610] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:38.841050] [INFO ] [MAIN ] VKQ: Generated 1820 derivative records from 17552 primary records. [2025-09-29T02:24:38.841363] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-29T02:24:38.859086] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1820 records). [2025-09-29T02:24:38.860098] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-29T02:24:38.863575] [INFO ] [MAIN ] Derivative Progress: 2078/2211 symbols completed. VKQ took 1.2s. Estimated remaining: 56.4s. Rate: 141.4 symbols/min [2025-09-29T02:24:38.872028] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:38.886506] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:38.887585] [INFO ] [MAIN ] VIV: Generated 1820 derivative records from 45667 primary records. [2025-09-29T02:24:38.897848] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-29T02:24:38.899505] [DEBUG] [LOCAL ] VLN: Loaded 29056 existing records from primary storage. [2025-09-29T02:24:38.899999] [INFO ] [MAIN ] VLN: Loaded 29056 primary data records. [2025-09-29T02:24:39.013950] [DEBUG] [LOCAL ] VIV: Derivative data saved (1820 records). [2025-09-29T02:24:39.033738] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-29T02:24:39.036771] [INFO ] [MAIN ] Derivative Progress: 2079/2211 symbols completed. VIV took 1.4s. Estimated remaining: 56.0s. Rate: 141.4 symbols/min [2025-09-29T02:24:39.058274] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:39.288133] [DEBUG] [LOCAL ] VLO: Loaded 53865 existing records from primary storage. [2025-09-29T02:24:39.288905] [INFO ] [MAIN ] VLO: Loaded 53865 primary data records. [2025-09-29T02:24:39.500618] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:39.657524] [INFO ] [MAIN ] VLN: Generated 1820 derivative records from 29056 primary records. [2025-09-29T02:24:39.656431] [DEBUG] [LOCAL ] VLRS: Loaded 41188 existing records from primary storage. [2025-09-29T02:24:39.658630] [INFO ] [MAIN ] VLRS: Loaded 41188 primary data records. [2025-09-29T02:24:39.658510] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-29T02:24:39.797025] [DEBUG] [LOCAL ] VLN: Derivative data saved (1820 records). [2025-09-29T02:24:39.803289] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-29T02:24:39.821191] [INFO ] [MAIN ] Derivative Progress: 2080/2211 symbols completed. VLN took 1.0s. Estimated remaining: 55.6s. Rate: 141.4 symbols/min [2025-09-29T02:24:39.919496] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:40.054207] [DEBUG] [LOCAL ] VLT: Loaded 4615 existing records from primary storage. [2025-09-29T02:24:40.054820] [INFO ] [MAIN ] VLT: Loaded 4615 primary data records. [2025-09-29T02:24:40.205071] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:40.256435] [INFO ] [MAIN ] VLO: Generated 1820 derivative records from 53865 primary records. [2025-09-29T02:24:40.276784] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-29T02:24:40.423555] [DEBUG] [LOCAL ] VLO: Derivative data saved (1820 records). [2025-09-29T02:24:40.424847] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-29T02:24:40.428142] [INFO ] [MAIN ] Derivative Progress: 2081/2211 symbols completed. VLO took 1.6s. Estimated remaining: 55.2s. Rate: 141.3 symbols/min [2025-09-29T02:24:40.428410] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:40.447296] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:40.448203] [INFO ] [MAIN ] VLRS: Generated 1820 derivative records from 41188 primary records. [2025-09-29T02:24:40.448452] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-29T02:24:40.466186] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1820 records). [2025-09-29T02:24:40.466784] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-29T02:24:40.469542] [INFO ] [MAIN ] Derivative Progress: 2082/2211 symbols completed. VLRS took 1.4s. Estimated remaining: 54.7s. Rate: 141.4 symbols/min [2025-09-29T02:24:40.470130] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:40.488541] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:40.489443] [INFO ] [MAIN ] VLT: Generated 1820 derivative records from 4615 primary records. [2025-09-29T02:24:40.489554] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-29T02:24:40.518132] [DEBUG] [LOCAL ] VLT: Derivative data saved (1820 records). [2025-09-29T02:24:40.518347] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-29T02:24:40.521006] [INFO ] [MAIN ] Derivative Progress: 2083/2211 symbols completed. VLT took 0.6s. Estimated remaining: 54.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:40.538514] [DEBUG] [LOCAL ] VLTO: Loaded 46710 existing records from primary storage. [2025-09-29T02:24:40.538737] [INFO ] [MAIN ] VLTO: Loaded 46710 primary data records. [2025-09-29T02:24:40.760142] [DEBUG] [LOCAL ] VMC: Loaded 44263 existing records from primary storage. [2025-09-29T02:24:40.760400] [INFO ] [MAIN ] VMC: Loaded 44263 primary data records. [2025-09-29T02:24:41.240214] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:41.241950] [INFO ] [MAIN ] VLTO: Generated 1820 derivative records from 46710 primary records. [2025-09-29T02:24:41.242063] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-29T02:24:41.260145] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1820 records). [2025-09-29T02:24:41.260590] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-29T02:24:41.263639] [INFO ] [MAIN ] Derivative Progress: 2084/2211 symbols completed. VLTO took 0.8s. Estimated remaining: 53.9s. Rate: 141.4 symbols/min [2025-09-29T02:24:41.284804] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:41.285612] [INFO ] [MAIN ] VMC: Generated 1820 derivative records from 44263 primary records. [2025-09-29T02:24:41.285739] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-29T02:24:41.306452] [DEBUG] [LOCAL ] VMC: Derivative data saved (1820 records). [2025-09-29T02:24:41.306691] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-29T02:24:41.310598] [INFO ] [MAIN ] Derivative Progress: 2085/2211 symbols completed. VMC took 0.8s. Estimated remaining: 53.4s. Rate: 141.5 symbols/min [2025-09-29T02:24:41.311393] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:41.311533] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:41.311240] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:41.334553] [DEBUG] [LOCAL ] VMI: Loaded 15711 existing records from primary storage. [2025-09-29T02:24:41.341186] [INFO ] [MAIN ] VMI: Loaded 15711 primary data records. [2025-09-29T02:24:41.349399] [DEBUG] [LOCAL ] VNCE: Loaded 7593 existing records from primary storage. [2025-09-29T02:24:41.373179] [INFO ] [MAIN ] VNCE: Loaded 7593 primary data records. [2025-09-29T02:24:41.556625] [DEBUG] [LOCAL ] VMO: Loaded 21297 existing records from primary storage. [2025-09-29T02:24:41.572490] [INFO ] [MAIN ] VMO: Loaded 21297 primary data records. [2025-09-29T02:24:42.489378] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:42.491375] [INFO ] [MAIN ] VMI: Generated 1820 derivative records from 15711 primary records. [2025-09-29T02:24:42.491829] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-29T02:24:42.518487] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:42.524102] [DEBUG] [LOCAL ] VMI: Derivative data saved (1820 records). [2025-09-29T02:24:42.524321] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-29T02:24:42.523404] [INFO ] [MAIN ] VNCE: Generated 1820 derivative records from 7593 primary records. [2025-09-29T02:24:42.527233] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-29T02:24:42.527101] [INFO ] [MAIN ] Derivative Progress: 2086/2211 symbols completed. VMI took 1.2s. Estimated remaining: 53.1s. Rate: 141.3 symbols/min [2025-09-29T02:24:42.538371] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:42.563068] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1820 records). [2025-09-29T02:24:42.563446] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:42.564995] [INFO ] [MAIN ] VMO: Generated 1820 derivative records from 21297 primary records. [2025-09-29T02:24:42.564070] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-29T02:24:42.565330] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-29T02:24:42.568810] [INFO ] [MAIN ] Derivative Progress: 2087/2211 symbols completed. VNCE took 1.3s. Estimated remaining: 52.6s. Rate: 141.4 symbols/min [2025-09-29T02:24:42.571559] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:42.588676] [DEBUG] [LOCAL ] VMO: Derivative data saved (1820 records). [2025-09-29T02:24:42.588844] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-29T02:24:42.591763] [INFO ] [MAIN ] Derivative Progress: 2088/2211 symbols completed. VMO took 1.3s. Estimated remaining: 52.2s. Rate: 141.5 symbols/min [2025-09-29T02:24:42.592094] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:42.605407] [DEBUG] [LOCAL ] VOC: Loaded 9021 existing records from primary storage. [2025-09-29T02:24:42.605687] [INFO ] [MAIN ] VOC: Loaded 9021 primary data records. [2025-09-29T02:24:42.803593] [DEBUG] [LOCAL ] VNO: Loaded 49668 existing records from primary storage. [2025-09-29T02:24:42.856302] [INFO ] [MAIN ] VNO: Loaded 49668 primary data records. [2025-09-29T02:24:42.995903] [DEBUG] [LOCAL ] VNT: Loaded 44451 existing records from primary storage. [2025-09-29T02:24:43.041908] [INFO ] [MAIN ] VNT: Loaded 44451 primary data records. [2025-09-29T02:24:43.733075] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:43.734907] [INFO ] [MAIN ] VOC: Generated 1820 derivative records from 9021 primary records. [2025-09-29T02:24:43.735461] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-29T02:24:43.755684] [DEBUG] [LOCAL ] VOC: Derivative data saved (1820 records). [2025-09-29T02:24:43.755904] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-29T02:24:43.758442] [INFO ] [MAIN ] Derivative Progress: 2089/2211 symbols completed. VOC took 1.2s. Estimated remaining: 51.8s. Rate: 141.3 symbols/min [2025-09-29T02:24:43.758738] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:43.778178] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:43.779316] [INFO ] [MAIN ] VNO: Generated 1820 derivative records from 49668 primary records. [2025-09-29T02:24:43.780008] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-29T02:24:43.804419] [DEBUG] [LOCAL ] VNO: Derivative data saved (1820 records). [2025-09-29T02:24:43.805485] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-29T02:24:43.809341] [INFO ] [MAIN ] Derivative Progress: 2090/2211 symbols completed. VNO took 1.3s. Estimated remaining: 51.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:43.817588] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:43.823757] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:43.824805] [INFO ] [MAIN ] VNT: Generated 1820 derivative records from 44451 primary records. [2025-09-29T02:24:43.824974] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-29T02:24:43.869001] [DEBUG] [LOCAL ] VNT: Derivative data saved (1820 records). [2025-09-29T02:24:43.870283] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-29T02:24:43.874552] [DEBUG] [LOCAL ] VOYA: Loaded 43377 existing records from primary storage. [2025-09-29T02:24:43.873266] [INFO ] [MAIN ] Derivative Progress: 2091/2211 symbols completed. VNT took 1.3s. Estimated remaining: 50.9s. Rate: 141.5 symbols/min [2025-09-29T02:24:43.874818] [INFO ] [MAIN ] VOYA: Loaded 43377 primary data records. [2025-09-29T02:24:43.874928] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:43.929945] [DEBUG] [LOCAL ] VPG: Loaded 17373 existing records from primary storage. [2025-09-29T02:24:43.954830] [INFO ] [MAIN ] VPG: Loaded 17373 primary data records. [2025-09-29T02:24:43.998508] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-09-29T02:24:44.050977] [INFO ] [MAIN ] VPV: Loaded 5429 primary data records. [2025-09-29T02:24:44.970244] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:44.971909] [INFO ] [MAIN ] VOYA: Generated 1820 derivative records from 43377 primary records. [2025-09-29T02:24:44.979871] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-29T02:24:44.985983] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:44.995973] [INFO ] [MAIN ] VPG: Generated 1820 derivative records from 17373 primary records. [2025-09-29T02:24:44.998755] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-29T02:24:45.004010] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1820 records). [2025-09-29T02:24:45.004154] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-29T02:24:45.008127] [INFO ] [MAIN ] Derivative Progress: 2092/2211 symbols completed. VOYA took 1.2s. Estimated remaining: 50.5s. Rate: 141.3 symbols/min [2025-09-29T02:24:45.008747] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:45.035819] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:45.040136] [INFO ] [MAIN ] VPV: Generated 1820 derivative records from 5429 primary records. [2025-09-29T02:24:45.041394] [DEBUG] [LOCAL ] VPG: Derivative data saved (1820 records). [2025-09-29T02:24:45.041606] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-29T02:24:45.041476] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-29T02:24:45.044423] [INFO ] [MAIN ] Derivative Progress: 2093/2211 symbols completed. VPG took 1.2s. Estimated remaining: 50.1s. Rate: 141.4 symbols/min [2025-09-29T02:24:45.044702] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:45.074051] [DEBUG] [LOCAL ] VPV: Derivative data saved (1820 records). [2025-09-29T02:24:45.074360] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-29T02:24:45.077994] [INFO ] [MAIN ] Derivative Progress: 2094/2211 symbols completed. VPV took 1.2s. Estimated remaining: 49.6s. Rate: 141.5 symbols/min [2025-09-29T02:24:45.078567] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:45.099537] [DEBUG] [LOCAL ] VRE: Loaded 35345 existing records from primary storage. [2025-09-29T02:24:45.101672] [INFO ] [MAIN ] VRE: Loaded 35345 primary data records. [2025-09-29T02:24:45.163827] [DEBUG] [LOCAL ] VRTS: Loaded 9287 existing records from primary storage. [2025-09-29T02:24:45.211740] [INFO ] [MAIN ] VRTS: Loaded 9287 primary data records. [2025-09-29T02:24:45.500861] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-29T02:24:45.570259] [INFO ] [MAIN ] VRT: Loaded 54533 primary data records. [2025-09-29T02:24:46.237097] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:46.238559] [INFO ] [MAIN ] VRE: Generated 1820 derivative records from 35345 primary records. [2025-09-29T02:24:46.239063] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-29T02:24:46.259562] [DEBUG] [LOCAL ] VRE: Derivative data saved (1820 records). [2025-09-29T02:24:46.267887] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-29T02:24:46.271015] [INFO ] [MAIN ] Derivative Progress: 2095/2211 symbols completed. VRE took 1.3s. Estimated remaining: 49.2s. Rate: 141.3 symbols/min [2025-09-29T02:24:46.276615] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:46.276969] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:46.279532] [INFO ] [MAIN ] VRTS: Generated 1820 derivative records from 9287 primary records. [2025-09-29T02:24:46.279763] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-29T02:24:46.311025] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:46.312316] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1820 records). [2025-09-29T02:24:46.313374] [INFO ] [MAIN ] VRT: Generated 1820 derivative records from 54533 primary records. [2025-09-29T02:24:46.313511] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-29T02:24:46.313717] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-29T02:24:46.316612] [INFO ] [MAIN ] Derivative Progress: 2096/2211 symbols completed. VRTS took 1.2s. Estimated remaining: 48.8s. Rate: 141.4 symbols/min [2025-09-29T02:24:46.316975] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:46.336794] [DEBUG] [LOCAL ] VRT: Derivative data saved (1820 records). [2025-09-29T02:24:46.337167] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-29T02:24:46.339918] [INFO ] [MAIN ] Derivative Progress: 2097/2211 symbols completed. VRT took 1.3s. Estimated remaining: 48.4s. Rate: 141.5 symbols/min [2025-09-29T02:24:46.340157] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:46.398519] [DEBUG] [LOCAL ] VSCO: Loaded 53556 existing records from primary storage. [2025-09-29T02:24:46.399058] [INFO ] [MAIN ] VSCO: Loaded 53556 primary data records. [2025-09-29T02:24:46.520244] [DEBUG] [LOCAL ] VSH: Loaded 49188 existing records from primary storage. [2025-09-29T02:24:46.533949] [INFO ] [MAIN ] VSH: Loaded 49188 primary data records. [2025-09-29T02:24:46.766438] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-09-29T02:24:46.911850] [INFO ] [MAIN ] VST: Loaded 54498 primary data records. [2025-09-29T02:24:47.492504] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:47.494003] [INFO ] [MAIN ] VSCO: Generated 1820 derivative records from 53556 primary records. [2025-09-29T02:24:47.494403] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-29T02:24:47.516142] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1820 records). [2025-09-29T02:24:47.519261] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-29T02:24:47.523674] [INFO ] [MAIN ] Derivative Progress: 2098/2211 symbols completed. VSCO took 1.2s. Estimated remaining: 48.0s. Rate: 141.3 symbols/min [2025-09-29T02:24:47.538766] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:47.539574] [INFO ] [MAIN ] VSH: Generated 1820 derivative records from 49188 primary records. [2025-09-29T02:24:47.539713] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-29T02:24:47.560737] [DEBUG] [LOCAL ] VSH: Derivative data saved (1820 records). [2025-09-29T02:24:47.560884] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-29T02:24:47.564230] [INFO ] [MAIN ] Derivative Progress: 2099/2211 symbols completed. VSH took 1.2s. Estimated remaining: 47.5s. Rate: 141.4 symbols/min [2025-09-29T02:24:47.578624] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:47.579477] [INFO ] [MAIN ] VST: Generated 1820 derivative records from 54498 primary records. [2025-09-29T02:24:47.579570] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-29T02:24:47.596281] [DEBUG] [LOCAL ] VST: Derivative data saved (1820 records). [2025-09-29T02:24:47.596422] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-29T02:24:47.599453] [INFO ] [MAIN ] Derivative Progress: 2100/2211 symbols completed. VST took 1.3s. Estimated remaining: 47.1s. Rate: 141.5 symbols/min [2025-09-29T02:24:47.600217] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:47.600385] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:47.600553] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:47.664360] [DEBUG] [LOCAL ] VTEX: Loaded 43948 existing records from primary storage. [2025-09-29T02:24:47.677604] [INFO ] [MAIN ] VTEX: Loaded 43948 primary data records. [2025-09-29T02:24:47.752825] [DEBUG] [LOCAL ] VSTS: Loaded 49773 existing records from primary storage. [2025-09-29T02:24:47.794799] [INFO ] [MAIN ] VSTS: Loaded 49773 primary data records. [2025-09-29T02:24:47.899808] [DEBUG] [LOCAL ] VTLE: Loaded 49337 existing records from primary storage. [2025-09-29T02:24:47.941442] [INFO ] [MAIN ] VTLE: Loaded 49337 primary data records. [2025-09-29T02:24:48.814188] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:48.815691] [INFO ] [MAIN ] VTEX: Generated 1820 derivative records from 43948 primary records. [2025-09-29T02:24:48.815926] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-29T02:24:48.839483] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1820 records). [2025-09-29T02:24:48.840623] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-29T02:24:48.857918] [INFO ] [MAIN ] Derivative Progress: 2101/2211 symbols completed. VTEX took 1.3s. Estimated remaining: 46.7s. Rate: 141.3 symbols/min [2025-09-29T02:24:48.854850] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:48.858796] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:48.860551] [INFO ] [MAIN ] VSTS: Generated 1820 derivative records from 49773 primary records. [2025-09-29T02:24:48.860701] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-29T02:24:48.881832] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1820 records). [2025-09-29T02:24:48.890725] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-29T02:24:48.898855] [INFO ] [MAIN ] Derivative Progress: 2102/2211 symbols completed. VSTS took 1.3s. Estimated remaining: 46.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:48.899734] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:48.899608] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:48.901036] [INFO ] [MAIN ] VTLE: Generated 1820 derivative records from 49337 primary records. [2025-09-29T02:24:48.906166] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-29T02:24:48.930131] [DEBUG] [LOCAL ] VTMX: Loaded 17811 existing records from primary storage. [2025-09-29T02:24:48.934546] [DEBUG] [LOCAL ] VTN: Loaded 7293 existing records from primary storage. [2025-09-29T02:24:48.935308] [INFO ] [MAIN ] VTN: Loaded 7293 primary data records. [2025-09-29T02:24:48.935141] [INFO ] [MAIN ] VTMX: Loaded 17811 primary data records. [2025-09-29T02:24:48.994094] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1820 records). [2025-09-29T02:24:49.023906] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-29T02:24:49.095275] [INFO ] [MAIN ] Derivative Progress: 2103/2211 symbols completed. VTLE took 1.5s. Estimated remaining: 45.8s. Rate: 141.4 symbols/min [2025-09-29T02:24:49.122723] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:49.634121] [DEBUG] [LOCAL ] VTOL: Loaded 19915 existing records from primary storage. [2025-09-29T02:24:49.634483] [INFO ] [MAIN ] VTOL: Loaded 19915 primary data records. [2025-09-29T02:24:50.012709] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:50.018125] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:50.019063] [INFO ] [MAIN ] VTN: Generated 1820 derivative records from 7293 primary records. [2025-09-29T02:24:50.019948] [INFO ] [MAIN ] VTMX: Generated 1820 derivative records from 17811 primary records. [2025-09-29T02:24:50.019274] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-29T02:24:50.030583] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-29T02:24:50.055228] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1820 records). [2025-09-29T02:24:50.054073] [DEBUG] [LOCAL ] VTN: Derivative data saved (1820 records). [2025-09-29T02:24:50.055875] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-29T02:24:50.058359] [INFO ] [MAIN ] Derivative Progress: 2104/2211 symbols completed. VTN took 1.2s. Estimated remaining: 45.4s. Rate: 141.3 symbols/min [2025-09-29T02:24:50.058686] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:50.059005] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-29T02:24:50.061735] [INFO ] [MAIN ] Derivative Progress: 2105/2211 symbols completed. VTMX took 1.2s. Estimated remaining: 45.0s. Rate: 141.4 symbols/min [2025-09-29T02:24:50.062612] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:50.081937] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:50.082972] [INFO ] [MAIN ] VTOL: Generated 1820 derivative records from 19915 primary records. [2025-09-29T02:24:50.083313] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-29T02:24:50.104796] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1820 records). [2025-09-29T02:24:50.105073] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-29T02:24:50.108402] [INFO ] [MAIN ] Derivative Progress: 2106/2211 symbols completed. VTOL took 1.0s. Estimated remaining: 44.5s. Rate: 141.5 symbols/min [2025-09-29T02:24:50.108913] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:50.148810] [DEBUG] [LOCAL ] VTS: Loaded 30992 existing records from primary storage. [2025-09-29T02:24:50.149131] [INFO ] [MAIN ] VTS: Loaded 30992 primary data records. [2025-09-29T02:24:50.290318] [DEBUG] [LOCAL ] VTR: Loaded 53620 existing records from primary storage. [2025-09-29T02:24:50.292066] [INFO ] [MAIN ] VTR: Loaded 53620 primary data records. [2025-09-29T02:24:50.463139] [DEBUG] [LOCAL ] VVR: Loaded 31251 existing records from primary storage. [2025-09-29T02:24:50.480839] [INFO ] [MAIN ] VVR: Loaded 31251 primary data records. [2025-09-29T02:24:51.259371] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:51.260489] [INFO ] [MAIN ] VTS: Generated 1820 derivative records from 30992 primary records. [2025-09-29T02:24:51.260810] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-29T02:24:51.282870] [DEBUG] [LOCAL ] VTS: Derivative data saved (1820 records). [2025-09-29T02:24:51.283420] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-29T02:24:51.294358] [INFO ] [MAIN ] Derivative Progress: 2107/2211 symbols completed. VTS took 1.2s. Estimated remaining: 44.1s. Rate: 141.4 symbols/min [2025-09-29T02:24:51.300220] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:51.300565] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:51.302008] [INFO ] [MAIN ] VTR: Generated 1820 derivative records from 53620 primary records. [2025-09-29T02:24:51.302673] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-29T02:24:51.336344] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:51.336414] [DEBUG] [LOCAL ] VTR: Derivative data saved (1820 records). [2025-09-29T02:24:51.337549] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-29T02:24:51.340244] [INFO ] [MAIN ] Derivative Progress: 2108/2211 symbols completed. VTR took 1.3s. Estimated remaining: 43.7s. Rate: 141.4 symbols/min [2025-09-29T02:24:51.337457] [INFO ] [MAIN ] VVR: Generated 1820 derivative records from 31251 primary records. [2025-09-29T02:24:51.340594] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-29T02:24:51.340701] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:51.360840] [DEBUG] [LOCAL ] VVR: Derivative data saved (1820 records). [2025-09-29T02:24:51.360998] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-29T02:24:51.364351] [INFO ] [MAIN ] Derivative Progress: 2109/2211 symbols completed. VVR took 1.3s. Estimated remaining: 43.3s. Rate: 141.5 symbols/min [2025-09-29T02:24:51.364686] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:51.398031] [DEBUG] [LOCAL ] VVX: Loaded 23664 existing records from primary storage. [2025-09-29T02:24:51.398208] [INFO ] [MAIN ] VVX: Loaded 23664 primary data records. [2025-09-29T02:24:51.527121] [DEBUG] [LOCAL ] VVV: Loaded 50933 existing records from primary storage. [2025-09-29T02:24:51.532125] [INFO ] [MAIN ] VVV: Loaded 50933 primary data records. [2025-09-29T02:24:51.891074] [DEBUG] [LOCAL ] VYX: Loaded 49624 existing records from primary storage. [2025-09-29T02:24:51.898052] [INFO ] [MAIN ] VYX: Loaded 49624 primary data records. [2025-09-29T02:24:52.474879] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:52.476740] [INFO ] [MAIN ] VVX: Generated 1820 derivative records from 23664 primary records. [2025-09-29T02:24:52.477359] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-29T02:24:52.513202] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:52.512739] [DEBUG] [LOCAL ] VVX: Derivative data saved (1820 records). [2025-09-29T02:24:52.513432] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-29T02:24:52.515760] [INFO ] [MAIN ] Derivative Progress: 2110/2211 symbols completed. VVX took 1.2s. Estimated remaining: 42.9s. Rate: 141.4 symbols/min [2025-09-29T02:24:52.516771] [INFO ] [MAIN ] VVV: Generated 1820 derivative records from 50933 primary records. [2025-09-29T02:24:52.517101] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-29T02:24:52.518091] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:52.536043] [DEBUG] [LOCAL ] VVV: Derivative data saved (1820 records). [2025-09-29T02:24:52.538154] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-29T02:24:52.541344] [INFO ] [MAIN ] Derivative Progress: 2111/2211 symbols completed. VVV took 1.2s. Estimated remaining: 42.4s. Rate: 141.4 symbols/min [2025-09-29T02:24:52.541914] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:52.555622] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:52.556913] [INFO ] [MAIN ] VYX: Generated 1820 derivative records from 49624 primary records. [2025-09-29T02:24:52.557048] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-29T02:24:52.580777] [DEBUG] [LOCAL ] VYX: Derivative data saved (1820 records). [2025-09-29T02:24:52.581294] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-29T02:24:52.585183] [INFO ] [MAIN ] Derivative Progress: 2112/2211 symbols completed. VYX took 1.2s. Estimated remaining: 42.0s. Rate: 141.5 symbols/min [2025-09-29T02:24:52.585521] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:52.643928] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-29T02:24:52.644287] [INFO ] [MAIN ] VZ: Loaded 54571 primary data records. [2025-09-29T02:24:52.793542] [DEBUG] [LOCAL ] W: Loaded 54266 existing records from primary storage. [2025-09-29T02:24:52.835478] [DEBUG] [LOCAL ] WAB: Loaded 44872 existing records from primary storage. [2025-09-29T02:24:52.866114] [INFO ] [MAIN ] W: Loaded 54266 primary data records. [2025-09-29T02:24:52.892909] [INFO ] [MAIN ] WAB: Loaded 44872 primary data records. [2025-09-29T02:24:53.762384] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:53.765496] [INFO ] [MAIN ] VZ: Generated 1820 derivative records from 54571 primary records. [2025-09-29T02:24:53.766512] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-29T02:24:53.785361] [DEBUG] [LOCAL ] VZ: Derivative data saved (1820 records). [2025-09-29T02:24:53.786010] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-29T02:24:53.788361] [INFO ] [MAIN ] Derivative Progress: 2113/2211 symbols completed. VZ took 1.3s. Estimated remaining: 41.6s. Rate: 141.4 symbols/min [2025-09-29T02:24:53.807979] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:53.821894] [INFO ] [MAIN ] W: Generated 1820 derivative records from 54266 primary records. [2025-09-29T02:24:53.822265] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-29T02:24:53.822716] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:53.824269] [INFO ] [MAIN ] WAB: Generated 1820 derivative records from 44872 primary records. [2025-09-29T02:24:53.824628] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-29T02:24:53.841019] [DEBUG] [LOCAL ] W: Derivative data saved (1820 records). [2025-09-29T02:24:53.841361] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-29T02:24:53.851910] [INFO ] [MAIN ] Derivative Progress: 2114/2211 symbols completed. W took 1.3s. Estimated remaining: 41.2s. Rate: 141.4 symbols/min [2025-09-29T02:24:53.860344] [DEBUG] [LOCAL ] WAB: Derivative data saved (1820 records). [2025-09-29T02:24:53.860478] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-29T02:24:53.863360] [INFO ] [MAIN ] Derivative Progress: 2115/2211 symbols completed. WAB took 1.3s. Estimated remaining: 40.7s. Rate: 141.5 symbols/min [2025-09-29T02:24:53.864108] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:53.863946] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:53.863879] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:53.947736] [DEBUG] [LOCAL ] WAT: Loaded 35620 existing records from primary storage. [2025-09-29T02:24:53.949207] [DEBUG] [LOCAL ] WAL: Loaded 46040 existing records from primary storage. [2025-09-29T02:24:53.949549] [INFO ] [MAIN ] WAT: Loaded 35620 primary data records. [2025-09-29T02:24:53.949899] [INFO ] [MAIN ] WAL: Loaded 46040 primary data records. [2025-09-29T02:24:54.170518] [DEBUG] [LOCAL ] WBS: Loaded 49471 existing records from primary storage. [2025-09-29T02:24:54.180038] [INFO ] [MAIN ] WBS: Loaded 49471 primary data records. [2025-09-29T02:24:55.052959] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:55.054372] [INFO ] [MAIN ] WAL: Generated 1820 derivative records from 46040 primary records. [2025-09-29T02:24:55.054624] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-29T02:24:55.076056] [DEBUG] [LOCAL ] WAL: Derivative data saved (1820 records). [2025-09-29T02:24:55.076789] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-29T02:24:55.087439] [INFO ] [MAIN ] Derivative Progress: 2116/2211 symbols completed. WAL took 1.2s. Estimated remaining: 40.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:55.093247] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:55.093638] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:55.094780] [INFO ] [MAIN ] WAT: Generated 1820 derivative records from 35620 primary records. [2025-09-29T02:24:55.096130] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-29T02:24:55.134390] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:55.134026] [DEBUG] [LOCAL ] WAT: Derivative data saved (1820 records). [2025-09-29T02:24:55.135483] [INFO ] [MAIN ] WBS: Generated 1820 derivative records from 49471 primary records. [2025-09-29T02:24:55.134637] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-29T02:24:55.138525] [INFO ] [MAIN ] Derivative Progress: 2117/2211 symbols completed. WAT took 1.3s. Estimated remaining: 39.9s. Rate: 141.4 symbols/min [2025-09-29T02:24:55.138619] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-29T02:24:55.138888] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:55.146346] [DEBUG] [LOCAL ] WBX: Loaded 12558 existing records from primary storage. [2025-09-29T02:24:55.158571] [INFO ] [MAIN ] WBX: Loaded 12558 primary data records. [2025-09-29T02:24:55.280507] [DEBUG] [LOCAL ] WBS: Derivative data saved (1820 records). [2025-09-29T02:24:55.369318] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-29T02:24:55.495421] [INFO ] [MAIN ] Derivative Progress: 2118/2211 symbols completed. WBS took 1.6s. Estimated remaining: 39.5s. Rate: 141.4 symbols/min [2025-09-29T02:24:55.505293] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:55.523907] [DEBUG] [LOCAL ] WCC: Loaded 40567 existing records from primary storage. [2025-09-29T02:24:55.524835] [INFO ] [MAIN ] WCC: Loaded 40567 primary data records. [2025-09-29T02:24:55.900819] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:55.902511] [INFO ] [MAIN ] WBX: Generated 1820 derivative records from 12558 primary records. [2025-09-29T02:24:55.917409] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-29T02:24:55.923248] [DEBUG] [LOCAL ] WCN: Loaded 48708 existing records from primary storage. [2025-09-29T02:24:55.937734] [INFO ] [MAIN ] WCN: Loaded 48708 primary data records. [2025-09-29T02:24:55.939052] [DEBUG] [LOCAL ] WBX: Derivative data saved (1820 records). [2025-09-29T02:24:55.939308] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-29T02:24:55.989892] [INFO ] [MAIN ] Derivative Progress: 2119/2211 symbols completed. WBX took 0.9s. Estimated remaining: 39.0s. Rate: 141.4 symbols/min [2025-09-29T02:24:56.027183] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:56.321276] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:56.322219] [DEBUG] [LOCAL ] WD: Loaded 23747 existing records from primary storage. [2025-09-29T02:24:56.323942] [INFO ] [MAIN ] WD: Loaded 23747 primary data records. [2025-09-29T02:24:56.323515] [INFO ] [MAIN ] WCC: Generated 1820 derivative records from 40567 primary records. [2025-09-29T02:24:56.324395] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-29T02:24:56.455207] [DEBUG] [LOCAL ] WCC: Derivative data saved (1820 records). [2025-09-29T02:24:56.465809] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-29T02:24:56.500456] [INFO ] [MAIN ] Derivative Progress: 2120/2211 symbols completed. WCC took 1.4s. Estimated remaining: 38.6s. Rate: 141.4 symbols/min [2025-09-29T02:24:56.538891] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:56.690387] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:56.692996] [INFO ] [MAIN ] WCN: Generated 1820 derivative records from 48708 primary records. [2025-09-29T02:24:56.693317] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-29T02:24:56.725382] [DEBUG] [LOCAL ] WDH: Loaded 17597 existing records from primary storage. [2025-09-29T02:24:56.727211] [DEBUG] [LOCAL ] WCN: Derivative data saved (1820 records). [2025-09-29T02:24:56.727392] [INFO ] [MAIN ] WDH: Loaded 17597 primary data records. [2025-09-29T02:24:56.727599] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-29T02:24:56.735497] [INFO ] [MAIN ] Derivative Progress: 2121/2211 symbols completed. WCN took 1.2s. Estimated remaining: 38.2s. Rate: 141.4 symbols/min [2025-09-29T02:24:56.756444] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:57.091863] [DEBUG] [LOCAL ] WDI: Loaded 21314 existing records from primary storage. [2025-09-29T02:24:57.102605] [INFO ] [MAIN ] WDI: Loaded 21314 primary data records. [2025-09-29T02:24:57.103054] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:57.139676] [INFO ] [MAIN ] WD: Generated 1820 derivative records from 23747 primary records. [2025-09-29T02:24:57.190975] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-29T02:24:57.244348] [DEBUG] [LOCAL ] WD: Derivative data saved (1820 records). [2025-09-29T02:24:57.244886] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-29T02:24:57.247986] [INFO ] [MAIN ] Derivative Progress: 2122/2211 symbols completed. WD took 1.2s. Estimated remaining: 37.8s. Rate: 141.4 symbols/min [2025-09-29T02:24:57.248281] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:57.537760] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:57.539883] [INFO ] [MAIN ] WDH: Generated 1820 derivative records from 17597 primary records. [2025-09-29T02:24:57.540057] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-29T02:24:57.573305] [DEBUG] [LOCAL ] WDH: Derivative data saved (1820 records). [2025-09-29T02:24:57.574073] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-29T02:24:57.577625] [INFO ] [MAIN ] Derivative Progress: 2123/2211 symbols completed. WDH took 1.0s. Estimated remaining: 37.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:57.578217] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:57.616026] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:57.618531] [INFO ] [MAIN ] WDI: Generated 1820 derivative records from 21314 primary records. [2025-09-29T02:24:57.619396] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-29T02:24:57.617420] [DEBUG] [LOCAL ] WDS: Loaded 44259 existing records from primary storage. [2025-09-29T02:24:57.624551] [DEBUG] [LOCAL ] WEA: Loaded 7379 existing records from primary storage. [2025-09-29T02:24:57.624949] [INFO ] [MAIN ] WDS: Loaded 44259 primary data records. [2025-09-29T02:24:57.634413] [INFO ] [MAIN ] WEA: Loaded 7379 primary data records. [2025-09-29T02:24:57.770103] [DEBUG] [LOCAL ] WDI: Derivative data saved (1820 records). [2025-09-29T02:24:57.827404] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-29T02:24:57.862750] [INFO ] [MAIN ] Derivative Progress: 2124/2211 symbols completed. WDI took 1.1s. Estimated remaining: 36.9s. Rate: 141.5 symbols/min [2025-09-29T02:24:57.889130] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:58.368092] [DEBUG] [LOCAL ] WEAV: Loaded 42562 existing records from primary storage. [2025-09-29T02:24:58.368557] [INFO ] [MAIN ] WEAV: Loaded 42562 primary data records. [2025-09-29T02:24:58.460094] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:58.487101] [INFO ] [MAIN ] WDS: Generated 1820 derivative records from 44259 primary records. [2025-09-29T02:24:58.510236] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-29T02:24:58.557072] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:58.575335] [INFO ] [MAIN ] WEA: Generated 1820 derivative records from 7379 primary records. [2025-09-29T02:24:58.617160] [DEBUG] [LOCAL ] WDS: Derivative data saved (1820 records). [2025-09-29T02:24:58.636392] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-29T02:24:58.639127] [INFO ] [MAIN ] Derivative Progress: 2125/2211 symbols completed. WDS took 1.4s. Estimated remaining: 36.5s. Rate: 141.4 symbols/min [2025-09-29T02:24:58.633157] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-29T02:24:58.644356] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:58.797837] [DEBUG] [LOCAL ] WEA: Derivative data saved (1820 records). [2025-09-29T02:24:58.798366] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-29T02:24:58.801829] [INFO ] [MAIN ] Derivative Progress: 2126/2211 symbols completed. WEA took 1.2s. Estimated remaining: 36.1s. Rate: 141.4 symbols/min [2025-09-29T02:24:58.803084] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:58.834797] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:58.836435] [INFO ] [MAIN ] WEAV: Generated 1820 derivative records from 42562 primary records. [2025-09-29T02:24:58.836603] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-29T02:24:58.869169] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1820 records). [2025-09-29T02:24:58.869586] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-29T02:24:58.872442] [INFO ] [MAIN ] Derivative Progress: 2127/2211 symbols completed. WEAV took 1.0s. Estimated remaining: 35.6s. Rate: 141.5 symbols/min [2025-09-29T02:24:58.872770] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:58.896376] [DEBUG] [LOCAL ] WEC: Loaded 52958 existing records from primary storage. [2025-09-29T02:24:58.911753] [INFO ] [MAIN ] WEC: Loaded 52958 primary data records. [2025-09-29T02:24:59.046990] [DEBUG] [LOCAL ] WELL: Loaded 53132 existing records from primary storage. [2025-09-29T02:24:59.047899] [INFO ] [MAIN ] WELL: Loaded 53132 primary data records. [2025-09-29T02:24:59.425350] [DEBUG] [LOCAL ] WES: Loaded 48689 existing records from primary storage. [2025-09-29T02:24:59.439325] [INFO ] [MAIN ] WES: Loaded 48689 primary data records. [2025-09-29T02:25:00.141059] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:00.142443] [INFO ] [MAIN ] WEC: Generated 1820 derivative records from 52958 primary records. [2025-09-29T02:25:00.142586] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-29T02:25:00.176374] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:00.178462] [INFO ] [MAIN ] WELL: Generated 1820 derivative records from 53132 primary records. [2025-09-29T02:25:00.178661] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-29T02:25:00.182727] [DEBUG] [LOCAL ] WEC: Derivative data saved (1820 records). [2025-09-29T02:25:00.182981] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-29T02:25:00.194483] [INFO ] [MAIN ] Derivative Progress: 2128/2211 symbols completed. WEC took 1.6s. Estimated remaining: 35.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:00.203983] [DEBUG] [LOCAL ] WELL: Derivative data saved (1820 records). [2025-09-29T02:25:00.204444] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-29T02:25:00.207940] [INFO ] [MAIN ] Derivative Progress: 2129/2211 symbols completed. WELL took 1.4s. Estimated remaining: 34.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:00.224733] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:00.225561] [INFO ] [MAIN ] WES: Generated 1820 derivative records from 48689 primary records. [2025-09-29T02:25:00.225670] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-29T02:25:00.241990] [DEBUG] [LOCAL ] WES: Derivative data saved (1820 records). [2025-09-29T02:25:00.242150] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-29T02:25:00.245297] [INFO ] [MAIN ] Derivative Progress: 2130/2211 symbols completed. WES took 1.4s. Estimated remaining: 34.4s. Rate: 141.5 symbols/min [2025-09-29T02:25:00.246133] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:00.246203] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:00.246033] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:00.266936] [DEBUG] [LOCAL ] WF: Loaded 10903 existing records from primary storage. [2025-09-29T02:25:00.267277] [INFO ] [MAIN ] WF: Loaded 10903 primary data records. [2025-09-29T02:25:00.445638] [DEBUG] [LOCAL ] WEX: Loaded 35697 existing records from primary storage. [2025-09-29T02:25:00.520706] [INFO ] [MAIN ] WEX: Loaded 35697 primary data records. [2025-09-29T02:25:00.779582] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-29T02:25:00.784968] [INFO ] [MAIN ] WFC: Loaded 54528 primary data records. [2025-09-29T02:25:01.397003] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:01.398142] [INFO ] [MAIN ] WF: Generated 1820 derivative records from 10903 primary records. [2025-09-29T02:25:01.399788] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-29T02:25:01.420450] [DEBUG] [LOCAL ] WF: Derivative data saved (1820 records). [2025-09-29T02:25:01.421542] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-29T02:25:01.425719] [INFO ] [MAIN ] Derivative Progress: 2131/2211 symbols completed. WF took 1.2s. Estimated remaining: 34.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:01.426597] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:01.448239] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:01.450151] [INFO ] [MAIN ] WEX: Generated 1820 derivative records from 35697 primary records. [2025-09-29T02:25:01.450527] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-29T02:25:01.478588] [DEBUG] [LOCAL ] WEX: Derivative data saved (1820 records). [2025-09-29T02:25:01.479111] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-29T02:25:01.481806] [INFO ] [MAIN ] Derivative Progress: 2132/2211 symbols completed. WEX took 1.2s. Estimated remaining: 33.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:01.482437] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:01.497356] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:01.508281] [INFO ] [MAIN ] WFC: Generated 1820 derivative records from 54528 primary records. [2025-09-29T02:25:01.509112] [DEBUG] [LOCAL ] WFG: Loaded 25211 existing records from primary storage. [2025-09-29T02:25:01.509468] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-29T02:25:01.509624] [INFO ] [MAIN ] WFG: Loaded 25211 primary data records. [2025-09-29T02:25:01.648941] [DEBUG] [LOCAL ] WFC: Derivative data saved (1820 records). [2025-09-29T02:25:01.658610] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-29T02:25:01.663041] [INFO ] [MAIN ] Derivative Progress: 2133/2211 symbols completed. WFC took 1.4s. Estimated remaining: 33.1s. Rate: 141.5 symbols/min [2025-09-29T02:25:01.684978] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:01.939460] [DEBUG] [LOCAL ] WGO: Loaded 39823 existing records from primary storage. [2025-09-29T02:25:01.939953] [INFO ] [MAIN ] WGO: Loaded 39823 primary data records. [2025-09-29T02:25:02.319463] [DEBUG] [LOCAL ] WH: Loaded 46339 existing records from primary storage. [2025-09-29T02:25:02.320434] [INFO ] [MAIN ] WH: Loaded 46339 primary data records. [2025-09-29T02:25:02.554537] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:02.686111] [INFO ] [MAIN ] WFG: Generated 1820 derivative records from 25211 primary records. [2025-09-29T02:25:02.686906] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-29T02:25:02.711596] [DEBUG] [LOCAL ] WFG: Derivative data saved (1820 records). [2025-09-29T02:25:02.713218] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-29T02:25:02.716629] [INFO ] [MAIN ] Derivative Progress: 2134/2211 symbols completed. WFG took 1.3s. Estimated remaining: 32.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:02.717395] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:02.741374] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:02.742453] [INFO ] [MAIN ] WGO: Generated 1820 derivative records from 39823 primary records. [2025-09-29T02:25:02.742777] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-29T02:25:02.764182] [DEBUG] [LOCAL ] WGO: Derivative data saved (1820 records). [2025-09-29T02:25:02.764595] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-29T02:25:02.768167] [INFO ] [MAIN ] Derivative Progress: 2135/2211 symbols completed. WGO took 1.3s. Estimated remaining: 32.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:02.768603] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:02.783363] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:02.784594] [INFO ] [MAIN ] WH: Generated 1820 derivative records from 46339 primary records. [2025-09-29T02:25:02.796088] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-29T02:25:02.808135] [DEBUG] [LOCAL ] WHG: Loaded 3416 existing records from primary storage. [2025-09-29T02:25:02.824143] [INFO ] [MAIN ] WHG: Loaded 3416 primary data records. [2025-09-29T02:25:02.824341] [DEBUG] [LOCAL ] WH: Derivative data saved (1820 records). [2025-09-29T02:25:02.843458] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-29T02:25:02.854891] [INFO ] [MAIN ] Derivative Progress: 2136/2211 symbols completed. WH took 1.2s. Estimated remaining: 31.8s. Rate: 141.5 symbols/min [2025-09-29T02:25:02.855238] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:02.868515] [DEBUG] [LOCAL ] WHD: Loaded 41130 existing records from primary storage. [2025-09-29T02:25:02.925129] [INFO ] [MAIN ] WHD: Loaded 41130 primary data records. [2025-09-29T02:25:03.544336] [DEBUG] [LOCAL ] WHR: Loaded 48846 existing records from primary storage. [2025-09-29T02:25:03.545384] [INFO ] [MAIN ] WHR: Loaded 48846 primary data records. [2025-09-29T02:25:03.979555] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:25:03.982062] [INFO ] [MAIN ] WHG: Generated 1819 derivative records from 3416 primary records. [2025-09-29T02:25:03.982698] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-29T02:25:04.007974] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:04.013239] [INFO ] [MAIN ] WHD: Generated 1820 derivative records from 41130 primary records. [2025-09-29T02:25:04.014146] [DEBUG] [LOCAL ] WHG: Derivative data saved (1819 records). [2025-09-29T02:25:04.014387] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-29T02:25:04.014485] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-29T02:25:04.017241] [INFO ] [MAIN ] Derivative Progress: 2137/2211 symbols completed. WHG took 1.2s. Estimated remaining: 31.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:04.017877] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:04.042423] [DEBUG] [LOCAL ] WIA: Loaded 4937 existing records from primary storage. [2025-09-29T02:25:04.039135] [DEBUG] [LOCAL ] WHD: Derivative data saved (1820 records). [2025-09-29T02:25:04.042619] [INFO ] [MAIN ] WIA: Loaded 4937 primary data records. [2025-09-29T02:25:04.048076] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-29T02:25:04.108637] [INFO ] [MAIN ] Derivative Progress: 2138/2211 symbols completed. WHD took 1.4s. Estimated remaining: 31.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:04.142394] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:04.181103] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:04.204619] [INFO ] [MAIN ] WHR: Generated 1820 derivative records from 48846 primary records. [2025-09-29T02:25:04.248702] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-29T02:25:04.407592] [DEBUG] [LOCAL ] WINN: Loaded 11944 existing records from primary storage. [2025-09-29T02:25:04.408111] [INFO ] [MAIN ] WINN: Loaded 11944 primary data records. [2025-09-29T02:25:04.495423] [DEBUG] [LOCAL ] WHR: Derivative data saved (1820 records). [2025-09-29T02:25:04.512078] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-29T02:25:04.515230] [INFO ] [MAIN ] Derivative Progress: 2139/2211 symbols completed. WHR took 1.7s. Estimated remaining: 30.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:04.525054] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:04.880703] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:04.885350] [INFO ] [MAIN ] WIA: Generated 1820 derivative records from 4937 primary records. [2025-09-29T02:25:04.887460] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-29T02:25:04.905533] [DEBUG] [LOCAL ] WIA: Derivative data saved (1820 records). [2025-09-29T02:25:04.905822] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-29T02:25:04.927987] [INFO ] [MAIN ] Derivative Progress: 2140/2211 symbols completed. WIA took 0.9s. Estimated remaining: 30.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:04.928241] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:04.931698] [DEBUG] [LOCAL ] WIT: Loaded 53070 existing records from primary storage. [2025-09-29T02:25:04.932474] [INFO ] [MAIN ] WIT: Loaded 53070 primary data records. [2025-09-29T02:25:05.075928] [DEBUG] [LOCAL ] WIW: Loaded 20756 existing records from primary storage. [2025-09-29T02:25:05.076715] [INFO ] [MAIN ] WIW: Loaded 20756 primary data records. [2025-09-29T02:25:05.165736] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:25:05.212613] [INFO ] [MAIN ] WINN: Generated 1819 derivative records from 11944 primary records. [2025-09-29T02:25:05.398375] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-29T02:25:05.686344] [DEBUG] [LOCAL ] WINN: Derivative data saved (1819 records). [2025-09-29T02:25:05.686606] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-29T02:25:05.690674] [INFO ] [MAIN ] Derivative Progress: 2141/2211 symbols completed. WINN took 1.5s. Estimated remaining: 29.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:05.691732] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:05.720518] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:05.721418] [INFO ] [MAIN ] WIT: Generated 1820 derivative records from 53070 primary records. [2025-09-29T02:25:05.721726] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-29T02:25:05.767871] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:05.770513] [INFO ] [MAIN ] WIW: Generated 1820 derivative records from 20756 primary records. [2025-09-29T02:25:05.770713] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-29T02:25:05.771479] [DEBUG] [LOCAL ] WIT: Derivative data saved (1820 records). [2025-09-29T02:25:05.772812] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-29T02:25:05.777177] [INFO ] [MAIN ] Derivative Progress: 2142/2211 symbols completed. WIT took 1.3s. Estimated remaining: 29.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:05.778630] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:05.795362] [DEBUG] [LOCAL ] WIW: Derivative data saved (1820 records). [2025-09-29T02:25:05.795744] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-29T02:25:05.799388] [INFO ] [MAIN ] Derivative Progress: 2143/2211 symbols completed. WIW took 0.9s. Estimated remaining: 28.8s. Rate: 141.5 symbols/min [2025-09-29T02:25:05.817237] [DEBUG] [LOCAL ] WK: Loaded 37342 existing records from primary storage. [2025-09-29T02:25:05.817780] [INFO ] [MAIN ] WK: Loaded 37342 primary data records. [2025-09-29T02:25:06.183762] [DEBUG] [LOCAL ] WKC: Loaded 35538 existing records from primary storage. [2025-09-29T02:25:06.185101] [INFO ] [MAIN ] WKC: Loaded 35538 primary data records. [2025-09-29T02:25:06.587014] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:06.588496] [INFO ] [MAIN ] WK: Generated 1820 derivative records from 37342 primary records. [2025-09-29T02:25:06.588592] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-29T02:25:06.607427] [DEBUG] [LOCAL ] WK: Derivative data saved (1820 records). [2025-09-29T02:25:06.607750] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-29T02:25:06.610619] [INFO ] [MAIN ] Derivative Progress: 2144/2211 symbols completed. WK took 0.9s. Estimated remaining: 28.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:06.627732] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:06.628521] [INFO ] [MAIN ] WKC: Generated 1820 derivative records from 35538 primary records. [2025-09-29T02:25:06.628609] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-29T02:25:06.645171] [DEBUG] [LOCAL ] WKC: Derivative data saved (1820 records). [2025-09-29T02:25:06.645335] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-29T02:25:06.648383] [INFO ] [MAIN ] Derivative Progress: 2145/2211 symbols completed. WKC took 0.9s. Estimated remaining: 28.0s. Rate: 141.5 symbols/min [2025-09-29T02:25:06.649132] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:06.648974] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:06.649248] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:06.665152] [DEBUG] [LOCAL ] WLKP: Loaded 6800 existing records from primary storage. [2025-09-29T02:25:06.665594] [INFO ] [MAIN ] WLKP: Loaded 6800 primary data records. [2025-09-29T02:25:07.054397] [DEBUG] [LOCAL ] WLY: Loaded 30414 existing records from primary storage. [2025-09-29T02:25:07.065033] [INFO ] [MAIN ] WLY: Loaded 30414 primary data records. [2025-09-29T02:25:07.071577] [DEBUG] [LOCAL ] WLK: Loaded 46113 existing records from primary storage. [2025-09-29T02:25:07.084711] [INFO ] [MAIN ] WLK: Loaded 46113 primary data records. [2025-09-29T02:25:07.784036] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:07.785512] [INFO ] [MAIN ] WLKP: Generated 1820 derivative records from 6800 primary records. [2025-09-29T02:25:07.785818] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-29T02:25:07.805725] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1820 records). [2025-09-29T02:25:07.806459] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-29T02:25:07.809583] [INFO ] [MAIN ] Derivative Progress: 2146/2211 symbols completed. WLKP took 1.2s. Estimated remaining: 27.6s. Rate: 141.4 symbols/min [2025-09-29T02:25:07.810130] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:07.828379] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:07.829625] [INFO ] [MAIN ] WLY: Generated 1820 derivative records from 30414 primary records. [2025-09-29T02:25:07.830009] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-29T02:25:07.863131] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:07.866045] [INFO ] [MAIN ] WLK: Generated 1820 derivative records from 46113 primary records. [2025-09-29T02:25:07.868552] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-29T02:25:07.869331] [DEBUG] [LOCAL ] WLY: Derivative data saved (1820 records). [2025-09-29T02:25:07.869739] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-29T02:25:07.872968] [INFO ] [MAIN ] Derivative Progress: 2147/2211 symbols completed. WLY took 1.2s. Estimated remaining: 27.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:07.873663] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:07.890071] [DEBUG] [LOCAL ] WLK: Derivative data saved (1820 records). [2025-09-29T02:25:07.890226] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-29T02:25:07.894043] [INFO ] [MAIN ] Derivative Progress: 2148/2211 symbols completed. WLK took 1.2s. Estimated remaining: 26.7s. Rate: 141.5 symbols/min [2025-09-29T02:25:07.894464] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:07.932731] [DEBUG] [LOCAL ] WMK: Loaded 14753 existing records from primary storage. [2025-09-29T02:25:07.947870] [INFO ] [MAIN ] WMK: Loaded 14753 primary data records. [2025-09-29T02:25:07.954535] [DEBUG] [LOCAL ] WM: Loaded 51697 existing records from primary storage. [2025-09-29T02:25:07.988804] [INFO ] [MAIN ] WM: Loaded 51697 primary data records. [2025-09-29T02:25:08.337496] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-29T02:25:08.520249] [INFO ] [MAIN ] WMB: Loaded 54451 primary data records. [2025-09-29T02:25:09.065340] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:09.066796] [INFO ] [MAIN ] WMK: Generated 1820 derivative records from 14753 primary records. [2025-09-29T02:25:09.067080] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-29T02:25:09.102121] [DEBUG] [LOCAL ] WMK: Derivative data saved (1820 records). [2025-09-29T02:25:09.103309] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-29T02:25:09.106274] [INFO ] [MAIN ] Derivative Progress: 2149/2211 symbols completed. WMK took 1.2s. Estimated remaining: 26.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:09.106916] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:09.103818] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:09.108563] [INFO ] [MAIN ] WM: Generated 1820 derivative records from 51697 primary records. [2025-09-29T02:25:09.108810] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-29T02:25:09.135754] [DEBUG] [LOCAL ] WM: Derivative data saved (1820 records). [2025-09-29T02:25:09.149260] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-29T02:25:09.149628] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:09.154337] [INFO ] [MAIN ] WMB: Generated 1820 derivative records from 54451 primary records. [2025-09-29T02:25:09.153274] [INFO ] [MAIN ] Derivative Progress: 2150/2211 symbols completed. WM took 1.3s. Estimated remaining: 25.9s. Rate: 141.4 symbols/min [2025-09-29T02:25:09.154612] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:09.154675] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-29T02:25:09.183451] [DEBUG] [LOCAL ] WMB: Derivative data saved (1820 records). [2025-09-29T02:25:09.183975] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-29T02:25:09.187328] [INFO ] [MAIN ] Derivative Progress: 2151/2211 symbols completed. WMB took 1.3s. Estimated remaining: 25.4s. Rate: 141.5 symbols/min [2025-09-29T02:25:09.187749] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:09.210493] [DEBUG] [LOCAL ] WMS: Loaded 40249 existing records from primary storage. [2025-09-29T02:25:09.210737] [INFO ] [MAIN ] WMS: Loaded 40249 primary data records. [2025-09-29T02:25:09.609612] [DEBUG] [LOCAL ] WNC: Loaded 40452 existing records from primary storage. [2025-09-29T02:25:09.609918] [INFO ] [MAIN ] WNC: Loaded 40452 primary data records. [2025-09-29T02:25:09.611021] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-29T02:25:09.624103] [INFO ] [MAIN ] WMT: Loaded 54580 primary data records. [2025-09-29T02:25:10.325157] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:25:10.326961] [INFO ] [MAIN ] WMS: Generated 1819 derivative records from 40249 primary records. [2025-09-29T02:25:10.327433] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-29T02:25:10.348998] [DEBUG] [LOCAL ] WMS: Derivative data saved (1819 records). [2025-09-29T02:25:10.349744] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-29T02:25:10.352894] [INFO ] [MAIN ] Derivative Progress: 2152/2211 symbols completed. WMS took 1.2s. Estimated remaining: 25.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:10.353943] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:10.388637] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:10.389360] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:10.390532] [INFO ] [MAIN ] WNC: Generated 1820 derivative records from 40452 primary records. [2025-09-29T02:25:10.391432] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-29T02:25:10.391337] [INFO ] [MAIN ] WMT: Generated 1820 derivative records from 54580 primary records. [2025-09-29T02:25:10.392590] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-29T02:25:10.433892] [DEBUG] [LOCAL ] WNC: Derivative data saved (1820 records). [2025-09-29T02:25:10.438715] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-29T02:25:10.439404] [DEBUG] [LOCAL ] WMT: Derivative data saved (1820 records). [2025-09-29T02:25:10.439684] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-29T02:25:10.442441] [INFO ] [MAIN ] Derivative Progress: 2153/2211 symbols completed. WNC took 1.3s. Estimated remaining: 24.6s. Rate: 141.4 symbols/min [2025-09-29T02:25:10.446123] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:10.446230] [INFO ] [MAIN ] Derivative Progress: 2154/2211 symbols completed. WMT took 1.3s. Estimated remaining: 24.2s. Rate: 141.5 symbols/min [2025-09-29T02:25:10.446579] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:10.463944] [DEBUG] [LOCAL ] WNS: Loaded 40539 existing records from primary storage. [2025-09-29T02:25:10.464297] [INFO ] [MAIN ] WNS: Loaded 40539 primary data records. [2025-09-29T02:25:10.848078] [DEBUG] [LOCAL ] WOR: Loaded 25288 existing records from primary storage. [2025-09-29T02:25:10.879252] [INFO ] [MAIN ] WOR: Loaded 25288 primary data records. [2025-09-29T02:25:10.880461] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-29T02:25:10.880866] [INFO ] [MAIN ] WOLF: Loaded 54312 primary data records. [2025-09-29T02:25:11.682354] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:11.684676] [INFO ] [MAIN ] WNS: Generated 1820 derivative records from 40539 primary records. [2025-09-29T02:25:11.685165] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-29T02:25:11.708690] [DEBUG] [LOCAL ] WNS: Derivative data saved (1820 records). [2025-09-29T02:25:11.709700] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-29T02:25:11.713501] [INFO ] [MAIN ] Derivative Progress: 2155/2211 symbols completed. WNS took 1.4s. Estimated remaining: 23.8s. Rate: 141.3 symbols/min [2025-09-29T02:25:11.714419] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:11.741267] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:11.742590] [INFO ] [MAIN ] WOLF: Generated 1820 derivative records from 54312 primary records. [2025-09-29T02:25:11.756876] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-29T02:25:11.757476] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:11.778032] [INFO ] [MAIN ] WOR: Generated 1820 derivative records from 25288 primary records. [2025-09-29T02:25:11.783210] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-29T02:25:11.811339] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1820 records). [2025-09-29T02:25:11.812280] [DEBUG] [LOCAL ] WOW: Loaded 30769 existing records from primary storage. [2025-09-29T02:25:11.812841] [INFO ] [MAIN ] WOW: Loaded 30769 primary data records. [2025-09-29T02:25:11.813268] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-29T02:25:11.828546] [INFO ] [MAIN ] Derivative Progress: 2156/2211 symbols completed. WOLF took 1.4s. Estimated remaining: 23.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:11.868838] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:11.882436] [DEBUG] [LOCAL ] WOR: Derivative data saved (1820 records). [2025-09-29T02:25:11.917386] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-29T02:25:11.937914] [INFO ] [MAIN ] Derivative Progress: 2157/2211 symbols completed. WOR took 1.5s. Estimated remaining: 22.9s. Rate: 141.4 symbols/min [2025-09-29T02:25:11.951544] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:12.224966] [DEBUG] [LOCAL ] WPC: Loaded 49217 existing records from primary storage. [2025-09-29T02:25:12.225474] [INFO ] [MAIN ] WPC: Loaded 49217 primary data records. [2025-09-29T02:25:12.343136] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:12.349204] [DEBUG] [LOCAL ] WPM: Loaded 53504 existing records from primary storage. [2025-09-29T02:25:12.378337] [INFO ] [MAIN ] WPM: Loaded 53504 primary data records. [2025-09-29T02:25:12.379972] [INFO ] [MAIN ] WOW: Generated 1820 derivative records from 30769 primary records. [2025-09-29T02:25:12.403071] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-29T02:25:12.582898] [DEBUG] [LOCAL ] WOW: Derivative data saved (1820 records). [2025-09-29T02:25:12.712406] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-29T02:25:12.745613] [INFO ] [MAIN ] Derivative Progress: 2158/2211 symbols completed. WOW took 1.0s. Estimated remaining: 22.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:13.048954] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:13.050200] [INFO ] [MAIN ] WPC: Generated 1820 derivative records from 49217 primary records. [2025-09-29T02:25:13.050298] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-29T02:25:13.069434] [DEBUG] [LOCAL ] WPC: Derivative data saved (1820 records). [2025-09-29T02:25:13.069946] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-29T02:25:13.072546] [INFO ] [MAIN ] Derivative Progress: 2159/2211 symbols completed. WPC took 1.2s. Estimated remaining: 22.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:13.089114] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:13.089984] [INFO ] [MAIN ] WPM: Generated 1820 derivative records from 53504 primary records. [2025-09-29T02:25:13.090107] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-29T02:25:13.106781] [DEBUG] [LOCAL ] WPM: Derivative data saved (1820 records). [2025-09-29T02:25:13.106979] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-29T02:25:13.110036] [INFO ] [MAIN ] Derivative Progress: 2160/2211 symbols completed. WPM took 1.2s. Estimated remaining: 21.6s. Rate: 141.5 symbols/min [2025-09-29T02:25:13.110768] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:13.110872] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:13.110938] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:13.168966] [DEBUG] [LOCAL ] WPP: Loaded 34282 existing records from primary storage. [2025-09-29T02:25:13.169395] [INFO ] [MAIN ] WPP: Loaded 34282 primary data records. [2025-09-29T02:25:13.319957] [DEBUG] [LOCAL ] WRBY: Loaded 51609 existing records from primary storage. [2025-09-29T02:25:13.321553] [INFO ] [MAIN ] WRBY: Loaded 51609 primary data records. [2025-09-29T02:25:13.368669] [DEBUG] [LOCAL ] WRB: Loaded 51313 existing records from primary storage. [2025-09-29T02:25:13.392909] [INFO ] [MAIN ] WRB: Loaded 51313 primary data records. [2025-09-29T02:25:14.284164] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:14.287527] [INFO ] [MAIN ] WPP: Generated 1820 derivative records from 34282 primary records. [2025-09-29T02:25:14.287840] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-29T02:25:14.309793] [DEBUG] [LOCAL ] WPP: Derivative data saved (1820 records). [2025-09-29T02:25:14.310768] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-29T02:25:14.313495] [INFO ] [MAIN ] Derivative Progress: 2161/2211 symbols completed. WPP took 1.2s. Estimated remaining: 21.2s. Rate: 141.3 symbols/min [2025-09-29T02:25:14.314011] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:14.350206] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:14.350574] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:14.352328] [INFO ] [MAIN ] WRB: Generated 1820 derivative records from 51313 primary records. [2025-09-29T02:25:14.351633] [INFO ] [MAIN ] WRBY: Generated 1820 derivative records from 51609 primary records. [2025-09-29T02:25:14.352459] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-29T02:25:14.352586] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-29T02:25:14.401443] [DEBUG] [LOCAL ] WS: Loaded 24434 existing records from primary storage. [2025-09-29T02:25:14.402390] [INFO ] [MAIN ] WS: Loaded 24434 primary data records. [2025-09-29T02:25:14.402144] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1820 records). [2025-09-29T02:25:14.400553] [DEBUG] [LOCAL ] WRB: Derivative data saved (1820 records). [2025-09-29T02:25:14.402795] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-29T02:25:14.438513] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-29T02:25:14.438379] [INFO ] [MAIN ] Derivative Progress: 2162/2211 symbols completed. WRB took 1.3s. Estimated remaining: 20.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:14.490339] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:14.495639] [INFO ] [MAIN ] Derivative Progress: 2163/2211 symbols completed. WRBY took 1.4s. Estimated remaining: 20.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:14.522727] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:14.775035] [DEBUG] [LOCAL ] WSO: Loaded 25059 existing records from primary storage. [2025-09-29T02:25:14.790774] [INFO ] [MAIN ] WSO: Loaded 25059 primary data records. [2025-09-29T02:25:14.931411] [DEBUG] [LOCAL ] WSM: Loaded 50533 existing records from primary storage. [2025-09-29T02:25:14.973873] [INFO ] [MAIN ] WSM: Loaded 50533 primary data records. [2025-09-29T02:25:15.147575] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:15.221503] [INFO ] [MAIN ] WS: Generated 1820 derivative records from 24434 primary records. [2025-09-29T02:25:15.244552] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-29T02:25:15.571379] [DEBUG] [LOCAL ] WS: Derivative data saved (1820 records). [2025-09-29T02:25:15.571774] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-29T02:25:15.573926] [INFO ] [MAIN ] Derivative Progress: 2164/2211 symbols completed. WS took 1.3s. Estimated remaining: 20.0s. Rate: 141.3 symbols/min [2025-09-29T02:25:15.574382] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:15.603795] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:15.604809] [INFO ] [MAIN ] WSO: Generated 1820 derivative records from 25059 primary records. [2025-09-29T02:25:15.605254] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-29T02:25:15.632902] [DEBUG] [LOCAL ] WSR: Loaded 23550 existing records from primary storage. [2025-09-29T02:25:15.635351] [INFO ] [MAIN ] WSR: Loaded 23550 primary data records. [2025-09-29T02:25:15.634005] [DEBUG] [LOCAL ] WSO: Derivative data saved (1820 records). [2025-09-29T02:25:15.641556] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-29T02:25:15.675094] [INFO ] [MAIN ] Derivative Progress: 2165/2211 symbols completed. WSO took 1.2s. Estimated remaining: 19.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:15.719913] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:15.728583] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:15.762631] [INFO ] [MAIN ] WSM: Generated 1820 derivative records from 50533 primary records. [2025-09-29T02:25:15.775386] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-29T02:25:16.011312] [DEBUG] [LOCAL ] WSM: Derivative data saved (1820 records). [2025-09-29T02:25:16.012369] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-29T02:25:16.015991] [INFO ] [MAIN ] Derivative Progress: 2166/2211 symbols completed. WSM took 1.5s. Estimated remaining: 19.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:16.016259] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:16.078815] [DEBUG] [LOCAL ] WST: Loaded 38092 existing records from primary storage. [2025-09-29T02:25:16.079527] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:16.080939] [INFO ] [MAIN ] WST: Loaded 38092 primary data records. [2025-09-29T02:25:16.081851] [INFO ] [MAIN ] WSR: Generated 1820 derivative records from 23550 primary records. [2025-09-29T02:25:16.096910] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-29T02:25:16.242181] [DEBUG] [LOCAL ] WSR: Derivative data saved (1820 records). [2025-09-29T02:25:16.261533] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-29T02:25:16.304391] [INFO ] [MAIN ] Derivative Progress: 2167/2211 symbols completed. WSR took 0.7s. Estimated remaining: 18.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:16.305906] [DEBUG] [LOCAL ] WT: Loaded 48354 existing records from primary storage. [2025-09-29T02:25:16.306156] [INFO ] [MAIN ] WT: Loaded 48354 primary data records. [2025-09-29T02:25:16.306232] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:16.853335] [DEBUG] [LOCAL ] WTI: Loaded 44472 existing records from primary storage. [2025-09-29T02:25:16.854709] [INFO ] [MAIN ] WTI: Loaded 44472 primary data records. [2025-09-29T02:25:17.000500] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:17.028565] [INFO ] [MAIN ] WST: Generated 1820 derivative records from 38092 primary records. [2025-09-29T02:25:17.050052] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-29T02:25:17.263934] [DEBUG] [LOCAL ] WST: Derivative data saved (1820 records). [2025-09-29T02:25:17.265686] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-29T02:25:17.268827] [INFO ] [MAIN ] Derivative Progress: 2168/2211 symbols completed. WST took 1.5s. Estimated remaining: 18.3s. Rate: 141.3 symbols/min [2025-09-29T02:25:17.269189] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:17.285383] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:17.286528] [INFO ] [MAIN ] WT: Generated 1820 derivative records from 48354 primary records. [2025-09-29T02:25:17.286853] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-29T02:25:17.306415] [DEBUG] [LOCAL ] WT: Derivative data saved (1820 records). [2025-09-29T02:25:17.306873] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-29T02:25:17.310244] [INFO ] [MAIN ] Derivative Progress: 2169/2211 symbols completed. WT took 1.3s. Estimated remaining: 17.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:17.311088] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:17.333935] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:17.334738] [INFO ] [MAIN ] WTI: Generated 1820 derivative records from 44472 primary records. [2025-09-29T02:25:17.334865] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-29T02:25:17.363429] [DEBUG] [LOCAL ] WTI: Derivative data saved (1820 records). [2025-09-29T02:25:17.379358] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-29T02:25:17.383313] [INFO ] [MAIN ] Derivative Progress: 2170/2211 symbols completed. WTI took 1.1s. Estimated remaining: 17.4s. Rate: 141.5 symbols/min [2025-09-29T02:25:17.383616] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:17.380479] [DEBUG] [LOCAL ] WTS: Loaded 18597 existing records from primary storage. [2025-09-29T02:25:17.384369] [INFO ] [MAIN ] WTS: Loaded 18597 primary data records. [2025-09-29T02:25:17.525733] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-09-29T02:25:17.543776] [INFO ] [MAIN ] WTRG: Loaded 51656 primary data records. [2025-09-29T02:25:17.913804] [DEBUG] [LOCAL ] WTTR: Loaded 45735 existing records from primary storage. [2025-09-29T02:25:17.918484] [INFO ] [MAIN ] WTTR: Loaded 45735 primary data records. [2025-09-29T02:25:18.495254] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:18.497094] [INFO ] [MAIN ] WTS: Generated 1820 derivative records from 18597 primary records. [2025-09-29T02:25:18.498912] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-29T02:25:18.518840] [DEBUG] [LOCAL ] WTS: Derivative data saved (1820 records). [2025-09-29T02:25:18.520148] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-29T02:25:18.524309] [INFO ] [MAIN ] Derivative Progress: 2171/2211 symbols completed. WTS took 1.2s. Estimated remaining: 17.0s. Rate: 141.3 symbols/min [2025-09-29T02:25:18.524813] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:18.540987] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:18.543769] [INFO ] [MAIN ] WTRG: Generated 1820 derivative records from 51656 primary records. [2025-09-29T02:25:18.544077] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-29T02:25:18.574371] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1820 records). [2025-09-29T02:25:18.571306] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:18.574626] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-29T02:25:18.578384] [INFO ] [MAIN ] Derivative Progress: 2172/2211 symbols completed. WTRG took 1.3s. Estimated remaining: 16.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:18.578695] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:18.579937] [INFO ] [MAIN ] WTTR: Generated 1820 derivative records from 45735 primary records. [2025-09-29T02:25:18.580193] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-29T02:25:18.599196] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1820 records). [2025-09-29T02:25:18.599415] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-29T02:25:18.602710] [INFO ] [MAIN ] Derivative Progress: 2173/2211 symbols completed. WTTR took 1.2s. Estimated remaining: 16.1s. Rate: 141.5 symbols/min [2025-09-29T02:25:18.645334] [DEBUG] [LOCAL ] WU: Loaded 54232 existing records from primary storage. [2025-09-29T02:25:18.645577] [INFO ] [MAIN ] WU: Loaded 54232 primary data records. [2025-09-29T02:25:18.836119] [DEBUG] [LOCAL ] WWW: Loaded 49906 existing records from primary storage. [2025-09-29T02:25:18.842138] [INFO ] [MAIN ] WWW: Loaded 49906 primary data records. [2025-09-29T02:25:19.402366] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:19.403923] [INFO ] [MAIN ] WU: Generated 1820 derivative records from 54232 primary records. [2025-09-29T02:25:19.404538] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-29T02:25:19.424278] [DEBUG] [LOCAL ] WU: Derivative data saved (1820 records). [2025-09-29T02:25:19.437457] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-29T02:25:19.440357] [INFO ] [MAIN ] Derivative Progress: 2174/2211 symbols completed. WU took 0.9s. Estimated remaining: 15.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:19.440839] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:19.442518] [INFO ] [MAIN ] WWW: Generated 1820 derivative records from 49906 primary records. [2025-09-29T02:25:19.442713] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-29T02:25:19.460620] [DEBUG] [LOCAL ] WWW: Derivative data saved (1820 records). [2025-09-29T02:25:19.460748] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-29T02:25:19.463705] [INFO ] [MAIN ] Derivative Progress: 2175/2211 symbols completed. WWW took 0.9s. Estimated remaining: 15.3s. Rate: 141.5 symbols/min [2025-09-29T02:25:19.464271] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:19.464539] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:19.464420] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:19.505033] [DEBUG] [LOCAL ] XFLT: Loaded 30306 existing records from primary storage. [2025-09-29T02:25:19.505366] [INFO ] [MAIN ] XFLT: Loaded 30306 primary data records. [2025-09-29T02:25:19.685224] [DEBUG] [LOCAL ] XHR: Loaded 44680 existing records from primary storage. [2025-09-29T02:25:19.745407] [INFO ] [MAIN ] XHR: Loaded 44680 primary data records. [2025-09-29T02:25:19.979262] [DEBUG] [LOCAL ] WY: Loaded 53899 existing records from primary storage. [2025-09-29T02:25:19.979614] [INFO ] [MAIN ] WY: Loaded 53899 primary data records. [2025-09-29T02:25:20.674942] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:20.676195] [INFO ] [MAIN ] XFLT: Generated 1820 derivative records from 30306 primary records. [2025-09-29T02:25:20.676784] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-29T02:25:20.695713] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1820 records). [2025-09-29T02:25:20.696067] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-29T02:25:20.698733] [INFO ] [MAIN ] Derivative Progress: 2176/2211 symbols completed. XFLT took 1.2s. Estimated remaining: 14.9s. Rate: 141.3 symbols/min [2025-09-29T02:25:20.698950] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:20.718561] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:20.720133] [INFO ] [MAIN ] XHR: Generated 1820 derivative records from 44680 primary records. [2025-09-29T02:25:20.720224] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-29T02:25:20.744345] [DEBUG] [LOCAL ] XHR: Derivative data saved (1820 records). [2025-09-29T02:25:20.745016] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-29T02:25:20.761742] [INFO ] [MAIN ] Derivative Progress: 2177/2211 symbols completed. XHR took 1.3s. Estimated remaining: 14.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:20.762392] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:20.763809] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:20.763630] [INFO ] [MAIN ] WY: Generated 1820 derivative records from 53899 primary records. [2025-09-29T02:25:20.764243] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-29T02:25:20.783531] [DEBUG] [LOCAL ] WY: Derivative data saved (1820 records). [2025-09-29T02:25:20.783737] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-29T02:25:20.786604] [INFO ] [MAIN ] Derivative Progress: 2178/2211 symbols completed. WY took 1.3s. Estimated remaining: 14.0s. Rate: 141.5 symbols/min [2025-09-29T02:25:20.787171] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:20.829733] [DEBUG] [LOCAL ] XPER: Loaded 30181 existing records from primary storage. [2025-09-29T02:25:20.831765] [INFO ] [MAIN ] XPER: Loaded 30181 primary data records. [2025-09-29T02:25:20.926126] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-09-29T02:25:20.968737] [INFO ] [MAIN ] XOM: Loaded 54573 primary data records. [2025-09-29T02:25:21.211401] [DEBUG] [LOCAL ] XPEV: Loaded 54419 existing records from primary storage. [2025-09-29T02:25:21.339526] [INFO ] [MAIN ] XPEV: Loaded 54419 primary data records. [2025-09-29T02:25:22.027125] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:22.028552] [INFO ] [MAIN ] XPER: Generated 1820 derivative records from 30181 primary records. [2025-09-29T02:25:22.028814] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-29T02:25:22.051130] [DEBUG] [LOCAL ] XPER: Derivative data saved (1820 records). [2025-09-29T02:25:22.051582] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-29T02:25:22.054307] [INFO ] [MAIN ] Derivative Progress: 2179/2211 symbols completed. XPER took 1.3s. Estimated remaining: 13.6s. Rate: 141.3 symbols/min [2025-09-29T02:25:22.055004] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:22.069383] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:22.070877] [INFO ] [MAIN ] XOM: Generated 1820 derivative records from 54573 primary records. [2025-09-29T02:25:22.071101] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-29T02:25:22.090161] [DEBUG] [LOCAL ] XOM: Derivative data saved (1820 records). [2025-09-29T02:25:22.090362] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-29T02:25:22.093305] [INFO ] [MAIN ] Derivative Progress: 2180/2211 symbols completed. XOM took 1.4s. Estimated remaining: 13.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:22.093691] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:22.116087] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:22.118432] [INFO ] [MAIN ] XPEV: Generated 1820 derivative records from 54419 primary records. [2025-09-29T02:25:22.118639] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-29T02:25:22.139112] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1820 records). [2025-09-29T02:25:22.139551] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-29T02:25:22.154949] [INFO ] [MAIN ] Derivative Progress: 2181/2211 symbols completed. XPEV took 1.4s. Estimated remaining: 12.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:22.164026] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:22.198467] [DEBUG] [LOCAL ] XPOF: Loaded 39243 existing records from primary storage. [2025-09-29T02:25:22.198904] [INFO ] [MAIN ] XPOF: Loaded 39243 primary data records. [2025-09-29T02:25:22.223302] [DEBUG] [LOCAL ] XPO: Loaded 48656 existing records from primary storage. [2025-09-29T02:25:22.248440] [INFO ] [MAIN ] XPO: Loaded 48656 primary data records. [2025-09-29T02:25:22.550122] [DEBUG] [LOCAL ] XPRO: Loaded 46617 existing records from primary storage. [2025-09-29T02:25:22.703071] [INFO ] [MAIN ] XPRO: Loaded 46617 primary data records. [2025-09-29T02:25:23.261327] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:23.262470] [INFO ] [MAIN ] XPOF: Generated 1820 derivative records from 39243 primary records. [2025-09-29T02:25:23.262814] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-29T02:25:23.299568] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:23.298137] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1820 records). [2025-09-29T02:25:23.300593] [INFO ] [MAIN ] XPO: Generated 1820 derivative records from 48656 primary records. [2025-09-29T02:25:23.301138] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-29T02:25:23.301034] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-29T02:25:23.304522] [INFO ] [MAIN ] Derivative Progress: 2182/2211 symbols completed. XPOF took 1.2s. Estimated remaining: 12.3s. Rate: 141.3 symbols/min [2025-09-29T02:25:23.305019] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:23.327558] [DEBUG] [LOCAL ] XPO: Derivative data saved (1820 records). [2025-09-29T02:25:23.336180] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-29T02:25:23.345003] [INFO ] [MAIN ] Derivative Progress: 2183/2211 symbols completed. XPO took 1.3s. Estimated remaining: 11.9s. Rate: 141.4 symbols/min [2025-09-29T02:25:23.345979] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:23.346142] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:23.347668] [INFO ] [MAIN ] XPRO: Generated 1820 derivative records from 46617 primary records. [2025-09-29T02:25:23.348039] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-29T02:25:23.377605] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1820 records). [2025-09-29T02:25:23.378079] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-29T02:25:23.381048] [INFO ] [MAIN ] Derivative Progress: 2184/2211 symbols completed. XPRO took 1.2s. Estimated remaining: 11.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:23.381849] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:23.393751] [DEBUG] [LOCAL ] XYF: Loaded 28464 existing records from primary storage. [2025-09-29T02:25:23.394191] [INFO ] [MAIN ] XYF: Loaded 28464 primary data records. [2025-09-29T02:25:23.714420] [DEBUG] [LOCAL ] YALA: Loaded 37892 existing records from primary storage. [2025-09-29T02:25:23.713417] [DEBUG] [LOCAL ] XYL: Loaded 48777 existing records from primary storage. [2025-09-29T02:25:23.833363] [INFO ] [MAIN ] YALA: Loaded 37892 primary data records. [2025-09-29T02:25:23.833500] [INFO ] [MAIN ] XYL: Loaded 48777 primary data records. [2025-09-29T02:25:24.619014] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:24.620753] [INFO ] [MAIN ] XYF: Generated 1820 derivative records from 28464 primary records. [2025-09-29T02:25:24.621405] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-29T02:25:24.645599] [DEBUG] [LOCAL ] XYF: Derivative data saved (1820 records). [2025-09-29T02:25:24.646068] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-29T02:25:24.649054] [INFO ] [MAIN ] Derivative Progress: 2185/2211 symbols completed. XYF took 1.3s. Estimated remaining: 11.0s. Rate: 141.3 symbols/min [2025-09-29T02:25:24.649842] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:24.669328] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:24.674282] [INFO ] [MAIN ] YALA: Generated 1820 derivative records from 37892 primary records. [2025-09-29T02:25:24.674961] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-29T02:25:24.697275] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:24.703432] [INFO ] [MAIN ] XYL: Generated 1820 derivative records from 48777 primary records. [2025-09-29T02:25:24.706942] [DEBUG] [LOCAL ] YALA: Derivative data saved (1820 records). [2025-09-29T02:25:24.707240] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-29T02:25:24.707377] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-29T02:25:24.710729] [INFO ] [MAIN ] Derivative Progress: 2186/2211 symbols completed. YALA took 1.3s. Estimated remaining: 10.6s. Rate: 141.4 symbols/min [2025-09-29T02:25:24.711053] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:24.742702] [DEBUG] [LOCAL ] XYL: Derivative data saved (1820 records). [2025-09-29T02:25:24.742869] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-29T02:25:24.745730] [INFO ] [MAIN ] Derivative Progress: 2187/2211 symbols completed. XYL took 1.4s. Estimated remaining: 10.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:24.746001] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:24.765973] [DEBUG] [LOCAL ] YELP: Loaded 45909 existing records from primary storage. [2025-09-29T02:25:24.766271] [INFO ] [MAIN ] YELP: Loaded 45909 primary data records. [2025-09-29T02:25:25.162766] [DEBUG] [LOCAL ] YEXT: Loaded 43863 existing records from primary storage. [2025-09-29T02:25:25.163141] [INFO ] [MAIN ] YEXT: Loaded 43863 primary data records. [2025-09-29T02:25:25.189173] [DEBUG] [LOCAL ] YETI: Loaded 53216 existing records from primary storage. [2025-09-29T02:25:25.221010] [INFO ] [MAIN ] YETI: Loaded 53216 primary data records. [2025-09-29T02:25:25.889582] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:25.891944] [INFO ] [MAIN ] YELP: Generated 1820 derivative records from 45909 primary records. [2025-09-29T02:25:25.892973] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-29T02:25:25.912523] [DEBUG] [LOCAL ] YELP: Derivative data saved (1820 records). [2025-09-29T02:25:25.916531] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-29T02:25:25.929419] [INFO ] [MAIN ] Derivative Progress: 2188/2211 symbols completed. YELP took 1.3s. Estimated remaining: 9.8s. Rate: 141.3 symbols/min [2025-09-29T02:25:25.935603] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:25.937414] [INFO ] [MAIN ] YEXT: Generated 1820 derivative records from 43863 primary records. [2025-09-29T02:25:25.937622] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-29T02:25:25.955690] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1820 records). [2025-09-29T02:25:25.957231] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-29T02:25:25.961679] [INFO ] [MAIN ] Derivative Progress: 2189/2211 symbols completed. YEXT took 1.2s. Estimated remaining: 9.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:25.975225] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:25.976066] [INFO ] [MAIN ] YETI: Generated 1820 derivative records from 53216 primary records. [2025-09-29T02:25:25.976156] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-29T02:25:25.992504] [DEBUG] [LOCAL ] YETI: Derivative data saved (1820 records). [2025-09-29T02:25:25.992610] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-29T02:25:25.996081] [INFO ] [MAIN ] Derivative Progress: 2190/2211 symbols completed. YETI took 1.3s. Estimated remaining: 8.9s. Rate: 141.4 symbols/min [2025-09-29T02:25:25.996852] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:25.997426] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:25.997602] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:26.119615] [DEBUG] [LOCAL ] YMM: Loaded 53425 existing records from primary storage. [2025-09-29T02:25:26.121769] [DEBUG] [LOCAL ] YPF: Loaded 51252 existing records from primary storage. [2025-09-29T02:25:26.121936] [INFO ] [MAIN ] YMM: Loaded 53425 primary data records. [2025-09-29T02:25:26.122892] [DEBUG] [LOCAL ] YOU: Loaded 50504 existing records from primary storage. [2025-09-29T02:25:26.145773] [INFO ] [MAIN ] YOU: Loaded 50504 primary data records. [2025-09-29T02:25:26.123452] [INFO ] [MAIN ] YPF: Loaded 51252 primary data records. [2025-09-29T02:25:27.235861] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:27.237827] [INFO ] [MAIN ] YMM: Generated 1820 derivative records from 53425 primary records. [2025-09-29T02:25:27.251343] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-29T02:25:27.251634] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:27.255163] [INFO ] [MAIN ] YPF: Generated 1820 derivative records from 51252 primary records. [2025-09-29T02:25:27.255283] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-29T02:25:27.288867] [DEBUG] [LOCAL ] YMM: Derivative data saved (1820 records). [2025-09-29T02:25:27.297942] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-29T02:25:27.301521] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:27.305381] [INFO ] [MAIN ] YOU: Generated 1820 derivative records from 50504 primary records. [2025-09-29T02:25:27.303972] [INFO ] [MAIN ] Derivative Progress: 2191/2211 symbols completed. YMM took 1.3s. Estimated remaining: 8.5s. Rate: 141.3 symbols/min [2025-09-29T02:25:27.305844] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-29T02:25:27.307472] [DEBUG] [LOCAL ] YPF: Derivative data saved (1820 records). [2025-09-29T02:25:27.306236] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:27.308168] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-29T02:25:27.311142] [INFO ] [MAIN ] Derivative Progress: 2192/2211 symbols completed. YPF took 1.3s. Estimated remaining: 8.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:27.319517] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:27.329561] [DEBUG] [LOCAL ] YOU: Derivative data saved (1820 records). [2025-09-29T02:25:27.329926] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-29T02:25:27.333041] [INFO ] [MAIN ] Derivative Progress: 2193/2211 symbols completed. YOU took 1.3s. Estimated remaining: 7.6s. Rate: 141.4 symbols/min [2025-09-29T02:25:27.336675] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:27.343917] [DEBUG] [LOCAL ] YRD: Loaded 12726 existing records from primary storage. [2025-09-29T02:25:27.344276] [INFO ] [MAIN ] YRD: Loaded 12726 primary data records. [2025-09-29T02:25:27.478560] [DEBUG] [LOCAL ] YSG: Loaded 25485 existing records from primary storage. [2025-09-29T02:25:27.482840] [INFO ] [MAIN ] YSG: Loaded 25485 primary data records. [2025-09-29T02:25:27.983524] [DEBUG] [LOCAL ] YUM: Loaded 51931 existing records from primary storage. [2025-09-29T02:25:28.070333] [INFO ] [MAIN ] YUM: Loaded 51931 primary data records. [2025-09-29T02:25:28.445105] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:28.447168] [INFO ] [MAIN ] YRD: Generated 1820 derivative records from 12726 primary records. [2025-09-29T02:25:28.450402] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-29T02:25:28.477293] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:28.484896] [DEBUG] [LOCAL ] YRD: Derivative data saved (1820 records). [2025-09-29T02:25:28.486597] [INFO ] [MAIN ] YSG: Generated 1820 derivative records from 25485 primary records. [2025-09-29T02:25:28.487861] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-29T02:25:28.491432] [INFO ] [MAIN ] Derivative Progress: 2194/2211 symbols completed. YRD took 1.2s. Estimated remaining: 7.2s. Rate: 141.3 symbols/min [2025-09-29T02:25:28.488115] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-29T02:25:28.492057] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:28.512772] [DEBUG] [LOCAL ] YSG: Derivative data saved (1820 records). [2025-09-29T02:25:28.512974] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-29T02:25:28.515731] [INFO ] [MAIN ] Derivative Progress: 2195/2211 symbols completed. YSG took 1.2s. Estimated remaining: 6.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:28.516241] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:28.542156] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:28.543277] [INFO ] [MAIN ] YUM: Generated 1820 derivative records from 51931 primary records. [2025-09-29T02:25:28.543522] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-29T02:25:28.568996] [DEBUG] [LOCAL ] YUM: Derivative data saved (1820 records). [2025-09-29T02:25:28.583284] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-29T02:25:28.587050] [INFO ] [MAIN ] Derivative Progress: 2196/2211 symbols completed. YUM took 1.3s. Estimated remaining: 6.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:28.587580] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:28.613318] [DEBUG] [LOCAL ] YUMC: Loaded 53455 existing records from primary storage. [2025-09-29T02:25:28.627153] [INFO ] [MAIN ] YUMC: Loaded 53455 primary data records. [2025-09-29T02:25:28.717370] [DEBUG] [LOCAL ] ZEPP: Loaded 17335 existing records from primary storage. [2025-09-29T02:25:28.741815] [INFO ] [MAIN ] ZEPP: Loaded 17335 primary data records. [2025-09-29T02:25:28.854029] [DEBUG] [LOCAL ] ZBH: Loaded 51948 existing records from primary storage. [2025-09-29T02:25:28.963940] [INFO ] [MAIN ] ZBH: Loaded 51948 primary data records. [2025-09-29T02:25:29.800985] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:29.802690] [INFO ] [MAIN ] YUMC: Generated 1820 derivative records from 53455 primary records. [2025-09-29T02:25:29.802804] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-29T02:25:29.825026] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1820 records). [2025-09-29T02:25:29.833566] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-29T02:25:29.842720] [INFO ] [MAIN ] Derivative Progress: 2197/2211 symbols completed. YUMC took 1.4s. Estimated remaining: 5.9s. Rate: 141.3 symbols/min [2025-09-29T02:25:29.839790] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:29.843029] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:29.844588] [INFO ] [MAIN ] ZEPP: Generated 1820 derivative records from 17335 primary records. [2025-09-29T02:25:29.845623] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-29T02:25:29.869495] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1820 records). [2025-09-29T02:25:29.872438] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-29T02:25:29.876607] [INFO ] [MAIN ] Derivative Progress: 2198/2211 symbols completed. ZEPP took 1.3s. Estimated remaining: 5.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:29.877092] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:29.892559] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:29.893603] [INFO ] [MAIN ] ZBH: Generated 1820 derivative records from 51948 primary records. [2025-09-29T02:25:29.893720] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-29T02:25:29.911434] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1820 records). [2025-09-29T02:25:29.911615] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-29T02:25:29.915401] [INFO ] [MAIN ] Derivative Progress: 2199/2211 symbols completed. ZBH took 1.4s. Estimated remaining: 5.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:29.915850] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:29.982869] [DEBUG] [LOCAL ] ZH: Loaded 27298 existing records from primary storage. [2025-09-29T02:25:29.991666] [INFO ] [MAIN ] ZH: Loaded 27298 primary data records. [2025-09-29T02:25:29.993891] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-29T02:25:30.016241] [INFO ] [MAIN ] ZETA: Loaded 54375 primary data records. [2025-09-29T02:25:30.141147] [DEBUG] [LOCAL ] ZGN: Loaded 41333 existing records from primary storage. [2025-09-29T02:25:30.199485] [INFO ] [MAIN ] ZGN: Loaded 41333 primary data records. [2025-09-29T02:25:31.108313] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:31.117126] [INFO ] [MAIN ] ZH: Generated 1820 derivative records from 27298 primary records. [2025-09-29T02:25:31.121699] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-29T02:25:31.122884] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:31.124267] [INFO ] [MAIN ] ZETA: Generated 1820 derivative records from 54375 primary records. [2025-09-29T02:25:31.124543] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-29T02:25:31.159045] [DEBUG] [LOCAL ] ZH: Derivative data saved (1820 records). [2025-09-29T02:25:31.159334] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-29T02:25:31.169210] [INFO ] [MAIN ] Derivative Progress: 2200/2211 symbols completed. ZH took 1.3s. Estimated remaining: 4.7s. Rate: 141.3 symbols/min [2025-09-29T02:25:31.155946] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1820 records). [2025-09-29T02:25:31.174410] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-29T02:25:31.175241] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:31.174504] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:31.177957] [INFO ] [MAIN ] Derivative Progress: 2201/2211 symbols completed. ZETA took 1.3s. Estimated remaining: 4.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:31.179189] [INFO ] [MAIN ] ZGN: Generated 1820 derivative records from 41333 primary records. [2025-09-29T02:25:31.179401] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:31.179707] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-29T02:25:31.198718] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1820 records). [2025-09-29T02:25:31.199064] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-29T02:25:31.201801] [INFO ] [MAIN ] Derivative Progress: 2202/2211 symbols completed. ZGN took 1.3s. Estimated remaining: 3.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:31.202150] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:31.265393] [DEBUG] [LOCAL ] ZIP: Loaded 44952 existing records from primary storage. [2025-09-29T02:25:31.265697] [INFO ] [MAIN ] ZIP: Loaded 44952 primary data records. [2025-09-29T02:25:31.400331] [DEBUG] [LOCAL ] ZK: Loaded 40504 existing records from primary storage. [2025-09-29T02:25:31.409138] [DEBUG] [LOCAL ] ZIM: Loaded 54298 existing records from primary storage. [2025-09-29T02:25:31.409345] [INFO ] [MAIN ] ZK: Loaded 40504 primary data records. [2025-09-29T02:25:31.420782] [INFO ] [MAIN ] ZIM: Loaded 54298 primary data records. [2025-09-29T02:25:32.396844] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:32.400167] [INFO ] [MAIN ] ZIP: Generated 1820 derivative records from 44952 primary records. [2025-09-29T02:25:32.401621] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-29T02:25:32.421757] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1820 records). [2025-09-29T02:25:32.422367] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-29T02:25:32.425240] [INFO ] [MAIN ] Derivative Progress: 2203/2211 symbols completed. ZIP took 1.2s. Estimated remaining: 3.4s. Rate: 141.3 symbols/min [2025-09-29T02:25:32.447803] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:32.448902] [INFO ] [MAIN ] ZK: Generated 1820 derivative records from 40504 primary records. [2025-09-29T02:25:32.449094] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-29T02:25:32.469101] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:32.478694] [INFO ] [MAIN ] ZIM: Generated 1820 derivative records from 54298 primary records. [2025-09-29T02:25:32.487925] [DEBUG] [LOCAL ] ZK: Derivative data saved (1820 records). [2025-09-29T02:25:32.488058] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-29T02:25:32.488286] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-29T02:25:32.492102] [INFO ] [MAIN ] Derivative Progress: 2204/2211 symbols completed. ZK took 1.3s. Estimated remaining: 3.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:32.517880] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1820 records). [2025-09-29T02:25:32.518082] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-29T02:25:32.522039] [INFO ] [MAIN ] Derivative Progress: 2205/2211 symbols completed. ZIM took 1.3s. Estimated remaining: 2.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:32.522780] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:32.522602] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:32.523706] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:32.543485] [DEBUG] [LOCAL ] ZKH: Loaded 8119 existing records from primary storage. [2025-09-29T02:25:32.543905] [INFO ] [MAIN ] ZKH: Loaded 8119 primary data records. [2025-09-29T02:25:32.614630] [DEBUG] [LOCAL ] ZTR: Loaded 16911 existing records from primary storage. [2025-09-29T02:25:32.614824] [INFO ] [MAIN ] ZTR: Loaded 16911 primary data records. [2025-09-29T02:25:33.125323] [DEBUG] [LOCAL ] ZTO: Loaded 50751 existing records from primary storage. [2025-09-29T02:25:33.132748] [INFO ] [MAIN ] ZTO: Loaded 50751 primary data records. [2025-09-29T02:25:33.706966] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:33.721761] [INFO ] [MAIN ] ZKH: Generated 1820 derivative records from 8119 primary records. [2025-09-29T02:25:33.722187] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-29T02:25:33.723129] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:33.725131] [INFO ] [MAIN ] ZTR: Generated 1820 derivative records from 16911 primary records. [2025-09-29T02:25:33.725807] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-29T02:25:33.741407] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1820 records). [2025-09-29T02:25:33.748507] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-29T02:25:33.754014] [INFO ] [MAIN ] Derivative Progress: 2206/2211 symbols completed. ZKH took 1.2s. Estimated remaining: 2.1s. Rate: 141.3 symbols/min [2025-09-29T02:25:33.759981] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:33.762523] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1820 records). [2025-09-29T02:25:33.763474] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-29T02:25:33.765926] [INFO ] [MAIN ] Derivative Progress: 2207/2211 symbols completed. ZTR took 1.2s. Estimated remaining: 1.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:33.766366] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:33.787199] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:33.788154] [INFO ] [MAIN ] ZTO: Generated 1820 derivative records from 50751 primary records. [2025-09-29T02:25:33.788303] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-29T02:25:33.806481] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1820 records). [2025-09-29T02:25:33.816473] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-29T02:25:33.820836] [INFO ] [MAIN ] Derivative Progress: 2208/2211 symbols completed. ZTO took 1.3s. Estimated remaining: 1.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:33.821115] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:33.838930] [DEBUG] [LOCAL ] ZVIA: Loaded 35966 existing records from primary storage. [2025-09-29T02:25:33.839358] [INFO ] [MAIN ] ZVIA: Loaded 35966 primary data records. [2025-09-29T02:25:34.015447] [DEBUG] [LOCAL ] ZTS: Loaded 53775 existing records from primary storage. [2025-09-29T02:25:34.058272] [INFO ] [MAIN ] ZTS: Loaded 53775 primary data records. [2025-09-29T02:25:34.295354] [DEBUG] [LOCAL ] ZWS: Loaded 43134 existing records from primary storage. [2025-09-29T02:25:34.315824] [INFO ] [MAIN ] ZWS: Loaded 43134 primary data records. [2025-09-29T02:25:34.899438] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:34.902471] [INFO ] [MAIN ] ZVIA: Generated 1820 derivative records from 35966 primary records. [2025-09-29T02:25:34.903003] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-29T02:25:34.920696] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1820 records). [2025-09-29T02:25:34.920921] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-29T02:25:34.924483] [INFO ] [MAIN ] Derivative Progress: 2209/2211 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.8s. Rate: 141.3 symbols/min [2025-09-29T02:25:34.943930] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:34.944793] [INFO ] [MAIN ] ZTS: Generated 1820 derivative records from 53775 primary records. [2025-09-29T02:25:34.945116] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-29T02:25:34.964766] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1820 records). [2025-09-29T02:25:34.964936] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-29T02:25:34.968113] [INFO ] [MAIN ] Derivative Progress: 2210/2211 symbols completed. ZTS took 1.2s. Estimated remaining: 0.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:34.981055] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:34.981795] [INFO ] [MAIN ] ZWS: Generated 1820 derivative records from 43134 primary records. [2025-09-29T02:25:34.981883] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-29T02:25:34.997755] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1820 records). [2025-09-29T02:25:34.997888] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-29T02:25:35.000797] [INFO ] [MAIN ] Derivative Progress: 2211/2211 symbols completed. ZWS took 1.2s. Estimated remaining: 0.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:35.001872] [INFO ] [MAIN ] Parallel derivative generation completed in 15m 38s [2025-09-29T02:25:35.002157] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2211/2211 symbols) [2025-09-29T02:25:35.662838] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2211/2211 @ 100.00%)' [2025-09-29T02:25:35.663501] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-09-29T02:25:35.664016] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-29T02:25:35.664405] [INFO ] [STATE ] Last completion updated: 2025-09-29T02:25:35.664099 [2025-09-29T17:00:01.397776] [INFO ] [MAIN ] Using last completed trading day: 2025-09-29 [2025-09-29T17:00:01.612134] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-09-29T17:00:01.612321] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-09-29T17:00:01.921490] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-09-29T17:00:01.922162] [WARN ] [STATE ] State set to: RUNNING [2025-09-29T17:00:01.922248] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-29T17:00:01.922297] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-29T17:00:01.922384] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-29T17:00:01.922422] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T17:00:02.862629] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T17:00:02.862850] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T17:00:02.863055] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-29T17:00:02.863790] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-29T17:00:02.863851] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-29T17:00:02.863884] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-29T17:00:02.863941] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-29T17:00:02.863974] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-29T17:00:02.864030] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T17:00:02.864421] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T17:00:02.864474] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T17:00:02.864695] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-29T17:00:02.864775] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-29T17:00:02.864810] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-29T17:00:02.864843] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-29T17:00:02.893431] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-29T17:00:02.922397] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-29T17:00:02.922579] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-29T17:00:02.922621] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-29T17:00:02.922688] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-29T17:00:02.922775] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T17:00:02.923139] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T17:00:02.923179] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T17:00:02.923214] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-29T17:00:02.923245] [INFO ] [MAIN ] Running in parallel mode [2025-09-29T17:00:02.923455] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-29T17:00:03.619104] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:03.698831] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:03.745430] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:03.752724] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-29T17:00:03.781923] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-29T17:00:03.786065] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-29T17:00:03.802085] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-29T17:00:03.807951] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:03.808080] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-29T17:00:03.808291] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-29T17:00:03.808379] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-29T17:00:03.808493] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-29T17:00:03.809076] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-29T17:00:03.809154] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-29T17:00:03.809255] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-29T17:00:03.809329] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-29T17:00:04.392133] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-29T17:00:04.432363] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-29T17:00:04.438075] [INFO ] [MAIN ] A: Loaded 51487 existing records. [2025-09-29T17:00:04.469908] [INFO ] [MAIN ] AA: Loaded 54394 existing records. [2025-09-29T17:00:05.045562] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:05.147977] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-29T17:00:05.209213] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:05.221894] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-29T17:00:05.220746] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:05.222060] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-29T17:00:05.227862] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-29T17:00:05.239956] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-29T17:00:05.227788] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-29T17:00:05.275470] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-29T17:00:05.275333] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:05.324808] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-29T17:00:05.341874] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-29T17:00:05.325325] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-29T17:00:05.714417] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:00:05.747203] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-29T17:00:05.793024] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T17:00:05.793104] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:00:05.845317] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-29T17:00:05.871381] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:00:05.902067] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-29T17:00:05.902667] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-29T17:00:05.960075] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-29T17:00:06.069469] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:06.036343] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-29T17:00:06.075743] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-29T17:00:06.075016] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:06.075893] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-29T17:00:06.076203] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-29T17:00:06.077450] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 3.0s. Estimated remaining: 2h 4m 35s. Rate: 19.0 symbols/min [2025-09-29T17:00:06.272786] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:06.323063] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-29T17:00:06.324137] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-29T17:00:06.347673] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-29T17:00:06.348023] [INFO ] [MAIN ] AAP: Loaded 52789 existing records. [2025-09-29T17:00:06.544218] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:06.544473] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-29T17:00:06.544526] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-29T17:00:06.545722] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-29T17:00:06.545798] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-29T17:00:06.712516] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-29T17:00:06.726186] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-29T17:00:06.959363] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:06.959800] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-29T17:00:07.173169] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T17:00:07.174208] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-29T17:00:07.539222] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T17:00:07.540583] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-29T17:00:07.830290] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-29T17:00:07.831314] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-29T17:00:07.874961] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:00:07.885887] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-29T17:00:08.139148] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-29T17:00:08.150457] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-29T17:00:08.173490] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T17:00:08.174392] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-29T17:00:08.491928] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-29T17:00:08.492872] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-29T17:00:08.742997] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T17:00:08.754074] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-29T17:00:08.935944] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T17:00:08.937224] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-29T17:00:09.493417] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T17:00:09.494246] [INFO ] [REMOTE ] AAM: Full fetch complete (960 records). [2025-09-29T17:00:09.494334] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-29T17:00:09.704483] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T17:00:09.705497] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:09.705591] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:09.705693] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-29T17:00:09.705796] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-29T17:00:09.705852] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-29T17:00:09.705897] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-29T17:00:09.705984] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.7s. Estimated remaining: 2h 13m 54s. Rate: 17.7 symbols/min [2025-09-29T17:00:09.831209] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T17:00:09.883328] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-29T17:00:09.961820] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:10.002968] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-29T17:00:10.003274] [INFO ] [MAIN ] AAT: Loaded 31069 existing records. [2025-09-29T17:00:10.198369] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:10.199247] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-29T17:00:10.199511] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-29T17:00:10.200421] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-29T17:00:10.200566] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-29T17:00:10.364494] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-29T17:00:10.456282] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-29T17:00:10.669562] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:10.670138] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-29T17:00:10.700116] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T17:00:10.711132] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-29T17:00:11.742959] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:00:11.754161] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-29T17:00:11.892052] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T17:00:11.898050] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-29T17:00:12.313508] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:00:12.324416] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-29T17:00:12.753503] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-29T17:00:12.764419] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-29T17:00:12.781949] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T17:00:12.788934] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-29T17:00:13.491600] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:00:13.503721] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-29T17:00:13.973897] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T17:00:13.979857] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-29T17:00:14.293490] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:00:14.305382] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-29T17:00:15.279571] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T17:00:15.286607] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-29T17:00:15.474199] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T17:00:15.489874] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-29T17:00:15.526627] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (3.20 seconds). [2025-09-29T17:00:15.539891] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-29T17:00:16.168603] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T17:00:16.179975] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-29T17:00:16.576236] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T17:00:16.584077] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-29T17:00:17.474510] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-29T17:00:17.486826] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-29T17:00:17.715827] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-29T17:00:17.729576] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-29T17:00:18.042901] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T17:00:18.060059] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-29T17:00:19.229067] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T17:00:19.240973] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-29T17:00:19.717110] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T17:00:19.729303] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-29T17:00:19.898466] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T17:00:19.910692] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-29T17:00:19.950743] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-29T17:00:19.957593] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-29T17:00:20.656155] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:00:20.668845] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-29T17:00:20.993179] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:00:21.000580] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-29T17:00:21.600061] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T17:00:21.611344] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-29T17:00:21.785487] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:00:21.801576] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-29T17:00:22.481871] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T17:00:22.490049] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-29T17:00:22.534679] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T17:00:22.545754] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-29T17:00:23.181837] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T17:00:23.193193] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-29T17:00:23.467203] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T17:00:23.474386] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-29T17:00:23.848798] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-29T17:00:23.861352] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-29T17:00:24.224398] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T17:00:24.245170] [INFO ] [REMOTE ] A: Full fetch complete (72673 records). [2025-09-29T17:00:24.245370] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-29T17:00:24.246294] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:00:24.246389] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:24.246435] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:24.246476] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-29T17:00:24.246556] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-29T17:00:24.246614] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-09-29T17:00:24.247327] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-09-29T17:00:24.247925] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. A took 21.3s. Estimated remaining: 4h 40m 32s. Rate: 8.4 symbols/min [2025-09-29T17:00:24.427712] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:24.427966] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-29T17:00:24.428026] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-29T17:00:24.428155] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-29T17:00:24.428209] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-29T17:00:24.428257] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-29T17:00:24.428299] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-29T17:00:24.882560] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:24.883230] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-29T17:00:24.985413] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:00:25.023105] [INFO ] [REMOTE ] AAP: Full fetch complete (74696 records). [2025-09-29T17:00:25.024201] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-29T17:00:25.025235] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T17:00:25.033132] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:00:25.033341] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:25.033395] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:25.033474] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-29T17:00:25.033546] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-29T17:00:25.033585] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-09-29T17:00:25.034234] [INFO ] [REMOTE ] AAT: Full fetch complete (42640 records). [2025-09-29T17:00:25.034395] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-29T17:00:25.034783] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-09-29T17:00:25.035550] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAP took 19.0s. Estimated remaining: 3h 38m 5s. Rate: 10.9 symbols/min [2025-09-29T17:00:25.117972] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:00:25.130360] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-29T17:00:25.130513] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:00:25.130572] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-29T17:00:25.130613] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:00:25.130697] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-29T17:00:25.130783] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-29T17:00:25.130826] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-29T17:00:25.130874] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-29T17:00:25.130934] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAUC took 0.9s. Estimated remaining: 2h 55m 9s. Rate: 13.5 symbols/min [2025-09-29T17:00:25.755098] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:25.938601] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:26.068316] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-29T17:00:26.149897] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-29T17:00:26.150470] [INFO ] [MAIN ] AB: Loaded 28642 existing records. [2025-09-29T17:00:26.192868] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-29T17:00:26.267531] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-29T17:00:26.274318] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-29T17:00:26.301743] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-29T17:00:26.314386] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-29T17:00:26.381423] [DEBUG] [LOCAL ] AAT: Trimmed 42640 records to 30539 (keeping 200 days of data) [2025-09-29T17:00:26.418799] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:26.420267] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-29T17:00:26.420334] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-29T17:00:26.495320] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-29T17:00:26.508683] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-29T17:00:26.655050] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-29T17:00:26.666575] [INFO ] [MAIN ] ABBV: Loaded 54465 existing records. [2025-09-29T17:00:27.145359] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:27.219247] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-29T17:00:27.258378] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-29T17:00:27.287083] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-29T17:00:27.293542] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:27.294395] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-29T17:00:27.294466] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-29T17:00:27.460954] [DEBUG] [LOCAL ] AAT: Primary data saved (30539 records). [2025-09-29T17:00:27.489247] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-29T17:00:27.497984] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AAT took 17.8s. Estimated remaining: 2h 41m 27s. Rate: 14.6 symbols/min [2025-09-29T17:00:27.855011] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:27.913110] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:27.913539] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-29T17:00:27.945952] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-29T17:00:27.946318] [INFO ] [MAIN ] ABCB: Loaded 31144 existing records. [2025-09-29T17:00:28.142407] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:28.142758] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-29T17:00:28.142838] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-29T17:00:28.143747] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-29T17:00:28.143820] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-29T17:00:28.543694] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-29T17:00:28.590960] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:28.591790] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-29T17:00:28.593855] [INFO ] [REMOTE ] AA: Full fetch complete (77148 records). [2025-09-29T17:00:28.593950] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-29T17:00:28.594883] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:00:28.594981] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:28.595054] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:28.595130] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-29T17:00:28.595213] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-29T17:00:28.595285] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-09-29T17:00:28.595865] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-09-29T17:00:28.596259] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AA took 25.6s. Estimated remaining: 2h 24m 30s. Rate: 16.4 symbols/min [2025-09-29T17:00:28.782123] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:28.843579] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-29T17:00:28.843995] [INFO ] [MAIN ] ABEV: Loaded 54055 existing records. [2025-09-29T17:00:29.037784] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T17:00:29.067044] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-29T17:00:29.070994] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:29.072205] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-29T17:00:29.072260] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-29T17:00:29.073010] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-29T17:00:29.073114] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-29T17:00:29.445979] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:29.446328] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-29T17:00:30.084053] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T17:00:30.090861] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-29T17:00:30.132087] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-29T17:00:30.144755] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-29T17:00:30.201916] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T17:00:30.210830] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-29T17:00:31.323471] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T17:00:31.330977] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-29T17:00:31.509395] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T17:00:31.518677] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-29T17:00:31.671951] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T17:00:31.683161] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-29T17:00:31.818104] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T17:00:31.830370] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-29T17:00:32.687537] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T17:00:32.694448] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-29T17:00:32.725534] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T17:00:32.735716] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-29T17:00:33.592255] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-29T17:00:33.609144] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-29T17:00:33.684164] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T17:00:33.695360] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-29T17:00:33.805222] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:00:33.816735] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-29T17:00:34.306380] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:00:34.317440] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-29T17:00:35.239128] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:00:35.247284] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-29T17:00:35.329201] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T17:00:35.340087] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-29T17:00:35.625623] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T17:00:35.632018] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-29T17:00:35.764172] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:00:35.776341] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-29T17:00:36.469544] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T17:00:36.476049] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-29T17:00:36.722698] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T17:00:36.727609] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-29T17:00:36.832826] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T17:00:36.844437] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-29T17:00:37.651519] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T17:00:37.657578] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-29T17:00:37.884741] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T17:00:37.896724] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-29T17:00:37.931496] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T17:00:37.937692] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-29T17:00:38.682303] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:00:38.693725] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-29T17:00:38.747814] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T17:00:38.756235] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-29T17:00:39.163170] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T17:00:39.168585] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-29T17:00:39.668638] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T17:00:39.680833] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-29T17:00:39.860589] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T17:00:39.868204] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-29T17:00:40.483637] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:00:40.497405] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-29T17:00:40.594435] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T17:00:40.600165] [INFO ] [REMOTE ] AB: Full fetch complete (45720 records). [2025-09-29T17:00:40.600320] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-29T17:00:41.020308] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-29T17:00:41.020456] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-29T17:00:41.020964] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-29T17:00:41.021034] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-29T17:00:41.022336] [DEBUG] [LOCAL ] AB: Trimmed 45720 records to 27747 (keeping 200 days of data) [2025-09-29T17:00:41.271103] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T17:00:41.280007] [INFO ] [REMOTE ] ABCB: Full fetch complete (44479 records). [2025-09-29T17:00:41.280168] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-29T17:00:41.496012] [DEBUG] [LOCAL ] AB: Primary data saved (27747 records). [2025-09-29T17:00:41.500445] [INFO ] [MAIN ] AB: Full history saved. [2025-09-29T17:00:41.510193] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 16.5s. Estimated remaining: 3h 9m 58s. Rate: 12.4 symbols/min [2025-09-29T17:00:41.939402] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:41.952898] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-29T17:00:41.952986] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-29T17:00:41.953540] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-29T17:00:41.953666] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-29T17:00:41.955219] [DEBUG] [LOCAL ] ABCB: Trimmed 44479 records to 30510 (keeping 200 days of data) [2025-09-29T17:00:42.119132] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-29T17:00:42.146872] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-29T17:00:42.150765] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-29T17:00:42.152435] [INFO ] [MAIN ] ABG: Loaded 19034 existing records. [2025-09-29T17:00:42.375003] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:42.376912] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-29T17:00:42.396411] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-29T17:00:42.410552] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-29T17:00:42.411921] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-29T17:00:42.411766] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T17:00:42.503337] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-29T17:00:42.895925] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:42.897184] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-29T17:00:42.913175] [DEBUG] [LOCAL ] ABCB: Primary data saved (30510 records). [2025-09-29T17:00:42.913329] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-29T17:00:42.913439] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 15.4s. Estimated remaining: 2h 54m 55s. Rate: 13.5 symbols/min [2025-09-29T17:00:43.103982] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:43.144255] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-29T17:00:43.144637] [INFO ] [MAIN ] ABM: Loaded 32915 existing records. [2025-09-29T17:00:43.336151] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:43.336420] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-29T17:00:43.336469] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-29T17:00:43.337279] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-29T17:00:43.337396] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-29T17:00:43.713089] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:43.713450] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-29T17:00:43.994519] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T17:00:43.998232] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-29T17:00:44.299522] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T17:00:44.313124] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-29T17:00:44.379441] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:00:44.393239] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-29T17:00:44.764590] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T17:00:44.775798] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-29T17:00:45.045066] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T17:00:45.049800] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-29T17:00:45.640818] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T17:00:45.647171] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-29T17:00:46.152252] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:00:46.156791] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-29T17:00:46.232483] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T17:00:46.245546] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-29T17:00:46.378925] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:00:46.395453] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-29T17:00:46.589123] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T17:00:46.594485] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-29T17:00:47.315142] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T17:00:47.320545] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-29T17:00:48.060776] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T17:00:48.068744] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-29T17:00:48.162342] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T17:00:48.174122] [INFO ] [REMOTE ] ABEV: Full fetch complete (77198 records). [2025-09-29T17:00:48.174312] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-29T17:00:48.621330] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-29T17:00:48.621547] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-29T17:00:48.622458] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-29T17:00:48.622569] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-29T17:00:48.625839] [DEBUG] [LOCAL ] ABEV: Trimmed 77198 records to 53278 (keeping 200 days of data) [2025-09-29T17:00:48.749067] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-29T17:00:48.765463] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-09-29T17:00:48.767812] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-29T17:00:48.974171] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T17:00:49.002864] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-29T17:00:49.373188] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-29T17:00:49.373697] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-29T17:00:49.375024] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-29T17:00:49.376222] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-29T17:00:49.381872] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 53684 (keeping 200 days of data) [2025-09-29T17:00:49.538094] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T17:00:49.550948] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-29T17:00:49.782268] [DEBUG] [LOCAL ] ABEV: Primary data saved (53278 records). [2025-09-29T17:00:49.782927] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-29T17:00:49.783520] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABEV took 21.2s. Estimated remaining: 3h 4m 24s. Rate: 12.8 symbols/min [2025-09-29T17:00:49.983526] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:50.005013] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T17:00:50.011568] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-29T17:00:50.066045] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-29T17:00:50.067313] [INFO ] [MAIN ] ABR: Loaded 52817 existing records. [2025-09-29T17:00:50.368964] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:50.370039] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-29T17:00:50.370414] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-29T17:00:50.372087] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-29T17:00:50.375429] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-29T17:00:50.576431] [DEBUG] [LOCAL ] ABBV: Primary data saved (53684 records). [2025-09-29T17:00:50.586294] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-29T17:00:50.611718] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABBV took 25.5s. Estimated remaining: 2h 50m 31s. Rate: 13.8 symbols/min [2025-09-29T17:00:51.060583] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:51.066026] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:51.068234] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:00:51.068610] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-29T17:00:51.088835] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-29T17:00:51.091391] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T17:00:51.097676] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-29T17:00:51.155389] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-29T17:00:51.155777] [INFO ] [MAIN ] ABT: Loaded 54400 existing records. [2025-09-29T17:00:51.343718] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:51.343947] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-29T17:00:51.343998] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-29T17:00:51.347690] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-29T17:00:51.347767] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-29T17:00:51.729291] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:51.729728] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-29T17:00:52.212446] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T17:00:52.217728] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-29T17:00:52.476561] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T17:00:52.484937] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-29T17:00:52.816990] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:00:52.828023] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-29T17:00:53.409154] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:00:53.414596] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-29T17:00:53.722538] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T17:00:53.740801] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-29T17:00:53.809735] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:00:53.817998] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-29T17:00:54.209029] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-29T17:00:54.212566] [INFO ] [REMOTE ] ABG: Full fetch complete (26337 records). [2025-09-29T17:00:54.212714] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-29T17:00:54.213322] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:00:54.213427] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:54.213544] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:54.213636] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-29T17:00:54.213791] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-09-29T17:00:54.213834] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-09-29T17:00:54.215035] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-09-29T17:00:54.215142] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 12.7s. Estimated remaining: 2h 48m 3s. Rate: 14.0 symbols/min [2025-09-29T17:00:54.407999] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:54.433732] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-29T17:00:54.434026] [INFO ] [MAIN ] ACA: Loaded 24034 existing records. [2025-09-29T17:00:54.632197] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:54.632512] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-29T17:00:54.632757] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-29T17:00:54.633371] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-29T17:00:54.633439] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-29T17:00:54.913247] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-29T17:00:54.977238] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-29T17:00:55.046520] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T17:00:55.120701] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:55.121209] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-29T17:00:55.121509] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-29T17:00:55.158675] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T17:00:55.169803] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-29T17:00:56.412534] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:00:56.421272] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-29T17:00:56.630074] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:00:56.640967] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-29T17:00:56.686302] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T17:00:56.697801] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-29T17:00:57.068231] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T17:00:57.076794] [INFO ] [REMOTE ] ABM: Full fetch complete (44698 records). [2025-09-29T17:00:57.076946] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-29T17:00:57.524523] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-29T17:00:57.524781] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-29T17:00:57.525325] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-29T17:00:57.525445] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-29T17:00:57.526821] [DEBUG] [LOCAL ] ABM: Trimmed 44698 records to 32159 (keeping 200 days of data) [2025-09-29T17:00:57.686783] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T17:00:57.693346] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-29T17:00:57.814395] [DEBUG] [LOCAL ] ABM: Primary data saved (32159 records). [2025-09-29T17:00:57.814560] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-29T17:00:57.814707] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 14.9s. Estimated remaining: 2h 45m 56s. Rate: 14.2 symbols/min [2025-09-29T17:00:58.010575] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:58.059227] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-29T17:00:58.059577] [INFO ] [MAIN ] ACCO: Loaded 38214 existing records. [2025-09-29T17:00:58.250201] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:58.250634] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-29T17:00:58.250795] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-29T17:00:58.251385] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-29T17:00:58.251452] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-29T17:00:58.644687] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:58.645820] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-29T17:00:58.695541] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T17:00:58.702186] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T17:00:58.714568] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-29T17:00:58.716457] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-29T17:00:58.747980] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T17:00:58.760750] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-29T17:01:00.031545] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T17:01:00.038513] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-29T17:01:00.217713] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T17:01:00.225799] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-29T17:01:00.818358] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T17:01:00.829901] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-29T17:01:01.033724] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T17:01:01.034330] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T17:01:01.052745] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-29T17:01:01.053205] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-29T17:01:01.877969] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:01:01.886003] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-29T17:01:02.372914] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T17:01:02.381440] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-29T17:01:02.757670] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T17:01:02.769712] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-29T17:01:02.817370] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T17:01:02.829787] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-29T17:01:03.212920] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T17:01:03.220604] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-29T17:01:03.434807] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T17:01:03.440202] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-29T17:01:04.649476] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-29T17:01:04.655423] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-29T17:01:04.726067] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T17:01:04.736295] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-29T17:01:04.767250] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T17:01:04.779461] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-29T17:01:04.811290] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-29T17:01:04.822876] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-29T17:01:05.768263] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T17:01:05.773987] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-29T17:01:05.921510] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T17:01:05.930891] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-29T17:01:06.940071] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-29T17:01:06.952593] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-29T17:01:07.035587] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T17:01:07.040048] [INFO ] [REMOTE ] ACA: Full fetch complete (34308 records). [2025-09-29T17:01:07.040145] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-29T17:01:07.477332] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-29T17:01:07.477559] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-29T17:01:07.477994] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-29T17:01:07.478100] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-29T17:01:07.479468] [DEBUG] [LOCAL ] ACA: Trimmed 34308 records to 23441 (keeping 200 days of data) [2025-09-29T17:01:07.610693] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-29T17:01:07.624915] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-29T17:01:07.684069] [DEBUG] [LOCAL ] ACA: Primary data saved (23441 records). [2025-09-29T17:01:07.684250] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-29T17:01:07.684352] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 13.5s. Estimated remaining: 3h 1m 43s. Rate: 13.0 symbols/min [2025-09-29T17:01:07.868157] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-29T17:01:07.906874] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-29T17:01:07.908680] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:07.940337] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-29T17:01:07.940627] [INFO ] [MAIN ] ACEL: Loaded 27405 existing records. [2025-09-29T17:01:08.128539] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:08.128827] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-29T17:01:08.128879] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-29T17:01:08.129174] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-29T17:01:08.129239] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-29T17:01:08.522637] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:08.523073] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-29T17:01:08.559607] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T17:01:08.571417] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-29T17:01:09.344631] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:01:09.357055] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-29T17:01:09.398939] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T17:01:09.407714] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-29T17:01:09.827243] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T17:01:09.833204] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-29T17:01:10.158791] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T17:01:10.170008] [INFO ] [REMOTE ] ABR: Full fetch complete (75199 records). [2025-09-29T17:01:10.170176] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-29T17:01:10.623955] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-29T17:01:10.624093] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-29T17:01:10.624924] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-29T17:01:10.625052] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-29T17:01:10.649910] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T17:01:10.658472] [DEBUG] [LOCAL ] ABR: Trimmed 75199 records to 52026 (keeping 200 days of data) [2025-09-29T17:01:10.659915] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-29T17:01:11.004786] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T17:01:11.012222] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-29T17:01:11.036580] [DEBUG] [LOCAL ] ABR: Primary data saved (52026 records). [2025-09-29T17:01:11.036832] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-29T17:01:11.036970] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABR took 21.3s. Estimated remaining: 2h 58m 18s. Rate: 13.2 symbols/min [2025-09-29T17:01:11.233703] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:11.294940] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-29T17:01:11.295307] [INFO ] [MAIN ] ACHR: Loaded 54598 existing records. [2025-09-29T17:01:11.505986] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:11.506561] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-29T17:01:11.506805] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-29T17:01:11.507680] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-29T17:01:11.507762] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-29T17:01:11.717308] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-29T17:01:11.784263] [INFO ] [REMOTE ] ABT: Full fetch complete (77588 records). [2025-09-29T17:01:11.835372] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-29T17:01:12.179068] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:12.195752] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-29T17:01:12.439667] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T17:01:12.478360] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T17:01:12.512200] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-29T17:01:12.525983] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-29T17:01:12.598241] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-29T17:01:12.598373] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-29T17:01:12.599411] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-29T17:01:12.599483] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-29T17:01:12.601675] [DEBUG] [LOCAL ] ABT: Trimmed 77588 records to 53620 (keeping 200 days of data) [2025-09-29T17:01:12.970886] [DEBUG] [LOCAL ] ABT: Primary data saved (53620 records). [2025-09-29T17:01:12.971085] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-29T17:01:12.971188] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABT took 22.3s. Estimated remaining: 2h 51m 50s. Rate: 13.7 symbols/min [2025-09-29T17:01:13.154408] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:13.215559] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-29T17:01:13.216010] [INFO ] [MAIN ] ACI: Loaded 54044 existing records. [2025-09-29T17:01:13.416188] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:13.416489] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-29T17:01:13.416543] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-29T17:01:13.417389] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-29T17:01:13.417457] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-29T17:01:13.848827] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:13.849255] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-29T17:01:13.871008] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:01:13.896354] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:01:13.895547] [INFO ] [REMOTE ] ACCO: Full fetch complete (54196 records). [2025-09-29T17:01:13.899059] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-29T17:01:13.903816] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-29T17:01:14.315785] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-29T17:01:14.315881] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-29T17:01:14.316442] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-29T17:01:14.316495] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-29T17:01:14.317877] [DEBUG] [LOCAL ] ACCO: Trimmed 54196 records to 37516 (keeping 200 days of data) [2025-09-29T17:01:14.561303] [DEBUG] [LOCAL ] ACCO: Primary data saved (37516 records). [2025-09-29T17:01:14.561510] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-29T17:01:14.563033] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 16.7s. Estimated remaining: 2h 45m 20s. Rate: 14.2 symbols/min [2025-09-29T17:01:14.753092] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:14.791814] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-29T17:01:14.804294] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-29T17:01:14.858180] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-29T17:01:14.858541] [INFO ] [MAIN ] ACM: Loaded 43767 existing records. [2025-09-29T17:01:15.059637] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:15.059930] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-29T17:01:15.059986] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-29T17:01:15.060680] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-29T17:01:15.060774] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-29T17:01:15.445420] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:15.445781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-29T17:01:15.556040] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T17:01:15.564194] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-29T17:01:15.888843] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-29T17:01:15.899950] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-29T17:01:16.662952] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T17:01:16.670178] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-29T17:01:17.513612] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-29T17:01:17.475556] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T17:01:17.567013] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-29T17:01:17.582005] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T17:01:17.684044] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T17:01:17.948121] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-29T17:01:18.748109] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-29T17:01:19.119228] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T17:01:19.282394] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:01:19.548124] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-29T17:01:20.159505] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T17:01:20.348145] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-29T17:01:21.153288] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-29T17:01:21.168306] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T17:01:21.948116] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-29T17:01:22.748997] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-29T17:01:22.758342] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-29T17:01:22.924388] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:01:23.315435] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T17:01:23.548106] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-29T17:01:24.228553] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T17:01:24.348153] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-29T17:01:25.148151] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-29T17:01:25.948083] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-29T17:01:26.463951] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-09-29T17:01:26.537009] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T17:01:26.748136] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-29T17:01:26.822399] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:01:27.156233] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T17:01:27.161729] [INFO ] [REMOTE ] ACEL: Full fetch complete (38564 records). [2025-09-29T17:01:27.161835] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-29T17:01:27.162708] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:01:27.162800] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:01:27.162847] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:01:27.162889] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-29T17:01:27.162963] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-29T17:01:27.163022] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-09-29T17:01:27.164109] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-09-29T17:01:27.164275] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 19.5s. Estimated remaining: 3h 3m 32s. Rate: 12.8 symbols/min [2025-09-29T17:01:27.347706] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:27.420055] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-29T17:01:27.420446] [INFO ] [MAIN ] ACN: Loaded 54204 existing records. [2025-09-29T17:01:27.553281] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-29T17:01:27.620843] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:27.621115] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-29T17:01:27.621174] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-29T17:01:27.623084] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-29T17:01:27.623160] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-29T17:01:28.074755] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:28.348137] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-29T17:01:28.998228] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-29T17:01:29.148124] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-29T17:01:29.346448] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:01:29.873450] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:01:29.948138] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-29T17:01:30.748170] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-29T17:01:31.548154] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-29T17:01:31.889249] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-29T17:01:31.933065] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T17:01:32.348135] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-29T17:01:32.550807] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T17:01:32.919122] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T17:01:33.148115] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-29T17:01:33.811116] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:01:33.948208] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-29T17:01:34.748178] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-29T17:01:34.859780] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:01:35.548150] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-29T17:01:35.750415] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T17:01:36.348117] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-29T17:01:37.148095] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-29T17:01:37.454582] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-29T17:01:37.705527] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-29T17:01:37.948132] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-29T17:01:38.136342] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T17:01:38.747578] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T17:01:38.756200] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-29T17:01:39.548158] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-29T17:01:40.348099] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-29T17:01:40.663397] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-29T17:01:40.814197] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:01:41.148161] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-29T17:01:41.401084] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T17:01:41.842379] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:01:41.852271] [INFO ] [REMOTE ] ACM: Full fetch complete (62793 records). [2025-09-29T17:01:41.852425] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-29T17:01:41.953249] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-29T17:01:42.318583] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-29T17:01:42.318718] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-29T17:01:42.319456] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-29T17:01:42.319526] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-29T17:01:42.321066] [DEBUG] [LOCAL ] ACM: Trimmed 62793 records to 43033 (keeping 200 days of data) [2025-09-29T17:01:42.624530] [DEBUG] [LOCAL ] ACM: Primary data saved (43033 records). [2025-09-29T17:01:42.624696] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-29T17:01:42.628229] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACM took 28.1s. Estimated remaining: 3h 25m 42s. Rate: 11.4 symbols/min [2025-09-29T17:01:42.753341] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-29T17:01:42.813170] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:42.848561] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-29T17:01:42.848882] [INFO ] [MAIN ] ACP: Loaded 31428 existing records. [2025-09-29T17:01:43.037011] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:43.037402] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-29T17:01:43.037467] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-29T17:01:43.038186] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-29T17:01:43.038251] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-29T17:01:43.417134] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:43.548164] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-29T17:01:44.089713] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:01:44.101083] [INFO ] [REMOTE ] ACI: Full fetch complete (77045 records). [2025-09-29T17:01:44.101312] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-29T17:01:44.536542] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-29T17:01:44.536715] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-29T17:01:44.537704] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-29T17:01:44.548410] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-29T17:01:44.570776] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (3.42 seconds). [2025-09-29T17:01:44.582265] [DEBUG] [LOCAL ] ACI: Trimmed 77045 records to 53256 (keeping 200 days of data) [2025-09-29T17:01:44.584260] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-29T17:01:44.983876] [DEBUG] [LOCAL ] ACI: Primary data saved (53256 records). [2025-09-29T17:01:44.984062] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-29T17:01:44.989151] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 32.0s. Estimated remaining: 3h 19m 58s. Rate: 11.8 symbols/min [2025-09-29T17:01:45.176236] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:45.201331] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:01:45.210350] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-29T17:01:45.218277] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-29T17:01:45.218531] [INFO ] [MAIN ] ACR: Loaded 6352 existing records. [2025-09-29T17:01:45.414507] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:45.414997] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-29T17:01:45.415052] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-29T17:01:45.454753] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-29T17:01:45.459692] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-29T17:01:45.530269] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-29T17:01:45.869392] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:45.948137] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-29T17:01:46.376920] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T17:01:46.748158] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-29T17:01:47.528697] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T17:01:47.553347] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-29T17:01:47.575592] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.99 seconds). [2025-09-29T17:01:47.587871] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-29T17:01:47.588059] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-29T17:01:48.124616] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-29T17:01:48.124970] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-29T17:01:48.154971] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-29T17:01:48.159152] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-29T17:01:48.159321] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-29T17:01:48.161966] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-29T17:01:48.175232] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-09-29T17:01:48.357581] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-29T17:01:48.528956] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-09-29T17:01:48.529116] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-29T17:01:48.529207] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 37.5s. Estimated remaining: 3h 16m 58s. Rate: 11.9 symbols/min [2025-09-29T17:01:48.716827] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:48.753153] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-29T17:01:48.753527] [INFO ] [MAIN ] ACRE: Loaded 34027 existing records. [2025-09-29T17:01:48.942908] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:48.943127] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-29T17:01:48.943177] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-29T17:01:48.943713] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-29T17:01:48.943774] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-29T17:01:49.153306] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-29T17:01:49.319019] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:49.925898] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T17:01:49.948072] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-29T17:01:50.301419] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T17:01:50.749085] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-29T17:01:50.751633] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T17:01:51.548192] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-29T17:01:52.119806] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T17:01:52.348152] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-29T17:01:53.061074] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:01:53.148154] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-29T17:01:53.888809] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T17:01:53.948119] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-29T17:01:54.462494] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-29T17:01:54.748295] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-29T17:01:54.751315] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T17:01:55.548159] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-29T17:01:56.247937] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:01:56.348269] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-29T17:01:57.066702] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T17:01:57.148124] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-29T17:01:57.685144] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:01:57.697695] [INFO ] [REMOTE ] ACN: Full fetch complete (77114 records). [2025-09-29T17:01:57.697904] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-29T17:01:57.957106] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-29T17:01:58.165705] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-29T17:01:58.165794] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-29T17:01:58.166507] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-29T17:01:58.166573] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-29T17:01:58.168460] [DEBUG] [LOCAL ] ACN: Trimmed 77114 records to 53425 (keeping 200 days of data) [2025-09-29T17:01:58.529305] [DEBUG] [LOCAL ] ACN: Primary data saved (53425 records). [2025-09-29T17:01:58.529500] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-29T17:01:58.529609] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 31.4s. Estimated remaining: 3h 25m 44s. Rate: 11.4 symbols/min [2025-09-29T17:01:58.723938] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:58.748093] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-29T17:01:58.748932] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:01:58.765338] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-29T17:01:58.765808] [INFO ] [MAIN ] ACV: Loaded 7095 existing records. [2025-09-29T17:01:58.887109] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T17:01:58.975803] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:58.976045] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-29T17:01:58.976100] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-29T17:01:58.976365] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-29T17:01:58.976433] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-29T17:01:59.444592] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:59.548131] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-29T17:02:00.067886] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T17:02:00.311175] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:02:00.348152] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-29T17:02:00.948957] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-29T17:02:00.950557] [INFO ] [REMOTE ] ACR: Full fetch complete (8582 records). [2025-09-29T17:02:00.950675] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-29T17:02:01.153233] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-29T17:02:01.358260] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-29T17:02:01.358392] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-29T17:02:01.358732] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-29T17:02:01.358818] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-29T17:02:01.359955] [DEBUG] [LOCAL ] ACR: Trimmed 8582 records to 6054 (keeping 200 days of data) [2025-09-29T17:02:01.413132] [DEBUG] [LOCAL ] ACR: Primary data saved (6054 records). [2025-09-29T17:02:01.413310] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-29T17:02:01.413413] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACR took 16.4s. Estimated remaining: 3h 21m 36s. Rate: 11.6 symbols/min [2025-09-29T17:02:01.603051] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:01.670044] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-29T17:02:01.670391] [INFO ] [MAIN ] ACVA: Loaded 50072 existing records. [2025-09-29T17:02:01.863050] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:01.863492] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-29T17:02:01.863542] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-29T17:02:01.864242] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-29T17:02:01.864309] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-29T17:02:01.953260] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-29T17:02:02.180325] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T17:02:02.291862] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:02.748142] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-29T17:02:03.520198] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:02:03.548063] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-29T17:02:04.060924] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T17:02:04.348123] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-29T17:02:04.984463] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:02:05.148145] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-29T17:02:05.513232] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T17:02:05.948127] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-29T17:02:06.467637] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:02:06.748129] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-29T17:02:07.372570] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T17:02:07.380729] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T17:02:07.548109] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-29T17:02:08.348116] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-29T17:02:09.024775] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T17:02:09.069714] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T17:02:09.148118] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-29T17:02:09.948122] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-29T17:02:10.500771] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T17:02:10.636826] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T17:02:10.748136] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-29T17:02:11.548121] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-29T17:02:12.348124] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-29T17:02:12.467428] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:02:12.981595] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T17:02:12.987868] [INFO ] [REMOTE ] ACP: Full fetch complete (47250 records). [2025-09-29T17:02:12.988046] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-29T17:02:12.992096] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:02:12.992245] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:02:12.992290] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:02:12.992365] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-29T17:02:12.992435] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-29T17:02:12.992474] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-09-29T17:02:12.992905] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-09-29T17:02:12.994295] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACP took 30.4s. Estimated remaining: 3h 31m 60s. Rate: 11.1 symbols/min [2025-09-29T17:02:13.161861] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-29T17:02:13.213545] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:13.214529] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-29T17:02:13.214581] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-29T17:02:13.214780] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-29T17:02:13.214838] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-29T17:02:13.214885] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-29T17:02:13.214922] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-29T17:02:13.634318] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:13.826501] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:02:13.948145] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-29T17:02:14.485400] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T17:02:14.748133] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-29T17:02:14.946317] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T17:02:15.548124] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-29T17:02:15.870081] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T17:02:16.348109] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-29T17:02:17.016151] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T17:02:17.148120] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-29T17:02:17.872763] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T17:02:17.871205] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T17:02:17.948106] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-29T17:02:18.748178] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-29T17:02:18.945844] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:02:18.946156] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-29T17:02:18.946277] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:02:18.946326] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-29T17:02:18.946363] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:02:18.946402] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-29T17:02:18.946462] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-29T17:02:18.946501] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-29T17:02:18.946543] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-29T17:02:18.946593] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 6.0s. Estimated remaining: 3h 32m 44s. Rate: 11.0 symbols/min [2025-09-29T17:02:19.138723] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:19.194560] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-29T17:02:19.194926] [INFO ] [MAIN ] ADC: Loaded 46934 existing records. [2025-09-29T17:02:19.415920] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:19.416250] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-29T17:02:19.416320] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-29T17:02:19.417243] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-29T17:02:19.417305] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-29T17:02:19.548485] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-29T17:02:19.844695] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:19.880541] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T17:02:20.245921] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:02:20.348129] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-29T17:02:21.148159] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-29T17:02:21.719439] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T17:02:21.726632] [INFO ] [REMOTE ] ACRE: Full fetch complete (50587 records). [2025-09-29T17:02:21.726784] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-29T17:02:21.959578] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-29T17:02:22.166456] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-29T17:02:22.166551] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-29T17:02:22.167205] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-29T17:02:22.167277] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-29T17:02:22.168818] [DEBUG] [LOCAL ] ACRE: Trimmed 50587 records to 33528 (keeping 200 days of data) [2025-09-29T17:02:22.386492] [DEBUG] [LOCAL ] ACRE: Primary data saved (33528 records). [2025-09-29T17:02:22.386676] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-29T17:02:22.386812] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 33.9s. Estimated remaining: 3h 29m 39s. Rate: 11.2 symbols/min [2025-09-29T17:02:22.588685] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:22.626495] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-29T17:02:22.626857] [INFO ] [MAIN ] ADCT: Loaded 34670 existing records. [2025-09-29T17:02:22.753203] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-29T17:02:22.831160] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:22.831803] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-29T17:02:22.831913] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-29T17:02:22.832419] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-29T17:02:22.832498] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-29T17:02:23.238489] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:23.271110] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T17:02:23.307588] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T17:02:23.403990] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-29T17:02:23.548171] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-29T17:02:24.348152] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-29T17:02:25.115533] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T17:02:25.148104] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-29T17:02:25.735599] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T17:02:25.948147] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-29T17:02:26.706321] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:02:26.748111] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-29T17:02:27.038041] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T17:02:27.548169] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-29T17:02:28.348124] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-29T17:02:28.475997] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T17:02:28.983639] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:02:29.148131] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-29T17:02:29.957351] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-29T17:02:29.969079] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:02:30.034562] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:02:30.723263] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T17:02:30.748141] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-29T17:02:31.548168] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-29T17:02:31.604479] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T17:02:31.607281] [INFO ] [REMOTE ] ACV: Full fetch complete (9856 records). [2025-09-29T17:02:31.607398] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-29T17:02:32.051058] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-29T17:02:32.051176] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-29T17:02:32.051482] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-29T17:02:32.051562] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-29T17:02:32.052195] [DEBUG] [LOCAL ] ACV: Trimmed 9856 records to 7105 (keeping 200 days of data) [2025-09-29T17:02:32.102496] [DEBUG] [LOCAL ] ACV: Primary data saved (7105 records). [2025-09-29T17:02:32.102676] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-29T17:02:32.103017] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACV took 33.6s. Estimated remaining: 3h 35m 51s. Rate: 10.9 symbols/min [2025-09-29T17:02:32.285289] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:32.347873] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-29T17:02:32.348184] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-29T17:02:32.350766] [INFO ] [MAIN ] ADM: Loaded 54175 existing records. [2025-09-29T17:02:32.548228] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:32.548537] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-29T17:02:32.548588] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-29T17:02:32.549536] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-29T17:02:32.549613] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-29T17:02:32.930738] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:32.950395] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T17:02:33.148171] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-29T17:02:33.948491] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-29T17:02:34.150301] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T17:02:34.428007] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T17:02:34.748135] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-29T17:02:35.548124] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-29T17:02:35.697300] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:02:36.348115] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-29T17:02:36.585173] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T17:02:37.001454] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T17:02:37.148156] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-29T17:02:37.948150] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-29T17:02:38.117957] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:02:38.748162] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-29T17:02:38.967512] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:02:38.978885] [INFO ] [REMOTE ] ACVA: Full fetch complete (70273 records). [2025-09-29T17:02:38.979068] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-29T17:02:39.413134] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-29T17:02:39.427186] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-29T17:02:39.438762] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-29T17:02:39.439089] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-29T17:02:39.441137] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T17:02:39.452356] [DEBUG] [LOCAL ] ACVA: Trimmed 70273 records to 49259 (keeping 200 days of data) [2025-09-29T17:02:39.548330] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-29T17:02:39.767964] [DEBUG] [LOCAL ] ACVA: Primary data saved (49259 records). [2025-09-29T17:02:39.768119] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-29T17:02:39.769220] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 38.4s. Estimated remaining: 3h 38m 45s. Rate: 10.7 symbols/min [2025-09-29T17:02:39.950662] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:40.010508] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-29T17:02:40.010921] [INFO ] [MAIN ] ADNT: Loaded 48095 existing records. [2025-09-29T17:02:40.206325] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:40.206575] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-29T17:02:40.206637] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-29T17:02:40.207176] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-29T17:02:40.207240] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-29T17:02:40.358378] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-29T17:02:40.658976] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:40.694358] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T17:02:41.148101] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-29T17:02:41.337505] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:02:41.948137] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-29T17:02:41.993987] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T17:02:42.748106] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-29T17:02:42.786996] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T17:02:43.507528] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T17:02:43.548129] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-29T17:02:44.171119] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T17:02:44.348126] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-29T17:02:45.148171] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-29T17:02:45.460727] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T17:02:45.954007] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-29T17:02:45.959229] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:02:46.722377] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T17:02:46.748077] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-29T17:02:47.548180] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-29T17:02:47.608011] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T17:02:47.622197] [INFO ] [REMOTE ] ADCT: Full fetch complete (51576 records). [2025-09-29T17:02:47.622491] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-29T17:02:48.045891] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-29T17:02:48.046138] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-29T17:02:48.046821] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-29T17:02:48.046909] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-29T17:02:48.048406] [DEBUG] [LOCAL ] ADCT: Trimmed 51576 records to 34320 (keeping 200 days of data) [2025-09-29T17:02:48.181861] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:02:48.291830] [DEBUG] [LOCAL ] ADCT: Primary data saved (34320 records). [2025-09-29T17:02:48.291999] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-29T17:02:48.292094] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADCT took 25.9s. Estimated remaining: 3h 42m 35s. Rate: 10.5 symbols/min [2025-09-29T17:02:48.353300] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-29T17:02:48.478514] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:48.539571] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-29T17:02:48.539974] [INFO ] [MAIN ] ADT: Loaded 54253 existing records. [2025-09-29T17:02:48.732145] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:48.732385] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-29T17:02:48.732447] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-29T17:02:48.733089] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-29T17:02:48.733155] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-29T17:02:49.145052] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:49.148072] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-29T17:02:49.185728] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:02:49.666204] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T17:02:49.675773] [INFO ] [REMOTE ] ADC: Full fetch complete (66099 records). [2025-09-29T17:02:49.675932] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-29T17:02:49.957156] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-29T17:02:50.106681] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-29T17:02:50.106832] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-29T17:02:50.107704] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-29T17:02:50.107779] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-29T17:02:50.109280] [DEBUG] [LOCAL ] ADC: Trimmed 66099 records to 46182 (keeping 200 days of data) [2025-09-29T17:02:50.430296] [DEBUG] [LOCAL ] ADC: Primary data saved (46182 records). [2025-09-29T17:02:50.430458] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-29T17:02:50.431534] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADC took 31.5s. Estimated remaining: 3h 37m 51s. Rate: 10.7 symbols/min [2025-09-29T17:02:50.634618] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:50.672844] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-29T17:02:50.673114] [INFO ] [MAIN ] ADX: Loaded 28180 existing records. [2025-09-29T17:02:50.753255] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-29T17:02:50.870544] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:50.870792] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-29T17:02:50.870924] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-29T17:02:50.871504] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-29T17:02:50.871571] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-29T17:02:51.299076] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:51.305675] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T17:02:51.541767] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T17:02:51.551570] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-29T17:02:52.348154] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-29T17:02:52.860453] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T17:02:53.148171] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-29T17:02:53.247709] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:02:53.948135] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-29T17:02:54.102677] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:02:54.748089] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-29T17:02:55.187487] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T17:02:55.548125] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-29T17:02:55.751223] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:02:56.348118] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-29T17:02:56.501925] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T17:02:57.061592] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:02:57.148110] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-29T17:02:57.948117] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-29T17:02:58.084591] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:02:58.156523] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T17:02:58.748113] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-29T17:02:59.552706] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-29T17:02:59.559034] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:03:00.348089] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-29T17:03:00.491309] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T17:03:00.781009] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T17:03:01.148130] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-29T17:03:01.577597] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T17:03:01.948156] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-29T17:03:02.748204] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-29T17:03:02.910128] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T17:03:03.548119] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-29T17:03:03.654163] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:03:04.348240] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-29T17:03:05.148190] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-29T17:03:05.532842] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-29T17:03:05.634831] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T17:03:05.948149] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-29T17:03:06.748174] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-29T17:03:06.993472] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (4.25 seconds). [2025-09-29T17:03:07.347325] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-29T17:03:07.525305] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T17:03:07.535683] [INFO ] [REMOTE ] ADNT: Full fetch complete (67750 records). [2025-09-29T17:03:07.535861] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-29T17:03:07.536914] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:03:07.537062] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:03:07.537125] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:03:07.537171] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-29T17:03:07.537245] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-29T17:03:07.537314] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-09-29T17:03:07.538252] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-09-29T17:03:07.539155] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADNT took 27.8s. Estimated remaining: 3h 52m 16s. Rate: 10.1 symbols/min [2025-09-29T17:03:07.553297] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-29T17:03:07.724280] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:07.789600] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-29T17:03:07.790158] [INFO ] [MAIN ] AEE: Loaded 50875 existing records. [2025-09-29T17:03:07.979035] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:07.979259] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-29T17:03:07.979310] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-29T17:03:07.980419] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-29T17:03:07.980482] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-29T17:03:08.361422] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:08.353608] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-29T17:03:09.148107] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-29T17:03:09.386712] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-29T17:03:09.513787] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T17:03:09.619125] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:03:09.948159] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-29T17:03:10.748173] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-29T17:03:10.811666] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T17:03:11.119297] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:03:11.548116] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-29T17:03:12.348140] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-29T17:03:12.469269] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T17:03:12.767409] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T17:03:12.778364] [INFO ] [REMOTE ] ADM: Full fetch complete (76844 records). [2025-09-29T17:03:12.778573] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-29T17:03:12.779749] [FATAL] [VALIDATOR ] ADM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:03:12.779896] [FATAL] [MAIN ] ADM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:03:12.779950] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:03:12.780005] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-29T17:03:12.780094] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-29T17:03:12.780199] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-09-29T17:03:12.781183] [DEBUG] [LOCAL ] ADM: Deleted derivative data file. [2025-09-29T17:03:12.781314] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADM took 40.7s. Estimated remaining: 3h 51m 17s. Rate: 10.1 symbols/min [2025-09-29T17:03:12.994339] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:13.008334] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-29T17:03:13.008600] [INFO ] [MAIN ] AEFC: Loaded 8643 existing records. [2025-09-29T17:03:13.156738] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-29T17:03:13.207064] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:13.207461] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-29T17:03:13.207525] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-29T17:03:13.207742] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-29T17:03:13.207800] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-29T17:03:13.603887] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:13.948175] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-29T17:03:14.225761] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:03:14.748176] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-29T17:03:14.845036] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T17:03:14.961827] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T17:03:15.548166] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-29T17:03:16.256561] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T17:03:16.348156] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-29T17:03:17.148133] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-29T17:03:17.182889] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:03:17.537386] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:03:17.948143] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-29T17:03:18.665298] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T17:03:18.748112] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-29T17:03:19.078325] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T17:03:19.482001] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T17:03:19.548168] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-29T17:03:20.348194] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-29T17:03:21.148146] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-29T17:03:21.417627] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T17:03:21.948112] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-29T17:03:22.250053] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:03:22.261370] [INFO ] [REMOTE ] ADT: Full fetch complete (77202 records). [2025-09-29T17:03:22.261561] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-29T17:03:22.615440] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T17:03:22.688070] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T17:03:22.730987] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-29T17:03:22.731254] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-29T17:03:22.732099] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-29T17:03:22.732195] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-29T17:03:22.732360] [INFO ] [REMOTE ] ADX: Full fetch complete (42074 records). [2025-09-29T17:03:22.732597] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-29T17:03:22.748935] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-29T17:03:22.795580] [DEBUG] [LOCAL ] ADT: Trimmed 77202 records to 53469 (keeping 200 days of data) [2025-09-29T17:03:23.296183] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-29T17:03:23.298007] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-29T17:03:23.298809] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-29T17:03:23.301603] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-29T17:03:23.305350] [DEBUG] [LOCAL ] ADX: Trimmed 42074 records to 27588 (keeping 200 days of data) [2025-09-29T17:03:23.548186] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-29T17:03:23.660191] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T17:03:23.728326] [DEBUG] [LOCAL ] ADX: Primary data saved (27588 records). [2025-09-29T17:03:23.729325] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-29T17:03:23.729733] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 33.3s. Estimated remaining: 3h 57m 7s. Rate: 9.9 symbols/min [2025-09-29T17:03:23.938254] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:23.944373] [DEBUG] [LOCAL ] ADT: Primary data saved (53469 records). [2025-09-29T17:03:23.944568] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-29T17:03:23.944720] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADT took 35.7s. Estimated remaining: 3h 50m 17s. Rate: 10.1 symbols/min [2025-09-29T17:03:24.146050] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:24.163180] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-29T17:03:24.163549] [INFO ] [MAIN ] AEG: Loaded 50307 existing records. [2025-09-29T17:03:24.355054] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-29T17:03:24.354860] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:24.356180] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-29T17:03:24.356283] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-29T17:03:24.356831] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-29T17:03:24.356992] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-29T17:03:24.590199] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-29T17:03:24.664205] [INFO ] [MAIN ] AEM: Loaded 54243 existing records. [2025-09-29T17:03:24.977959] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:24.998574] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:24.999513] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-29T17:03:24.999788] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-29T17:03:25.001103] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-29T17:03:25.001169] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-29T17:03:25.150436] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-29T17:03:25.395073] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:25.404574] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:03:25.436338] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T17:03:25.948138] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-29T17:03:26.748105] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-29T17:03:27.004084] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T17:03:27.548137] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-29T17:03:27.770604] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T17:03:28.046866] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T17:03:28.348092] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-29T17:03:28.582545] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T17:03:29.148126] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-29T17:03:29.749181] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-29T17:03:29.948086] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-29T17:03:29.977528] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T17:03:30.680296] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T17:03:30.748091] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-29T17:03:31.548176] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-29T17:03:32.348098] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-29T17:03:32.622057] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T17:03:33.132807] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T17:03:33.148070] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-29T17:03:33.948140] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-29T17:03:34.120900] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T17:03:34.446043] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T17:03:34.448109] [INFO ] [REMOTE ] AEFC: Full fetch complete (12261 records). [2025-09-29T17:03:34.448189] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-29T17:03:34.753232] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-29T17:03:34.856715] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-29T17:03:34.856959] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-29T17:03:34.857272] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-29T17:03:34.857355] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-29T17:03:34.872568] [DEBUG] [LOCAL ] AEFC: Trimmed 12261 records to 8491 (keeping 200 days of data) [2025-09-29T17:03:34.906254] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T17:03:34.948559] [DEBUG] [LOCAL ] AEFC: Primary data saved (8491 records). [2025-09-29T17:03:34.948728] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-29T17:03:34.948834] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 22.2s. Estimated remaining: 3h 55m 51s. Rate: 9.9 symbols/min [2025-09-29T17:03:35.124765] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:35.193820] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-29T17:03:35.194203] [INFO ] [MAIN ] AEO: Loaded 54336 existing records. [2025-09-29T17:03:35.402968] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:35.403268] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-29T17:03:35.403325] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-29T17:03:35.404300] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-29T17:03:35.404363] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-29T17:03:35.553240] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-29T17:03:35.781024] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:36.348112] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-29T17:03:36.461673] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T17:03:37.148172] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-29T17:03:37.390149] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T17:03:37.948159] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-29T17:03:38.323870] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-29T17:03:38.748091] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-29T17:03:39.092621] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:03:39.548119] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-29T17:03:39.819629] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:03:40.336204] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:03:40.348089] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-29T17:03:41.148121] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-29T17:03:41.335823] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:03:41.352850] [INFO ] [REMOTE ] AEE: Full fetch complete (72568 records). [2025-09-29T17:03:41.353059] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-29T17:03:41.819511] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-29T17:03:41.819609] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-29T17:03:41.820302] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-29T17:03:41.820369] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-29T17:03:41.822022] [DEBUG] [LOCAL ] AEE: Trimmed 72568 records to 50084 (keeping 200 days of data) [2025-09-29T17:03:41.948189] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-29T17:03:42.173419] [DEBUG] [LOCAL ] AEE: Primary data saved (50084 records). [2025-09-29T17:03:42.173560] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-29T17:03:42.177600] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 34.6s. Estimated remaining: 3h 57m 1s. Rate: 9.9 symbols/min [2025-09-29T17:03:42.378222] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:42.442482] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-29T17:03:42.442855] [INFO ] [MAIN ] AER: Loaded 49271 existing records. [2025-09-29T17:03:42.640003] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:42.640325] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-29T17:03:42.640382] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-29T17:03:42.657462] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-29T17:03:42.669829] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-29T17:03:42.738604] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-29T17:03:42.812348] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-29T17:03:43.089314] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T17:03:43.133711] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:43.548084] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-29T17:03:43.630906] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T17:03:44.348118] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-29T17:03:44.962009] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-29T17:03:45.148087] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-29T17:03:45.351472] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:03:45.948091] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-29T17:03:46.041536] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T17:03:46.748171] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-29T17:03:46.798131] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:03:47.548169] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-29T17:03:47.683214] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T17:03:48.348161] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-29T17:03:48.382729] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T17:03:49.148115] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-29T17:03:49.278392] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T17:03:49.948126] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-29T17:03:50.389809] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T17:03:50.433152] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T17:03:50.748117] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-29T17:03:51.548119] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-29T17:03:51.794384] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T17:03:52.348151] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-29T17:03:52.421107] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:03:53.148139] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-29T17:03:53.617407] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T17:03:53.948087] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-29T17:03:54.282518] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T17:03:54.748119] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-29T17:03:55.018868] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T17:03:55.029068] [INFO ] [REMOTE ] AEG: Full fetch complete (70339 records). [2025-09-29T17:03:55.029203] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-29T17:03:55.442315] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-29T17:03:55.442412] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-29T17:03:55.443296] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-29T17:03:55.443366] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-29T17:03:55.444897] [DEBUG] [LOCAL ] AEG: Trimmed 70339 records to 49547 (keeping 200 days of data) [2025-09-29T17:03:55.550279] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-29T17:03:55.704492] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:03:55.836900] [DEBUG] [LOCAL ] AEG: Primary data saved (49547 records). [2025-09-29T17:03:55.837122] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-29T17:03:55.838942] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 32.1s. Estimated remaining: 4h 4m 53s. Rate: 9.5 symbols/min [2025-09-29T17:03:56.348106] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-29T17:03:56.803663] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T17:03:57.148109] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-29T17:03:58.485961] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:03:58.497762] [INFO ] [REMOTE ] AEM: Full fetch complete (77149 records). [2025-09-29T17:03:58.497935] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-29T17:03:58.939870] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-29T17:03:58.940083] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-29T17:03:58.941049] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-29T17:03:58.951290] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-29T17:03:58.971982] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T17:03:58.982957] [DEBUG] [LOCAL ] AEM: Trimmed 77149 records to 53465 (keeping 200 days of data) [2025-09-29T17:03:58.984557] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-29T17:03:59.378608] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (3.83 seconds). [2025-09-29T17:03:59.380904] [DEBUG] [LOCAL ] AEM: Primary data saved (53465 records). [2025-09-29T17:03:59.394261] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-29T17:03:59.395169] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 35.5s. Estimated remaining: 4h 1m 58s. Rate: 9.6 symbols/min [2025-09-29T17:03:59.395902] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-29T17:04:01.134437] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:04:01.145220] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-29T17:04:01.321513] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-29T17:04:01.335316] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-29T17:04:02.767551] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:04:02.777287] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-29T17:04:03.611249] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-29T17:04:03.624235] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-29T17:04:04.450251] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T17:04:04.461810] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-29T17:04:05.762852] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:04:05.774453] [INFO ] [REMOTE ] AEO: Full fetch complete (77444 records). [2025-09-29T17:04:05.774704] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-29T17:04:06.205811] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-29T17:04:06.206084] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-29T17:04:06.206989] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-29T17:04:06.207349] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-29T17:04:06.219455] [DEBUG] [LOCAL ] AEO: Trimmed 77444 records to 53558 (keeping 200 days of data) [2025-09-29T17:04:06.240626] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T17:04:06.317139] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-29T17:04:06.596810] [DEBUG] [LOCAL ] AEO: Primary data saved (53558 records). [2025-09-29T17:04:06.596968] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-29T17:04:06.597077] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEO took 31.6s. Estimated remaining: 4h 2m 50s. Rate: 9.6 symbols/min [2025-09-29T17:04:08.202797] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T17:04:08.213003] [INFO ] [REMOTE ] AER: Full fetch complete (69556 records). [2025-09-29T17:04:08.213188] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-29T17:04:08.664081] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-29T17:04:08.664180] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-29T17:04:08.665109] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-29T17:04:08.665181] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-29T17:04:08.666750] [DEBUG] [LOCAL ] AER: Trimmed 69556 records to 48447 (keeping 200 days of data) [2025-09-29T17:04:08.997947] [DEBUG] [LOCAL ] AER: Primary data saved (48447 records). [2025-09-29T17:04:08.998104] [INFO ] [MAIN ] AER: Full history saved. [2025-09-29T17:04:08.999361] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AER took 26.8s. Estimated remaining: 3h 59m 0s. Rate: 9.8 symbols/min [2025-09-29T17:04:09.730777] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:09.823376] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:09.809930] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:09.831774] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-29T17:04:09.837631] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-29T17:04:09.838261] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-29T17:04:09.838347] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-29T17:04:09.838426] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-29T17:04:09.838477] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-29T17:04:09.868772] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:09.950131] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-29T17:04:09.980827] [INFO ] [MAIN ] AFB: Loaded 11422 existing records. [2025-09-29T17:04:10.427327] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:10.442020] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-29T17:04:10.442688] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-29T17:04:10.441729] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-29T17:04:10.485021] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-29T17:04:10.463479] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-29T17:04:10.502254] [INFO ] [MAIN ] AESI: Loaded 50213 existing records. [2025-09-29T17:04:10.507611] [INFO ] [MAIN ] AES: Loaded 54450 existing records. [2025-09-29T17:04:10.529206] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-29T17:04:10.658765] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:10.784621] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-29T17:04:11.159057] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:04:11.186884] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-29T17:04:11.196843] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:11.237357] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-29T17:04:11.229687] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:11.237870] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-29T17:04:11.237703] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:04:11.237969] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-29T17:04:11.253405] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-29T17:04:11.274455] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:04:11.285048] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-29T17:04:11.269224] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-29T17:04:11.290474] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-29T17:04:11.290569] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-29T17:04:11.301061] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-29T17:04:11.308027] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-29T17:04:11.307970] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-29T17:04:11.308246] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.3s. Estimated remaining: 3h 55m 16s. Rate: 9.9 symbols/min [2025-09-29T17:04:11.336272] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-29T17:04:11.368814] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-29T17:04:11.696918] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:11.703328] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-29T17:04:11.880673] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:12.350924] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:12.368332] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-29T17:04:12.451284] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:12.451905] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-29T17:04:12.453015] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-29T17:04:12.454392] [INFO ] [MAIN ] AFG: Loaded 33021 existing records. [2025-09-29T17:04:12.654438] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:12.654697] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-29T17:04:12.654760] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-29T17:04:12.655071] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-29T17:04:12.655189] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-29T17:04:13.013598] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T17:04:13.043546] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-29T17:04:13.102159] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:13.102787] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-29T17:04:13.914594] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T17:04:13.918993] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-29T17:04:14.020098] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:04:14.031219] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-29T17:04:14.549423] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T17:04:14.554971] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-29T17:04:14.629241] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T17:04:14.640913] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-29T17:04:14.849948] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T17:04:14.852848] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-29T17:04:15.509035] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:04:15.519014] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-29T17:04:15.727498] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T17:04:15.736153] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-29T17:04:15.802488] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T17:04:15.808805] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-29T17:04:16.660579] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-29T17:04:16.662327] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T17:04:16.677028] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-29T17:04:16.678340] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-29T17:04:16.915153] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T17:04:17.148134] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-29T17:04:17.183167] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T17:04:17.542816] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T17:04:17.948163] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-29T17:04:18.451259] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T17:04:18.572933] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:04:18.748153] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-29T17:04:19.548089] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-29T17:04:19.634841] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T17:04:19.994367] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T17:04:20.348177] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-29T17:04:21.148148] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-29T17:04:21.927398] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T17:04:21.948098] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-29T17:04:22.016467] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:04:22.748153] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-29T17:04:23.065243] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (3.52 seconds). [2025-09-29T17:04:23.327505] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T17:04:23.548112] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-29T17:04:23.762689] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T17:04:24.348146] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-29T17:04:24.984433] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:04:25.148122] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-29T17:04:25.319241] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T17:04:25.322986] [INFO ] [REMOTE ] AFB: Full fetch complete (16558 records). [2025-09-29T17:04:25.323136] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-29T17:04:25.778123] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-29T17:04:25.778466] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-29T17:04:25.778772] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-29T17:04:25.778852] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-29T17:04:25.779541] [DEBUG] [LOCAL ] AFB: Trimmed 16558 records to 11281 (keeping 200 days of data) [2025-09-29T17:04:25.853215] [DEBUG] [LOCAL ] AFB: Primary data saved (11281 records). [2025-09-29T17:04:25.853360] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-29T17:04:25.853476] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 16.8s. Estimated remaining: 4h 3m 0s. Rate: 9.6 symbols/min [2025-09-29T17:04:25.953272] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-29T17:04:26.043072] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:26.047390] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-29T17:04:26.047605] [INFO ] [MAIN ] AFGB: Loaded 2404 existing records. [2025-09-29T17:04:26.244942] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:26.245326] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-29T17:04:26.245441] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-29T17:04:26.246045] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-29T17:04:26.246116] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-29T17:04:26.642662] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:26.748139] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-29T17:04:27.244461] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T17:04:27.314720] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-29T17:04:27.548184] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-29T17:04:27.952009] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T17:04:28.348122] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-29T17:04:29.100270] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:04:29.148098] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-29T17:04:29.605272] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T17:04:29.948147] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-29T17:04:30.486881] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-29T17:04:30.748124] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-29T17:04:31.548136] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-29T17:04:31.674198] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T17:04:32.348144] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-29T17:04:32.594544] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:04:32.898307] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T17:04:32.919635] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T17:04:33.148148] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-29T17:04:33.699682] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T17:04:33.948118] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-29T17:04:34.411190] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T17:04:34.748128] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-29T17:04:35.297807] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T17:04:35.548114] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-29T17:04:36.046997] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T17:04:36.348156] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-29T17:04:37.148153] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-29T17:04:37.634931] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T17:04:37.808860] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T17:04:37.948113] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-29T17:04:38.748171] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-29T17:04:39.548116] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-29T17:04:40.032182] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:04:40.076000] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T17:04:40.348114] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-29T17:04:41.148102] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-29T17:04:41.948110] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-29T17:04:42.076719] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-29T17:04:42.531083] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T17:04:42.532309] [INFO ] [REMOTE ] AFGB: Full fetch complete (3655 records). [2025-09-29T17:04:42.532449] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-29T17:04:42.777700] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-29T17:04:42.777566] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-29T17:04:42.860971] [INFO ] [REMOTE ] AFG: Full fetch complete (45788 records). [2025-09-29T17:04:42.871710] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-29T17:04:43.123050] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-29T17:04:43.128736] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-29T17:04:43.209224] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-29T17:04:43.231520] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-29T17:04:43.265284] [DEBUG] [LOCAL ] AFGB: Trimmed 3655 records to 2333 (keeping 200 days of data) [2025-09-29T17:04:43.445492] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-29T17:04:43.450924] [DEBUG] [LOCAL ] AFGB: Primary data saved (2333 records). [2025-09-29T17:04:43.476394] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-29T17:04:43.491848] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AFGB took 17.6s. Estimated remaining: 4h 13m 10s. Rate: 9.2 symbols/min [2025-09-29T17:04:43.495194] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-29T17:04:43.539920] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-29T17:04:43.553348] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-29T17:04:43.575979] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-29T17:04:43.581269] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-29T17:04:43.622822] [DEBUG] [LOCAL ] AFG: Trimmed 45788 records to 32404 (keeping 200 days of data) [2025-09-29T17:04:43.682838] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:43.689588] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-29T17:04:43.744015] [INFO ] [MAIN ] AFGC: Loaded 2602 existing records. [2025-09-29T17:04:43.986905] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:43.989628] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-29T17:04:43.990037] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-29T17:04:43.991881] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-29T17:04:43.991969] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-29T17:04:44.398823] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:44.400867] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-29T17:04:44.490899] [DEBUG] [LOCAL ] AFG: Primary data saved (32404 records). [2025-09-29T17:04:44.491065] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-29T17:04:44.491196] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFG took 33.2s. Estimated remaining: 4h 8m 11s. Rate: 9.4 symbols/min [2025-09-29T17:04:44.698955] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T17:04:44.719406] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:44.735039] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-29T17:04:44.735241] [INFO ] [MAIN ] AFGD: Loaded 1859 existing records. [2025-09-29T17:04:44.924281] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:44.924546] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-29T17:04:44.924611] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-29T17:04:44.925014] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-29T17:04:44.925080] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-29T17:04:45.054816] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-29T17:04:45.152765] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-29T17:04:45.323034] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:45.749344] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-29T17:04:45.762534] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-09-29T17:04:45.762737] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-29T17:04:45.872744] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T17:04:45.951502] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-29T17:04:46.204269] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-29T17:04:46.204359] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-29T17:04:46.205159] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-29T17:04:46.205229] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-29T17:04:46.207159] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53670 (keeping 200 days of data) [2025-09-29T17:04:46.531995] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T17:04:46.562502] [DEBUG] [LOCAL ] AES: Primary data saved (53670 records). [2025-09-29T17:04:46.562714] [INFO ] [MAIN ] AES: Full history saved. [2025-09-29T17:04:46.562873] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AES took 37.6s. Estimated remaining: 4h 4m 21s. Rate: 9.5 symbols/min [2025-09-29T17:04:46.754721] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:46.752448] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-29T17:04:46.760875] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-29T17:04:46.761112] [INFO ] [MAIN ] AFGE: Loaded 2512 existing records. [2025-09-29T17:04:46.950156] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:46.950412] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-29T17:04:46.950471] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-29T17:04:46.950699] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-29T17:04:46.950759] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-29T17:04:47.251779] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T17:04:47.342727] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:47.548137] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-29T17:04:48.348119] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-29T17:04:48.863854] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T17:04:49.148085] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-29T17:04:49.407262] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T17:04:49.418138] [INFO ] [REMOTE ] AESI: Full fetch complete (70359 records). [2025-09-29T17:04:49.418335] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-29T17:04:49.839525] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-29T17:04:49.839799] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-29T17:04:49.840577] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-29T17:04:49.840753] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-29T17:04:49.845792] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-29T17:04:49.850337] [DEBUG] [LOCAL ] AESI: Trimmed 70359 records to 49449 (keeping 200 days of data) [2025-09-29T17:04:49.948232] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-29T17:04:50.176156] [DEBUG] [LOCAL ] AESI: Primary data saved (49449 records). [2025-09-29T17:04:50.176304] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-29T17:04:50.176396] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AESI took 41.2s. Estimated remaining: 4h 1m 59s. Rate: 9.6 symbols/min [2025-09-29T17:04:50.352498] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:50.419397] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-29T17:04:50.419821] [INFO ] [MAIN ] AFL: Loaded 53915 existing records. [2025-09-29T17:04:50.619351] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:50.619570] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-29T17:04:50.619624] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-29T17:04:50.620231] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-29T17:04:50.620297] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-29T17:04:50.700485] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T17:04:50.753214] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-29T17:04:51.024335] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:51.311014] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T17:04:51.548121] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-29T17:04:52.025034] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T17:04:52.348127] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-29T17:04:52.777219] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T17:04:53.148120] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-29T17:04:53.602445] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T17:04:53.948119] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-29T17:04:54.748128] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-29T17:04:55.223203] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T17:04:55.548155] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-29T17:04:55.865102] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:04:56.004305] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-29T17:04:56.348110] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-29T17:04:56.795608] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T17:04:57.148117] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-29T17:04:57.601480] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T17:04:57.948111] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-29T17:04:58.748147] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-29T17:04:59.248460] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T17:04:59.548087] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-29T17:04:59.669800] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:05:00.188901] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T17:05:00.348107] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-29T17:05:00.897350] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T17:05:01.148115] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-29T17:05:01.948116] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-29T17:05:02.636770] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T17:05:02.748105] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-29T17:05:02.927888] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:05:03.199576] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-29T17:05:03.548130] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-29T17:05:03.992264] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T17:05:04.348132] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-29T17:05:04.831089] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T17:05:05.148144] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-29T17:05:05.948179] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-29T17:05:06.494510] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T17:05:06.748152] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-29T17:05:07.213999] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:05:07.299688] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T17:05:07.300830] [INFO ] [REMOTE ] AFGD: Full fetch complete (3159 records). [2025-09-29T17:05:07.300906] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-29T17:05:07.553244] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-29T17:05:07.693608] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-29T17:05:07.693728] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-29T17:05:07.693865] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-29T17:05:07.693939] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-29T17:05:07.694444] [DEBUG] [LOCAL ] AFGD: Trimmed 3159 records to 1812 (keeping 200 days of data) [2025-09-29T17:05:07.707020] [DEBUG] [LOCAL ] AFGD: Primary data saved (1812 records). [2025-09-29T17:05:07.707207] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-29T17:05:07.707332] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 23.2s. Estimated remaining: 4h 11m 11s. Rate: 9.3 symbols/min [2025-09-29T17:05:07.898815] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:07.961292] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-29T17:05:07.961700] [INFO ] [MAIN ] AG: Loaded 54423 existing records. [2025-09-29T17:05:08.154097] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:08.154330] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-29T17:05:08.154379] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-29T17:05:08.154929] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-29T17:05:08.154992] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-29T17:05:08.268322] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T17:05:08.353276] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-29T17:05:08.558630] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:09.057521] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T17:05:09.148124] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-29T17:05:09.948119] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-29T17:05:10.571854] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T17:05:10.748117] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-29T17:05:11.084972] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T17:05:11.537397] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T17:05:11.548058] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-29T17:05:12.321705] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T17:05:12.322995] [INFO ] [REMOTE ] AFGC: Full fetch complete (3731 records). [2025-09-29T17:05:12.323073] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-29T17:05:12.355461] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-29T17:05:12.712254] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-29T17:05:12.712342] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-29T17:05:12.712475] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-29T17:05:12.712513] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-29T17:05:12.712889] [DEBUG] [LOCAL ] AFGC: Trimmed 3731 records to 2542 (keeping 200 days of data) [2025-09-29T17:05:12.729011] [DEBUG] [LOCAL ] AFGC: Primary data saved (2542 records). [2025-09-29T17:05:12.729088] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-29T17:05:12.729157] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 29.2s. Estimated remaining: 4h 9m 53s. Rate: 9.3 symbols/min [2025-09-29T17:05:12.903809] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:12.974867] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-29T17:05:12.975234] [INFO ] [MAIN ] AGCO: Loaded 43086 existing records. [2025-09-29T17:05:13.162232] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-29T17:05:13.168356] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:13.170020] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-29T17:05:13.170097] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-29T17:05:13.170601] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-29T17:05:13.170785] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-29T17:05:13.545807] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:13.948208] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-29T17:05:14.432000] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T17:05:14.748097] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-29T17:05:14.940839] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:05:15.233582] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:05:15.422023] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T17:05:15.423242] [INFO ] [REMOTE ] AFGE: Full fetch complete (3469 records). [2025-09-29T17:05:15.423337] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-29T17:05:15.553216] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-29T17:05:15.851681] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-29T17:05:15.851774] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-29T17:05:15.851936] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-29T17:05:15.852002] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-29T17:05:15.852380] [DEBUG] [LOCAL ] AFGE: Trimmed 3469 records to 2470 (keeping 200 days of data) [2025-09-29T17:05:15.868597] [DEBUG] [LOCAL ] AFGE: Primary data saved (2470 records). [2025-09-29T17:05:15.868771] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-29T17:05:15.868885] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 29.3s. Estimated remaining: 4h 7m 10s. Rate: 9.4 symbols/min [2025-09-29T17:05:16.066428] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:16.089995] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-29T17:05:16.090259] [INFO ] [MAIN ] AGD: Loaded 17937 existing records. [2025-09-29T17:05:16.287457] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:16.287755] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-29T17:05:16.287810] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-29T17:05:16.288108] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-29T17:05:16.288168] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-29T17:05:16.361482] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-29T17:05:16.675397] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:17.148126] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-29T17:05:17.593451] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-29T17:05:17.948172] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-29T17:05:18.062519] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:05:18.192118] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T17:05:18.748169] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-29T17:05:19.548191] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-29T17:05:19.770013] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T17:05:20.329533] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T17:05:20.348077] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-29T17:05:21.148123] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-29T17:05:21.246726] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:05:21.948092] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-29T17:05:21.984494] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T17:05:22.235679] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T17:05:22.748166] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-29T17:05:23.548120] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-29T17:05:23.645856] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T17:05:24.214626] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-29T17:05:24.348177] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-29T17:05:25.148179] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-29T17:05:25.416962] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:05:25.948138] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-29T17:05:26.167396] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:05:26.748171] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-29T17:05:26.785199] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T17:05:27.298264] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T17:05:27.548134] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-29T17:05:28.348132] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-29T17:05:28.410665] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T17:05:29.148196] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-29T17:05:29.613694] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-29T17:05:29.693071] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T17:05:29.948136] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-29T17:05:30.748143] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-29T17:05:31.096294] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T17:05:31.106930] [INFO ] [REMOTE ] AFL: Full fetch complete (76529 records). [2025-09-29T17:05:31.107122] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-29T17:05:31.108026] [FATAL] [VALIDATOR ] AFL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:05:31.108124] [FATAL] [MAIN ] AFL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:05:31.108169] [WARN ] [MAIN ] AFL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:05:31.108219] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-29T17:05:31.108318] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-09-29T17:05:31.108369] [INFO ] [LOCAL ] AFL: Starting deletion of derivative data. [2025-09-29T17:05:31.109177] [DEBUG] [LOCAL ] AFL: Deleted derivative data file. [2025-09-29T17:05:31.109287] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 40.9s. Estimated remaining: 4h 13m 54s. Rate: 9.1 symbols/min [2025-09-29T17:05:31.289879] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:31.354973] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-29T17:05:31.355362] [INFO ] [MAIN ] AGI: Loaded 54195 existing records. [2025-09-29T17:05:31.549350] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:31.549441] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-29T17:05:31.549914] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-29T17:05:31.551099] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-29T17:05:31.551731] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-29T17:05:31.551796] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-29T17:05:31.956974] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:31.992243] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-29T17:05:32.027478] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T17:05:32.348143] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-29T17:05:32.783583] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T17:05:33.148165] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-29T17:05:33.948146] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-29T17:05:34.720442] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-29T17:05:34.748073] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-29T17:05:34.851799] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T17:05:34.927956] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T17:05:35.548129] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-29T17:05:36.348141] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-29T17:05:36.819969] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:05:37.153208] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-29T17:05:37.166770] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T17:05:37.364514] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T17:05:37.948125] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-29T17:05:38.748161] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-29T17:05:39.548085] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-29T17:05:39.651419] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T17:05:39.661453] [INFO ] [REMOTE ] AGCO: Full fetch complete (61940 records). [2025-09-29T17:05:39.661591] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-29T17:05:40.082570] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-09-29T17:05:40.115686] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-29T17:05:40.115797] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-29T17:05:40.116530] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-29T17:05:40.116835] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-29T17:05:40.116742] [INFO ] [REMOTE ] AG: Full fetch complete (77204 records). [2025-09-29T17:05:40.120761] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-29T17:05:40.122146] [FATAL] [VALIDATOR ] AG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:05:40.122302] [FATAL] [MAIN ] AG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:05:40.122512] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:05:40.122836] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-29T17:05:40.123014] [DEBUG] [LOCAL ] AGCO: Trimmed 61940 records to 42413 (keeping 200 days of data) [2025-09-29T17:05:40.123140] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-29T17:05:40.123771] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-09-29T17:05:40.125024] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-09-29T17:05:40.125268] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AG took 32.4s. Estimated remaining: 4h 15m 39s. Rate: 9.1 symbols/min [2025-09-29T17:05:40.461770] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:40.482026] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T17:05:40.489200] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-29T17:05:40.672529] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-29T17:05:40.674584] [INFO ] [MAIN ] AGL: Loaded 53191 existing records. [2025-09-29T17:05:40.892830] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:40.894266] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-29T17:05:40.894375] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-29T17:05:40.895618] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-29T17:05:40.895790] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-29T17:05:41.017815] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-29T17:05:41.170994] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-29T17:05:41.362333] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:41.379170] [DEBUG] [LOCAL ] AGCO: Primary data saved (42413 records). [2025-09-29T17:05:41.379304] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-29T17:05:41.380226] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGCO took 28.7s. Estimated remaining: 4h 11m 34s. Rate: 9.2 symbols/min [2025-09-29T17:05:41.569005] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:41.582883] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-29T17:05:41.583109] [INFO ] [MAIN ] AGM: Loaded 10125 existing records. [2025-09-29T17:05:41.708493] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T17:05:41.792563] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:41.792826] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-29T17:05:41.792883] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-29T17:05:41.793121] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-29T17:05:41.793191] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-29T17:05:41.952728] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-29T17:05:42.189280] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:42.748108] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-29T17:05:42.958590] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:05:43.548153] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-29T17:05:43.651812] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T17:05:44.101964] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T17:05:44.348131] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-29T17:05:45.074780] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T17:05:45.148085] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-29T17:05:45.340979] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T17:05:45.948130] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-29T17:05:46.457674] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T17:05:46.462824] [INFO ] [REMOTE ] AGD: Full fetch complete (25496 records). [2025-09-29T17:05:46.462967] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-29T17:05:46.753317] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-29T17:05:46.804105] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T17:05:46.907755] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-29T17:05:46.907847] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-29T17:05:46.908211] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-29T17:05:46.908257] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-29T17:05:46.909123] [DEBUG] [LOCAL ] AGD: Trimmed 25496 records to 17846 (keeping 200 days of data) [2025-09-29T17:05:47.024755] [DEBUG] [LOCAL ] AGD: Primary data saved (17846 records). [2025-09-29T17:05:47.024912] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-29T17:05:47.025007] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGD took 31.2s. Estimated remaining: 4h 10m 50s. Rate: 9.2 symbols/min [2025-09-29T17:05:47.211032] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:47.242971] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-29T17:05:47.243253] [INFO ] [MAIN ] AGO: Loaded 28356 existing records. [2025-09-29T17:05:47.444337] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:47.444878] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-29T17:05:47.444950] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-29T17:05:47.445531] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-29T17:05:47.445593] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-29T17:05:47.551786] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-29T17:05:47.828366] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:48.348110] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-29T17:05:48.828134] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:05:49.148142] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-29T17:05:49.347697] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:05:49.860005] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T17:05:49.948114] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-29T17:05:50.748154] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-29T17:05:51.548181] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-29T17:05:51.585699] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T17:05:51.638133] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:05:52.348130] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-29T17:05:52.839387] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (4.49 seconds). [2025-09-29T17:05:52.894610] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T17:05:53.148162] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-29T17:05:53.683619] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-29T17:05:53.888858] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T17:05:53.948118] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-29T17:05:54.748131] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-29T17:05:55.238165] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T17:05:55.385226] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T17:05:55.548118] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-29T17:05:56.348127] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-29T17:05:57.148100] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-29T17:05:57.258527] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:05:57.948087] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-29T17:05:58.018736] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T17:05:58.358505] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T17:05:58.701785] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T17:05:58.748124] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-29T17:05:59.548126] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-29T17:06:00.106142] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:06:00.348084] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-29T17:06:00.574998] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T17:06:00.577823] [INFO ] [REMOTE ] AGM: Full fetch complete (12655 records). [2025-09-29T17:06:00.577906] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-29T17:06:01.043695] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-29T17:06:01.043790] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-29T17:06:01.044041] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-29T17:06:01.044108] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-29T17:06:01.044734] [DEBUG] [LOCAL ] AGM: Trimmed 12655 records to 10075 (keeping 200 days of data) [2025-09-29T17:06:01.120366] [DEBUG] [LOCAL ] AGM: Primary data saved (10075 records). [2025-09-29T17:06:01.120530] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-29T17:06:01.120633] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 19.7s. Estimated remaining: 4h 16m 9s. Rate: 9.0 symbols/min [2025-09-29T17:06:01.158839] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-29T17:06:01.308902] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:01.356957] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-29T17:06:01.357320] [INFO ] [MAIN ] AGRO: Loaded 34097 existing records. [2025-09-29T17:06:01.565144] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:01.565594] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-29T17:06:01.565693] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-29T17:06:01.566320] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-29T17:06:01.566389] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-29T17:06:01.942113] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:01.948071] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-29T17:06:02.364334] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-29T17:06:02.748107] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-29T17:06:03.040728] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T17:06:03.377680] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T17:06:03.548102] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-29T17:06:04.348100] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-29T17:06:04.904965] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-29T17:06:04.941387] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T17:06:05.148121] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-29T17:06:05.917881] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:06:05.948094] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-29T17:06:06.748098] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-29T17:06:07.021624] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T17:06:07.083281] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T17:06:07.548113] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-29T17:06:08.348127] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-29T17:06:08.613961] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T17:06:09.070035] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T17:06:09.148118] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-29T17:06:09.631472] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T17:06:09.948116] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-29T17:06:10.668913] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T17:06:10.748109] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-29T17:06:11.548106] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-29T17:06:12.029082] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T17:06:12.040351] [INFO ] [REMOTE ] AGI: Full fetch complete (76773 records). [2025-09-29T17:06:12.040529] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-29T17:06:12.357144] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:06:12.355710] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-29T17:06:12.518709] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-29T17:06:12.518824] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-29T17:06:12.519578] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-29T17:06:12.519623] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-29T17:06:12.521534] [DEBUG] [LOCAL ] AGI: Trimmed 76773 records to 53415 (keeping 200 days of data) [2025-09-29T17:06:12.808244] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T17:06:12.902666] [DEBUG] [LOCAL ] AGI: Primary data saved (53415 records). [2025-09-29T17:06:12.902823] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-29T17:06:12.902924] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGI took 41.8s. Estimated remaining: 4h 19m 40s. Rate: 8.9 symbols/min [2025-09-29T17:06:13.085396] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:13.125526] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-29T17:06:13.125837] [INFO ] [MAIN ] AGX: Loaded 33823 existing records. [2025-09-29T17:06:13.156735] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-29T17:06:13.313237] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:13.313446] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-29T17:06:13.313495] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-29T17:06:13.314109] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-29T17:06:13.314174] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-29T17:06:13.706639] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:13.793120] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:06:13.948131] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-29T17:06:14.626930] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T17:06:14.748140] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-29T17:06:15.344945] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T17:06:15.548178] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-29T17:06:15.898681] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T17:06:16.348206] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-29T17:06:16.802606] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:06:17.148165] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-29T17:06:17.948119] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-29T17:06:18.070691] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:06:18.251986] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T17:06:18.748130] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-29T17:06:19.265950] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:06:19.548115] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-29T17:06:20.348090] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-29T17:06:20.443186] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:06:20.854493] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T17:06:21.148118] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-29T17:06:21.656063] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T17:06:21.661867] [INFO ] [REMOTE ] AGO: Full fetch complete (39343 records). [2025-09-29T17:06:21.662041] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-29T17:06:21.953233] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-29T17:06:22.074682] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-29T17:06:22.074790] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-29T17:06:22.075292] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-29T17:06:22.075367] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-29T17:06:22.076536] [DEBUG] [LOCAL ] AGO: Trimmed 39343 records to 27898 (keeping 200 days of data) [2025-09-29T17:06:22.261491] [DEBUG] [LOCAL ] AGO: Primary data saved (27898 records). [2025-09-29T17:06:22.261633] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-29T17:06:22.261764] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGO took 35.2s. Estimated remaining: 4h 21m 22s. Rate: 8.9 symbols/min [2025-09-29T17:06:22.444300] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:22.493136] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-29T17:06:22.493520] [INFO ] [MAIN ] AHH: Loaded 41885 existing records. [2025-09-29T17:06:22.707620] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:22.708026] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-29T17:06:22.708173] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-29T17:06:22.716356] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-29T17:06:22.728852] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-29T17:06:22.771006] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T17:06:22.768435] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-29T17:06:23.158555] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:23.548115] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-29T17:06:23.961354] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T17:06:23.973249] [INFO ] [REMOTE ] AGL: Full fetch complete (75489 records). [2025-09-29T17:06:23.973446] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-29T17:06:24.352432] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-29T17:06:24.406463] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-29T17:06:24.406677] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-29T17:06:24.407505] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-29T17:06:24.407594] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-29T17:06:24.427952] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T17:06:24.434766] [DEBUG] [LOCAL ] AGL: Trimmed 75489 records to 52425 (keeping 200 days of data) [2025-09-29T17:06:24.435820] [INFO ] [REMOTE ] AGRO: Full fetch complete (49879 records). [2025-09-29T17:06:24.436230] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-29T17:06:25.004419] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-29T17:06:25.005021] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-29T17:06:25.006116] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-29T17:06:25.006571] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-29T17:06:25.013989] [DEBUG] [LOCAL ] AGRO: Trimmed 49879 records to 33601 (keeping 200 days of data) [2025-09-29T17:06:25.142570] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:06:25.256727] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-29T17:06:25.404498] [DEBUG] [LOCAL ] AGRO: Primary data saved (33601 records). [2025-09-29T17:06:25.405426] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-29T17:06:25.408207] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGRO took 24.3s. Estimated remaining: 4h 18m 48s. Rate: 8.9 symbols/min [2025-09-29T17:06:25.653748] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:25.657112] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-29T17:06:25.657924] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-29T17:06:25.658060] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-29T17:06:25.658106] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-29T17:06:25.658150] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-29T17:06:25.658446] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-29T17:06:25.955167] [DEBUG] [LOCAL ] AGL: Primary data saved (52425 records). [2025-09-29T17:06:25.977223] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-29T17:06:25.977882] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGL took 45.9s. Estimated remaining: 4h 14m 36s. Rate: 9.1 symbols/min [2025-09-29T17:06:26.185902] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:26.207003] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-29T17:06:26.263454] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:26.293023] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:06:26.352452] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-29T17:06:26.352802] [INFO ] [MAIN ] AHR: Loaded 49946 existing records. [2025-09-29T17:06:26.455454] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:06:26.475814] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-29T17:06:26.501702] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:06:26.507344] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-29T17:06:26.546601] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:26.546719] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:06:26.547479] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-29T17:06:26.547393] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-29T17:06:26.547605] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-29T17:06:26.548092] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-29T17:06:26.548252] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-29T17:06:26.548456] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-29T17:06:26.548750] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AHL took 1.1s. Estimated remaining: 4h 10m 33s. Rate: 9.2 symbols/min [2025-09-29T17:06:26.549031] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-29T17:06:26.561517] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-29T17:06:26.750296] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-29T17:06:27.008200] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:27.033975] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T17:06:27.181396] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-29T17:06:27.193841] [INFO ] [MAIN ] AHT: Loaded 6181 existing records. [2025-09-29T17:06:27.215465] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:27.412442] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:27.412710] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-29T17:06:27.412772] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-29T17:06:27.413028] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-29T17:06:27.413088] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-29T17:06:27.561403] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-29T17:06:27.796575] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:28.348127] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-29T17:06:28.491113] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T17:06:29.148131] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-29T17:06:29.392760] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T17:06:29.908782] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T17:06:29.948104] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-29T17:06:30.150111] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T17:06:30.748132] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-29T17:06:31.327669] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T17:06:31.548220] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-29T17:06:32.295828] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:06:32.348130] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-29T17:06:33.036016] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T17:06:33.148103] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-29T17:06:33.840123] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:06:33.948136] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-29T17:06:34.530136] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T17:06:34.748152] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-29T17:06:35.423328] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T17:06:35.470400] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T17:06:35.548100] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-29T17:06:36.348128] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-29T17:06:37.076826] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T17:06:37.148116] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-29T17:06:37.318058] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:06:37.948155] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-29T17:06:38.391525] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T17:06:38.398667] [INFO ] [REMOTE ] AGX: Full fetch complete (48784 records). [2025-09-29T17:06:38.398814] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-29T17:06:38.720049] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T17:06:38.753310] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-29T17:06:38.827749] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-29T17:06:38.827969] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-29T17:06:38.828521] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-29T17:06:38.828569] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-29T17:06:38.829830] [DEBUG] [LOCAL ] AGX: Trimmed 48784 records to 33224 (keeping 200 days of data) [2025-09-29T17:06:39.047982] [DEBUG] [LOCAL ] AGX: Primary data saved (33224 records). [2025-09-29T17:06:39.048133] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-29T17:06:39.048220] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 26.1s. Estimated remaining: 4h 14m 17s. Rate: 9.1 symbols/min [2025-09-29T17:06:39.236568] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:39.303820] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-29T17:06:39.304218] [INFO ] [MAIN ] AI: Loaded 54529 existing records. [2025-09-29T17:06:39.490255] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:39.490509] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-29T17:06:39.490558] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-29T17:06:39.491262] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-29T17:06:39.491328] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-29T17:06:39.552707] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-29T17:06:39.861584] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:40.333631] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T17:06:40.348076] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-29T17:06:40.634620] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T17:06:41.148149] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-29T17:06:41.948126] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-29T17:06:42.551048] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T17:06:42.740063] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T17:06:42.750787] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-29T17:06:43.003142] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-29T17:06:43.547474] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T17:06:43.549971] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-29T17:06:44.348119] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-29T17:06:44.956824] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T17:06:45.148083] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-29T17:06:45.263608] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:06:45.871056] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T17:06:45.948142] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-29T17:06:46.748126] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-29T17:06:47.361811] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T17:06:47.548161] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-29T17:06:47.670312] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T17:06:47.672711] [INFO ] [REMOTE ] AHT: Full fetch complete (9392 records). [2025-09-29T17:06:47.672863] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-29T17:06:48.070402] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-29T17:06:48.070482] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-29T17:06:48.070718] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-29T17:06:48.070783] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-29T17:06:48.071347] [DEBUG] [LOCAL ] AHT: Trimmed 9392 records to 6127 (keeping 200 days of data) [2025-09-29T17:06:48.110955] [DEBUG] [LOCAL ] AHT: Primary data saved (6127 records). [2025-09-29T17:06:48.111096] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-29T17:06:48.111186] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHT took 21.6s. Estimated remaining: 4h 15m 44s. Rate: 9.0 symbols/min [2025-09-29T17:06:48.313236] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:48.360044] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-29T17:06:48.387029] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-29T17:06:48.387565] [INFO ] [MAIN ] AIG: Loaded 54254 existing records. [2025-09-29T17:06:48.578747] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:48.579024] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-29T17:06:48.579074] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-29T17:06:48.580623] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-29T17:06:48.580724] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-29T17:06:48.959304] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:48.992023] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:06:49.148122] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-29T17:06:49.864017] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T17:06:49.948105] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-29T17:06:50.748099] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-29T17:06:50.921550] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T17:06:51.517250] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T17:06:51.548085] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-29T17:06:52.348164] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-29T17:06:52.788523] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T17:06:52.881886] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T17:06:53.148114] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-29T17:06:53.948110] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-29T17:06:54.222221] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T17:06:54.581757] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:06:54.748139] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-29T17:06:55.548162] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-29T17:06:55.675431] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T17:06:56.348172] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-29T17:06:56.546684] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:06:57.148135] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-29T17:06:57.328518] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T17:06:57.336332] [INFO ] [REMOTE ] AHH: Full fetch complete (60196 records). [2025-09-29T17:06:57.336502] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-29T17:06:57.747089] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-29T17:06:57.747341] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-29T17:06:57.748181] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-29T17:06:57.748328] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-29T17:06:57.750142] [DEBUG] [LOCAL ] AHH: Trimmed 60196 records to 41228 (keeping 200 days of data) [2025-09-29T17:06:57.906076] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T17:06:57.926685] [INFO ] [REMOTE ] AHR: Full fetch complete (70888 records). [2025-09-29T17:06:57.926891] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-29T17:06:57.978559] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-29T17:06:58.388686] [DEBUG] [LOCAL ] AHH: Primary data saved (41228 records). [2025-09-29T17:06:58.407526] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-29T17:06:58.424361] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHH took 36.2s. Estimated remaining: 4h 17m 54s. Rate: 9.0 symbols/min [2025-09-29T17:06:58.628630] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-29T17:06:58.639826] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-29T17:06:58.677095] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-29T17:06:58.683338] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-29T17:06:58.704411] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:58.705072] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-29T17:06:58.705159] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-29T17:06:58.705467] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-29T17:06:58.705739] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-29T17:06:58.706064] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-29T17:06:58.706219] [DEBUG] [LOCAL ] AHR: Trimmed 70888 records to 49171 (keeping 200 days of data) [2025-09-29T17:06:58.706353] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-29T17:06:59.321949] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:59.323849] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-29T17:06:59.362184] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-29T17:06:59.452803] [DEBUG] [LOCAL ] AHR: Primary data saved (49171 records). [2025-09-29T17:06:59.452987] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-29T17:06:59.453083] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHR took 33.5s. Estimated remaining: 4h 14m 20s. Rate: 9.1 symbols/min [2025-09-29T17:06:59.566755] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:06:59.556426] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-29T17:06:59.567160] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-29T17:06:59.571954] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:06:59.578095] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-29T17:06:59.593983] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:06:59.615380] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-29T17:06:59.632078] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-29T17:06:59.652100] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-29T17:06:59.653900] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:59.654155] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-29T17:06:59.654339] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AII took 1.2s. Estimated remaining: 4h 10m 22s. Rate: 9.2 symbols/min [2025-09-29T17:06:59.863588] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:59.864778] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-29T17:06:59.865258] [INFO ] [MAIN ] AIN: Loaded 24906 existing records. [2025-09-29T17:06:59.990931] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-29T17:07:00.001531] [INFO ] [MAIN ] AIO: Loaded 13477 existing records. [2025-09-29T17:07:00.186911] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:00.203164] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-29T17:07:00.213575] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-29T17:07:00.252808] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-29T17:07:00.272895] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-29T17:07:00.276993] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:00.324275] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-29T17:07:00.354745] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-29T17:07:00.388571] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-29T17:07:00.420765] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-29T17:07:00.857019] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:00.893039] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-29T17:07:01.052070] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-09-29T17:07:01.148533] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-29T17:07:01.182020] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:01.239517] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:07:01.948122] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-29T17:07:02.202944] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T17:07:02.748110] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-29T17:07:03.553225] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-29T17:07:03.573304] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-29T17:07:03.815714] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T17:07:04.053593] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T17:07:04.348079] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-29T17:07:04.415898] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T17:07:05.148132] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-29T17:07:05.343095] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T17:07:05.823325] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T17:07:05.948122] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-29T17:07:06.748118] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-29T17:07:07.042603] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T17:07:07.548081] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-29T17:07:07.707700] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T17:07:08.348111] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-29T17:07:09.148186] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-29T17:07:09.322117] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T17:07:09.512294] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T17:07:09.948117] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-29T17:07:10.241396] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T17:07:10.748145] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-29T17:07:11.548133] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-29T17:07:12.348087] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-29T17:07:12.471038] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-29T17:07:12.512256] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T17:07:12.808449] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T17:07:13.148164] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-29T17:07:13.174069] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T17:07:13.948126] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-29T17:07:14.720727] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T17:07:14.748124] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-29T17:07:14.858502] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T17:07:15.548143] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-29T17:07:16.348136] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-29T17:07:16.579947] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T17:07:17.148182] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-29T17:07:17.633364] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T17:07:17.878711] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-29T17:07:17.948114] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-29T17:07:18.750394] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-29T17:07:18.772864] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T17:07:18.784901] [INFO ] [REMOTE ] AIG: Full fetch complete (77376 records). [2025-09-29T17:07:18.785089] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-29T17:07:18.929573] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T17:07:19.228167] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-29T17:07:19.228275] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-29T17:07:19.229062] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-29T17:07:19.229129] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-29T17:07:19.230757] [DEBUG] [LOCAL ] AIG: Trimmed 77376 records to 53471 (keeping 200 days of data) [2025-09-29T17:07:19.549111] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-29T17:07:19.574903] [DEBUG] [LOCAL ] AIG: Primary data saved (53471 records). [2025-09-29T17:07:19.575038] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-29T17:07:19.576371] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 31.5s. Estimated remaining: 4h 18m 11s. Rate: 8.9 symbols/min [2025-09-29T17:07:19.759961] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:19.792815] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-29T17:07:19.793105] [INFO ] [MAIN ] AIR: Loaded 28152 existing records. [2025-09-29T17:07:19.980695] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:19.981074] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-29T17:07:19.981144] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-29T17:07:19.996877] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-29T17:07:19.997498] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-29T17:07:19.998206] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T17:07:20.386480] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:20.354343] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-29T17:07:20.397498] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:07:21.148145] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-29T17:07:21.948117] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-29T17:07:22.143395] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T17:07:22.735265] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-29T17:07:22.748073] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-29T17:07:22.857425] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T17:07:23.345493] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-29T17:07:23.348604] [INFO ] [REMOTE ] AIO: Full fetch complete (20094 records). [2025-09-29T17:07:23.348710] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-29T17:07:23.553200] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-29T17:07:23.754954] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-29T17:07:23.755051] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-29T17:07:23.755347] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-29T17:07:23.755410] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-29T17:07:23.756686] [DEBUG] [LOCAL ] AIO: Trimmed 20094 records to 13223 (keeping 200 days of data) [2025-09-29T17:07:23.843294] [DEBUG] [LOCAL ] AIO: Primary data saved (13223 records). [2025-09-29T17:07:23.843444] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-29T17:07:23.843531] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIO took 24.2s. Estimated remaining: 4h 16m 39s. Rate: 9.0 symbols/min [2025-09-29T17:07:24.036614] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:24.068928] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-29T17:07:24.069205] [INFO ] [MAIN ] AIT: Loaded 28208 existing records. [2025-09-29T17:07:24.262533] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:24.262831] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-29T17:07:24.262907] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-29T17:07:24.263483] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-29T17:07:24.263552] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-29T17:07:24.357700] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-29T17:07:24.678897] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:24.881355] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T17:07:25.148128] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-29T17:07:25.656716] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T17:07:25.948145] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-29T17:07:26.748142] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-29T17:07:27.047329] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:07:27.548138] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-29T17:07:27.593700] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-29T17:07:28.031981] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T17:07:28.037198] [INFO ] [REMOTE ] AIN: Full fetch complete (33329 records). [2025-09-29T17:07:28.037309] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-29T17:07:28.348122] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-29T17:07:28.455239] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-29T17:07:28.455335] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-29T17:07:28.455790] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-29T17:07:28.455868] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-29T17:07:28.456718] [DEBUG] [LOCAL ] AIN: Trimmed 33329 records to 24535 (keeping 200 days of data) [2025-09-29T17:07:28.613627] [DEBUG] [LOCAL ] AIN: Primary data saved (24535 records). [2025-09-29T17:07:28.613845] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-29T17:07:28.613988] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIN took 29.2s. Estimated remaining: 4h 15m 26s. Rate: 9.0 symbols/min [2025-09-29T17:07:28.802423] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:28.845144] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-29T17:07:28.845474] [INFO ] [MAIN ] AIV: Loaded 40950 existing records. [2025-09-29T17:07:28.972628] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T17:07:29.062107] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:29.062320] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-29T17:07:29.062369] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-29T17:07:29.062791] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-29T17:07:29.062850] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-29T17:07:29.153249] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-29T17:07:29.445866] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:29.729811] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-29T17:07:29.948139] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-29T17:07:30.748123] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-29T17:07:31.212542] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T17:07:31.548094] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-29T17:07:31.752527] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-29T17:07:31.783312] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T17:07:32.348119] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-29T17:07:32.742301] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T17:07:33.148131] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-29T17:07:33.948178] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-29T17:07:34.259047] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:07:34.748073] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-29T17:07:34.879343] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-29T17:07:34.890774] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-29T17:07:34.890940] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-29T17:07:35.318423] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-29T17:07:35.318523] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-29T17:07:35.319619] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-29T17:07:35.319738] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-29T17:07:35.322661] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53750 (keeping 200 days of data) [2025-09-29T17:07:35.548190] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-29T17:07:35.601002] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:07:35.693760] [DEBUG] [LOCAL ] AI: Primary data saved (53750 records). [2025-09-29T17:07:35.693908] [INFO ] [MAIN ] AI: Full history saved. [2025-09-29T17:07:35.693996] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AI took 56.6s. Estimated remaining: 4h 15m 34s. Rate: 9.0 symbols/min [2025-09-29T17:07:35.875147] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:35.910920] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-29T17:07:35.911207] [INFO ] [MAIN ] AIZ: Loaded 30543 existing records. [2025-09-29T17:07:36.106387] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:36.106791] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-29T17:07:36.106864] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-29T17:07:36.107363] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-29T17:07:36.107447] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-29T17:07:36.300295] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T17:07:36.354834] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-29T17:07:36.539751] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:36.714875] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:07:37.148122] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-29T17:07:37.871498] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:07:37.948145] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-29T17:07:38.229919] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:07:38.748123] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-29T17:07:39.235376] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T17:07:39.548132] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-29T17:07:40.005936] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T17:07:40.348085] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-29T17:07:40.590140] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:07:41.148135] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-29T17:07:41.716275] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T17:07:41.948123] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-29T17:07:42.721529] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T17:07:42.748070] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-29T17:07:43.414173] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T17:07:43.548103] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-29T17:07:43.979344] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T17:07:44.348135] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-29T17:07:44.939720] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T17:07:45.148124] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-29T17:07:45.484969] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T17:07:45.948138] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-29T17:07:46.499493] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T17:07:46.748141] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-29T17:07:47.515005] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:07:47.548084] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-29T17:07:48.340907] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T17:07:48.345190] [INFO ] [REMOTE ] AIT: Full fetch complete (39325 records). [2025-09-29T17:07:48.345291] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-29T17:07:48.345976] [FATAL] [VALIDATOR ] AIT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:07:48.346067] [FATAL] [MAIN ] AIT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:07:48.346111] [WARN ] [MAIN ] AIT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:07:48.346153] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-29T17:07:48.346212] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-29T17:07:48.346250] [INFO ] [LOCAL ] AIT: Starting deletion of derivative data. [2025-09-29T17:07:48.346699] [DEBUG] [LOCAL ] AIT: Deleted derivative data file. [2025-09-29T17:07:48.346801] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIT took 24.5s. Estimated remaining: 4h 18m 48s. Rate: 8.9 symbols/min [2025-09-29T17:07:48.352192] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-29T17:07:48.532193] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:48.538425] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-29T17:07:48.538617] [INFO ] [MAIN ] AIZN: Loaded 3935 existing records. [2025-09-29T17:07:48.727087] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:48.727299] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-29T17:07:48.727349] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-29T17:07:48.727599] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-29T17:07:48.727893] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-29T17:07:49.144778] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:49.146725] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T17:07:49.154625] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-29T17:07:49.810584] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T17:07:49.948112] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-29T17:07:50.540060] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T17:07:50.748160] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-29T17:07:51.426896] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T17:07:51.439413] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T17:07:51.548178] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-29T17:07:52.130569] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T17:07:52.348113] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-29T17:07:53.148118] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-29T17:07:53.837765] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:07:53.845294] [INFO ] [REMOTE ] AIR: Full fetch complete (38505 records). [2025-09-29T17:07:53.845425] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-29T17:07:53.955544] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-29T17:07:54.251166] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-29T17:07:54.251251] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-29T17:07:54.251697] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-29T17:07:54.251763] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-29T17:07:54.253137] [DEBUG] [LOCAL ] AIR: Trimmed 38505 records to 27816 (keeping 200 days of data) [2025-09-29T17:07:54.424232] [DEBUG] [LOCAL ] AIR: Primary data saved (27816 records). [2025-09-29T17:07:54.424394] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-29T17:07:54.424491] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIR took 34.8s. Estimated remaining: 4h 18m 19s. Rate: 8.9 symbols/min [2025-09-29T17:07:54.601041] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T17:07:54.629595] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:54.685899] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-29T17:07:54.686237] [INFO ] [MAIN ] AJG: Loaded 47710 existing records. [2025-09-29T17:07:54.753236] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-29T17:07:54.880489] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:54.880746] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-29T17:07:54.880825] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-29T17:07:54.889095] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-29T17:07:54.902467] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-29T17:07:54.939751] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:07:55.295594] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:55.548132] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-29T17:07:56.357589] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-29T17:07:56.362406] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T17:07:57.005220] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T17:07:57.148134] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-29T17:07:57.356124] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T17:07:57.948106] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-29T17:07:58.748079] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-29T17:07:58.776832] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T17:07:59.285133] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T17:07:59.548122] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-29T17:08:00.046579] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T17:08:00.348161] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-29T17:08:00.582210] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T17:08:01.148202] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-29T17:08:01.894719] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T17:08:01.948085] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-29T17:08:02.212356] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T17:08:02.515761] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T17:08:02.748129] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-29T17:08:03.548114] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-29T17:08:04.172919] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:08:04.348110] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-29T17:08:05.148117] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-29T17:08:05.175530] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:08:05.243495] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T17:08:05.948117] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-29T17:08:06.748099] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-29T17:08:06.890857] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T17:08:06.900368] [INFO ] [REMOTE ] AIV: Full fetch complete (59477 records). [2025-09-29T17:08:06.900507] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-29T17:08:07.329586] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-29T17:08:07.331199] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-29T17:08:07.331880] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-29T17:08:07.333808] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-29T17:08:07.334771] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T17:08:07.337243] [DEBUG] [LOCAL ] AIV: Trimmed 59477 records to 40298 (keeping 200 days of data) [2025-09-29T17:08:07.548256] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-29T17:08:07.590036] [DEBUG] [LOCAL ] AIV: Primary data saved (40298 records). [2025-09-29T17:08:07.590218] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-29T17:08:07.590414] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 39.0s. Estimated remaining: 4h 21m 40s. Rate: 8.8 symbols/min [2025-09-29T17:08:07.782198] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:07.782570] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-29T17:08:07.782680] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-29T17:08:07.782827] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-29T17:08:07.782917] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-29T17:08:07.783035] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-29T17:08:07.783132] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-29T17:08:08.160876] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-29T17:08:08.221824] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:08.222802] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-29T17:08:08.348115] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-29T17:08:09.148172] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-29T17:08:09.646736] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T17:08:09.648053] [INFO ] [REMOTE ] AIZN: Full fetch complete (5768 records). [2025-09-29T17:08:09.648131] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-29T17:08:09.953279] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-29T17:08:10.047293] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-29T17:08:10.047406] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-29T17:08:10.047680] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-29T17:08:10.047746] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-29T17:08:10.048212] [DEBUG] [LOCAL ] AIZN: Trimmed 5768 records to 3911 (keeping 200 days of data) [2025-09-29T17:08:10.074084] [DEBUG] [LOCAL ] AIZN: Primary data saved (3911 records). [2025-09-29T17:08:10.074442] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-29T17:08:10.074554] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZN took 21.7s. Estimated remaining: 4h 19m 15s. Rate: 8.9 symbols/min [2025-09-29T17:08:10.253761] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:10.322625] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-29T17:08:10.323032] [INFO ] [MAIN ] AKR: Loaded 46481 existing records. [2025-09-29T17:08:10.516046] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:10.548820] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-29T17:08:10.548955] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-29T17:08:10.551848] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-29T17:08:10.551924] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-29T17:08:10.562625] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-29T17:08:10.679109] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T17:08:10.755391] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-29T17:08:10.981528] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:11.210666] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T17:08:11.548144] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-29T17:08:12.019492] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-29T17:08:12.348165] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-29T17:08:12.763146] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-29T17:08:13.148137] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-29T17:08:13.643151] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T17:08:13.948121] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-29T17:08:14.528426] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T17:08:14.748127] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-29T17:08:15.180219] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T17:08:15.548167] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-29T17:08:16.348137] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-29T17:08:17.012723] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T17:08:17.018965] [INFO ] [REMOTE ] AIZ: Full fetch complete (42987 records). [2025-09-29T17:08:17.019193] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-29T17:08:17.153265] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-29T17:08:17.439328] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-29T17:08:17.439411] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-29T17:08:17.439891] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-29T17:08:17.439957] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-29T17:08:17.441090] [DEBUG] [LOCAL ] AIZ: Trimmed 42987 records to 29952 (keeping 200 days of data) [2025-09-29T17:08:17.684120] [DEBUG] [LOCAL ] AIZ: Primary data saved (29952 records). [2025-09-29T17:08:17.684249] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-29T17:08:17.684328] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 42.0s. Estimated remaining: 4h 19m 35s. Rate: 8.9 symbols/min [2025-09-29T17:08:17.872703] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:17.925753] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-29T17:08:17.926089] [INFO ] [MAIN ] AL: Loaded 44831 existing records. [2025-09-29T17:08:17.960736] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-29T17:08:18.132816] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:18.133166] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-29T17:08:18.133228] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-29T17:08:18.134265] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-29T17:08:18.134331] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-29T17:08:18.394855] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T17:08:18.452875] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T17:08:18.575222] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:18.748126] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-29T17:08:19.025452] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T17:08:19.041578] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-29T17:08:19.548132] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-29T17:08:20.051496] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T17:08:20.052368] [INFO ] [REMOTE ] AKA: Full fetch complete (2429 records). [2025-09-29T17:08:20.052468] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-29T17:08:20.245285] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T17:08:20.245529] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:08:20.245600] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:08:20.245700] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-29T17:08:20.245799] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-29T17:08:20.245855] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-29T17:08:20.245900] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-29T17:08:20.245970] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 12.7s. Estimated remaining: 4h 17m 17s. Rate: 8.9 symbols/min [2025-09-29T17:08:20.351592] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-29T17:08:20.426778] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:20.505518] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-29T17:08:20.505965] [INFO ] [MAIN ] ALB: Loaded 54000 existing records. [2025-09-29T17:08:20.697221] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:20.697527] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-29T17:08:20.697582] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-29T17:08:20.698909] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-29T17:08:20.698987] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-29T17:08:21.156092] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:21.156218] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-29T17:08:21.733391] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T17:08:21.948118] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-29T17:08:22.748106] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-29T17:08:22.780351] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T17:08:23.548168] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-29T17:08:24.110965] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T17:08:24.339698] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T17:08:24.349702] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-29T17:08:25.153203] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-29T17:08:25.171881] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T17:08:25.809367] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:08:25.948139] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-29T17:08:26.748129] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-29T17:08:27.037745] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:08:27.541200] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:08:27.550719] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-29T17:08:28.348101] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-29T17:08:28.390190] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:08:29.148088] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-29T17:08:29.393550] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T17:08:29.948098] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-29T17:08:30.217185] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:08:30.748114] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-29T17:08:31.006147] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:08:31.548108] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-29T17:08:31.794695] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T17:08:31.805621] [INFO ] [REMOTE ] AJG: Full fetch complete (69718 records). [2025-09-29T17:08:31.805822] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-29T17:08:32.244636] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-29T17:08:32.244764] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-29T17:08:32.245582] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-29T17:08:32.245701] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-29T17:08:32.247372] [DEBUG] [LOCAL ] AJG: Trimmed 69718 records to 46911 (keeping 200 days of data) [2025-09-29T17:08:32.362840] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-29T17:08:32.379582] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T17:08:32.610214] [DEBUG] [LOCAL ] AJG: Primary data saved (46911 records). [2025-09-29T17:08:32.610368] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-29T17:08:32.615488] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 38.2s. Estimated remaining: 4h 20m 3s. Rate: 8.8 symbols/min [2025-09-29T17:08:32.801809] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:32.866108] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-29T17:08:32.866479] [INFO ] [MAIN ] ALC: Loaded 51537 existing records. [2025-09-29T17:08:33.062569] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:33.062813] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-29T17:08:33.062869] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-29T17:08:33.063846] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-29T17:08:33.063910] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-29T17:08:33.153168] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-29T17:08:33.454597] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:33.488685] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T17:08:33.948146] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-29T17:08:34.029919] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T17:08:34.547828] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T17:08:34.748146] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-29T17:08:35.548132] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-29T17:08:35.901346] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T17:08:36.348080] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-29T17:08:36.691233] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:08:36.807564] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-29T17:08:37.148157] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-29T17:08:37.948070] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-29T17:08:38.132169] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:08:38.748156] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-29T17:08:38.911939] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T17:08:39.475470] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T17:08:39.548108] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-29T17:08:40.060537] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T17:08:40.348117] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-29T17:08:41.148107] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-29T17:08:41.386231] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:08:41.396593] [INFO ] [REMOTE ] AKR: Full fetch complete (65498 records). [2025-09-29T17:08:41.396797] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-29T17:08:41.797747] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-29T17:08:41.797913] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-29T17:08:41.798783] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-29T17:08:41.798853] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-29T17:08:41.800760] [DEBUG] [LOCAL ] AKR: Trimmed 65498 records to 45716 (keeping 200 days of data) [2025-09-29T17:08:41.984755] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-29T17:08:42.098231] [DEBUG] [LOCAL ] AKR: Primary data saved (45716 records). [2025-09-29T17:08:42.098439] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-29T17:08:42.101228] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AKR took 32.0s. Estimated remaining: 4h 21m 18s. Rate: 8.8 symbols/min [2025-09-29T17:08:42.334592] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:42.368090] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-29T17:08:42.419059] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-29T17:08:42.419368] [INFO ] [MAIN ] ALE: Loaded 30788 existing records. [2025-09-29T17:08:42.611725] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:42.612059] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-29T17:08:42.612134] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-29T17:08:42.622476] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-29T17:08:42.638550] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-29T17:08:42.646105] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:08:42.753464] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-29T17:08:43.039430] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:43.479808] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T17:08:43.548165] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-29T17:08:44.348084] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-29T17:08:44.535612] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T17:08:45.148141] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-29T17:08:45.292852] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T17:08:45.948113] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-29T17:08:45.986702] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-29T17:08:46.748133] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-29T17:08:46.894499] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T17:08:46.956283] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T17:08:47.548114] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-29T17:08:48.348176] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-29T17:08:48.692504] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T17:08:49.148107] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-29T17:08:49.414234] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-29T17:08:49.948097] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-29T17:08:50.057746] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T17:08:50.092174] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T17:08:50.748125] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-29T17:08:51.548118] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-29T17:08:52.250318] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-29T17:08:52.261606] [INFO ] [REMOTE ] ALB: Full fetch complete (76795 records). [2025-09-29T17:08:52.261915] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-29T17:08:52.348577] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-29T17:08:52.702414] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-29T17:08:52.702906] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-29T17:08:52.703937] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-29T17:08:52.720730] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-29T17:08:52.743099] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T17:08:52.755949] [DEBUG] [LOCAL ] ALB: Trimmed 76795 records to 53226 (keeping 200 days of data) [2025-09-29T17:08:53.030162] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T17:08:53.159355] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-29T17:08:53.195297] [DEBUG] [LOCAL ] ALB: Primary data saved (53226 records). [2025-09-29T17:08:53.195505] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-29T17:08:53.195637] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. ALB took 32.9s. Estimated remaining: 4h 23m 18s. Rate: 8.7 symbols/min [2025-09-29T17:08:53.898335] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T17:08:53.948175] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-29T17:08:54.357849] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T17:08:54.748133] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-29T17:08:55.554259] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-29T17:08:55.575924] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T17:08:56.348128] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-29T17:08:56.388232] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T17:08:56.806739] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:08:57.148109] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-29T17:08:57.948169] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-29T17:08:58.024030] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T17:08:58.597484] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-29T17:08:58.748107] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-29T17:08:59.548087] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-29T17:08:59.632119] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T17:09:00.124139] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T17:09:00.348110] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-29T17:09:01.148126] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-29T17:09:01.366438] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:09:01.377695] [INFO ] [REMOTE ] AL: Full fetch complete (62448 records). [2025-09-29T17:09:01.377852] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-29T17:09:01.827031] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-29T17:09:01.827385] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-29T17:09:01.828202] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-29T17:09:01.828294] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-29T17:09:01.851193] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T17:09:01.858884] [DEBUG] [LOCAL ] AL: Trimmed 62448 records to 44176 (keeping 200 days of data) [2025-09-29T17:09:01.859317] [INFO ] [REMOTE ] ALE: Full fetch complete (42621 records). [2025-09-29T17:09:01.859833] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-29T17:09:02.452521] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-29T17:09:02.455915] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-29T17:09:02.456632] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-29T17:09:02.456798] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-29T17:09:02.556814] [DEBUG] [LOCAL ] ALE: Trimmed 42621 records to 30436 (keeping 200 days of data) [2025-09-29T17:09:02.742871] [DEBUG] [LOCAL ] AL: Primary data saved (44176 records). [2025-09-29T17:09:02.743797] [INFO ] [MAIN ] AL: Full history saved. [2025-09-29T17:09:02.744438] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. AL took 45.1s. Estimated remaining: 4h 24m 29s. Rate: 8.7 symbols/min [2025-09-29T17:09:02.822494] [DEBUG] [LOCAL ] ALE: Primary data saved (30436 records). [2025-09-29T17:09:02.822664] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-29T17:09:02.823602] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 20.7s. Estimated remaining: 4h 21m 4s. Rate: 8.8 symbols/min [2025-09-29T17:09:03.050796] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T17:09:03.062396] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-29T17:09:05.013683] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T17:09:05.024265] [INFO ] [REMOTE ] ALC: Full fetch complete (72799 records). [2025-09-29T17:09:05.024414] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-29T17:09:05.433254] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-29T17:09:05.433348] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-29T17:09:05.434118] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-29T17:09:05.434192] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-29T17:09:05.435753] [DEBUG] [LOCAL ] ALC: Trimmed 72799 records to 50776 (keeping 200 days of data) [2025-09-29T17:09:05.765664] [DEBUG] [LOCAL ] ALC: Primary data saved (50776 records). [2025-09-29T17:09:05.765836] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-29T17:09:05.766711] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALC took 33.2s. Estimated remaining: 4h 19m 6s. Rate: 8.8 symbols/min [2025-09-29T17:09:06.530568] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:06.526171] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:06.509505] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:06.564716] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:06.579221] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-29T17:09:06.579598] [INFO ] [MAIN ] ALG: Loaded 10562 existing records. [2025-09-29T17:09:06.745106] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-29T17:09:06.756001] [INFO ] [MAIN ] ALEX: Loaded 31769 existing records. [2025-09-29T17:09:06.856300] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:06.872548] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-29T17:09:06.899197] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-29T17:09:06.964617] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-29T17:09:06.980849] [INFO ] [MAIN ] ALK: Loaded 53840 existing records. [2025-09-29T17:09:06.981007] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-29T17:09:07.002721] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-29T17:09:07.019876] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-29T17:09:07.057937] [INFO ] [MAIN ] ALIT: Loaded 53534 existing records. [2025-09-29T17:09:07.346685] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:07.419793] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-29T17:09:07.431196] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-29T17:09:07.463067] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-29T17:09:07.488632] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-29T17:09:07.701730] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:07.737436] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-29T17:09:07.750842] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:07.802005] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-29T17:09:07.814517] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-29T17:09:07.777555] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-29T17:09:07.861823] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-29T17:09:07.882027] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-29T17:09:07.882097] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-29T17:09:07.948449] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-29T17:09:08.361280] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:08.396736] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-29T17:09:08.920849] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:08.938736] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-29T17:09:09.123613] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:09.141784] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-29T17:09:09.147769] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:09.149329] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-29T17:09:09.311033] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T17:09:09.314162] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-29T17:09:10.139508] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T17:09:10.142707] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-29T17:09:10.425005] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T17:09:10.432401] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-29T17:09:11.037186] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:09:11.040826] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-29T17:09:11.129693] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T17:09:11.141267] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-29T17:09:11.275241] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T17:09:11.286474] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-29T17:09:11.608724] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T17:09:11.615006] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-29T17:09:12.225758] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T17:09:12.229413] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-29T17:09:12.765438] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T17:09:12.770973] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-29T17:09:12.939732] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:09:13.091010] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T17:09:13.148102] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-29T17:09:13.323722] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-29T17:09:13.948119] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-29T17:09:13.986860] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T17:09:14.059476] [DEBUG] [REMOTE ] ALK: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-29T17:09:14.059855] [WARN ] [REMOTE ] ALK: No data returned for month 2025-02 [2025-09-29T17:09:14.060013] [FATAL] [REMOTE ] ALK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:09:14.060106] [FATAL] [MAIN ] ALK: Failed to fetch primary data. [2025-09-29T17:09:14.060180] [WARN ] [MAIN ] ALK: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:09:14.060286] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-29T17:09:14.060404] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-29T17:09:14.060496] [INFO ] [LOCAL ] ALK: Starting deletion of derivative data. [2025-09-29T17:09:14.061457] [DEBUG] [LOCAL ] ALK: Deleted derivative data file. [2025-09-29T17:09:14.061578] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALK took 8.3s. Estimated remaining: 4h 19m 42s. Rate: 8.8 symbols/min [2025-09-29T17:09:14.269682] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:14.346137] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-29T17:09:14.346527] [INFO ] [MAIN ] ALL: Loaded 50903 existing records. [2025-09-29T17:09:14.526021] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T17:09:14.583857] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:14.584127] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-29T17:09:14.584183] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-29T17:09:14.584922] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-29T17:09:14.584992] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-29T17:09:14.753258] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-29T17:09:14.986539] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:15.548105] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-29T17:09:15.681267] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T17:09:16.348139] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-29T17:09:17.148096] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-29T17:09:17.149513] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T17:09:17.342792] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T17:09:17.948137] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-29T17:09:18.681837] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T17:09:18.748143] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-29T17:09:19.553139] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-29T17:09:19.559387] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T17:09:19.673926] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T17:09:20.348142] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-29T17:09:21.148166] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-29T17:09:21.372582] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:09:21.948105] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-29T17:09:22.002189] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:09:22.563730] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T17:09:22.715757] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T17:09:22.748102] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-29T17:09:23.548140] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-29T17:09:24.348126] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-29T17:09:24.524066] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T17:09:24.526465] [INFO ] [REMOTE ] ALG: Full fetch complete (15887 records). [2025-09-29T17:09:24.526584] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-29T17:09:24.944284] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-29T17:09:24.957020] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-29T17:09:24.960983] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-29T17:09:24.968731] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-29T17:09:24.969603] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-29T17:09:24.971042] [DEBUG] [LOCAL ] ALG: Trimmed 15887 records to 10273 (keeping 200 days of data) [2025-09-29T17:09:25.044852] [DEBUG] [LOCAL ] ALG: Primary data saved (10273 records). [2025-09-29T17:09:25.045057] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-29T17:09:25.045226] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALG took 19.3s. Estimated remaining: 4h 21m 31s. Rate: 8.8 symbols/min [2025-09-29T17:09:25.155415] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-29T17:09:25.237142] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:25.294440] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-29T17:09:25.294800] [INFO ] [MAIN ] ALLE: Loaded 45637 existing records. [2025-09-29T17:09:25.491939] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:25.492212] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-29T17:09:25.492278] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-29T17:09:25.492959] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-29T17:09:25.493029] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-29T17:09:25.900105] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:25.948154] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-29T17:09:26.019206] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:09:26.748191] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-29T17:09:27.206520] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T17:09:27.548153] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-29T17:09:27.798024] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T17:09:28.348118] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-29T17:09:28.420381] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T17:09:28.778153] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T17:09:29.148131] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-29T17:09:29.948129] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-29T17:09:30.142212] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:09:30.748156] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-29T17:09:30.890936] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T17:09:31.315411] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T17:09:31.548101] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-29T17:09:32.348123] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-29T17:09:32.579887] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:09:33.148105] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-29T17:09:33.462213] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T17:09:33.948134] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-29T17:09:34.182097] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-29T17:09:34.748075] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-29T17:09:34.871468] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T17:09:35.290351] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:09:35.548163] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-29T17:09:36.348083] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-29T17:09:36.594739] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T17:09:37.036398] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:09:37.043337] [INFO ] [REMOTE ] ALEX: Full fetch complete (44620 records). [2025-09-29T17:09:37.043458] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-29T17:09:37.150841] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-29T17:09:37.440497] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-29T17:09:37.440603] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-29T17:09:37.441157] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-29T17:09:37.441228] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-29T17:09:37.442400] [DEBUG] [LOCAL ] ALEX: Trimmed 44620 records to 31165 (keeping 200 days of data) [2025-09-29T17:09:37.641704] [DEBUG] [LOCAL ] ALEX: Primary data saved (31165 records). [2025-09-29T17:09:37.641859] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-29T17:09:37.641971] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALEX took 31.9s. Estimated remaining: 4h 24m 3s. Rate: 8.7 symbols/min [2025-09-29T17:09:37.834780] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:37.870633] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T17:09:37.938461] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-29T17:09:37.938848] [INFO ] [MAIN ] ALLY: Loaded 53997 existing records. [2025-09-29T17:09:37.953290] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-29T17:09:38.126389] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:38.126629] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-29T17:09:38.126712] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-29T17:09:38.127475] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-29T17:09:38.127539] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-29T17:09:38.490230] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:38.748084] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-29T17:09:39.220039] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T17:09:39.231308] [INFO ] [REMOTE ] ALIT: Full fetch complete (76415 records). [2025-09-29T17:09:39.231468] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-29T17:09:39.551569] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-29T17:09:39.661784] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-29T17:09:39.661909] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-29T17:09:39.662987] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-29T17:09:39.663091] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-29T17:09:39.664827] [DEBUG] [LOCAL ] ALIT: Trimmed 76415 records to 52760 (keeping 200 days of data) [2025-09-29T17:09:39.801610] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T17:09:40.043529] [DEBUG] [LOCAL ] ALIT: Primary data saved (52760 records). [2025-09-29T17:09:40.043712] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-29T17:09:40.043828] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALIT took 34.3s. Estimated remaining: 4h 21m 53s. Rate: 8.7 symbols/min [2025-09-29T17:09:40.226935] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:40.278527] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-29T17:09:40.278884] [INFO ] [MAIN ] ALSN: Loaded 43953 existing records. [2025-09-29T17:09:40.352824] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-29T17:09:40.482550] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:40.483128] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-29T17:09:40.483403] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-29T17:09:40.484102] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-29T17:09:40.484179] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-29T17:09:40.866576] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T17:09:40.922974] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:41.148101] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-29T17:09:41.475733] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:09:41.948084] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-29T17:09:42.373423] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T17:09:42.385098] [INFO ] [REMOTE ] ALL: Full fetch complete (72147 records). [2025-09-29T17:09:42.385251] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-29T17:09:42.386185] [FATAL] [VALIDATOR ] ALL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:09:42.386275] [FATAL] [MAIN ] ALL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:09:42.386319] [WARN ] [MAIN ] ALL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:09:42.386388] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-29T17:09:42.386454] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-09-29T17:09:42.386491] [INFO ] [LOCAL ] ALL: Starting deletion of derivative data. [2025-09-29T17:09:42.386919] [DEBUG] [LOCAL ] ALL: Deleted derivative data file. [2025-09-29T17:09:42.388279] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 28.3s. Estimated remaining: 4h 19m 44s. Rate: 8.8 symbols/min [2025-09-29T17:09:42.564888] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:42.590975] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-29T17:09:42.591234] [INFO ] [MAIN ] ALTG: Loaded 24161 existing records. [2025-09-29T17:09:42.753060] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-29T17:09:42.795087] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:42.795787] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-29T17:09:42.795977] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-29T17:09:42.796329] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-29T17:09:42.796452] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-29T17:09:43.052758] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:09:43.246739] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:43.548091] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-29T17:09:43.850913] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T17:09:44.348138] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-29T17:09:44.685618] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T17:09:45.071456] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T17:09:45.148130] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-29T17:09:45.853581] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:09:45.948114] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-29T17:09:46.378249] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:09:46.748155] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-29T17:09:47.548767] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:09:47.548909] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-29T17:09:47.944008] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T17:09:48.348120] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-29T17:09:49.081028] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T17:09:49.148097] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-29T17:09:49.948113] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-29T17:09:50.111287] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:09:50.215092] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:09:50.748147] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-29T17:09:51.525909] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T17:09:51.548136] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-29T17:09:52.348086] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-29T17:09:52.826104] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-29T17:09:53.148101] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-29T17:09:53.380491] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T17:09:53.954698] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-29T17:09:53.974033] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T17:09:54.748122] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-29T17:09:54.799357] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:09:55.427816] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T17:09:55.548084] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-29T17:09:55.795904] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T17:09:56.348107] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-29T17:09:57.148123] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-29T17:09:57.220462] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T17:09:57.831759] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:09:57.948118] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-29T17:09:58.748127] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-29T17:09:58.944793] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T17:09:59.543799] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T17:09:59.553060] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-29T17:10:00.348126] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-29T17:10:00.488665] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:10:01.085117] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:10:01.148147] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-29T17:10:01.948135] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-29T17:10:01.999256] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T17:10:02.748133] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-29T17:10:03.331344] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T17:10:03.518863] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-29T17:10:03.530479] [INFO ] [REMOTE ] ALLY: Full fetch complete (76904 records). [2025-09-29T17:10:03.530684] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-29T17:10:03.555738] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-29T17:10:04.117944] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-29T17:10:04.118072] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-29T17:10:04.119409] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-29T17:10:04.119515] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-29T17:10:04.121512] [DEBUG] [LOCAL ] ALLY: Trimmed 76904 records to 53217 (keeping 200 days of data) [2025-09-29T17:10:04.390673] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-29T17:10:04.440378] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T17:10:04.474772] [INFO ] [REMOTE ] ALSN: Full fetch complete (62126 records). [2025-09-29T17:10:04.476448] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-29T17:10:04.937813] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T17:10:04.963814] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-29T17:10:04.969466] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-29T17:10:04.971110] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-29T17:10:04.971752] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-29T17:10:04.977020] [DEBUG] [LOCAL ] ALSN: Trimmed 62126 records to 43263 (keeping 200 days of data) [2025-09-29T17:10:05.148538] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-29T17:10:05.169910] [DEBUG] [LOCAL ] ALLY: Primary data saved (53217 records). [2025-09-29T17:10:05.171116] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-29T17:10:05.172190] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALLY took 27.5s. Estimated remaining: 4h 26m 42s. Rate: 8.6 symbols/min [2025-09-29T17:10:05.370539] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:05.478322] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-29T17:10:05.479866] [INFO ] [MAIN ] ALUR: Loaded 10950 existing records. [2025-09-29T17:10:05.683089] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:05.683914] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-29T17:10:05.684446] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-29T17:10:05.685094] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-29T17:10:05.685722] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-29T17:10:06.100515] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:06.101380] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-29T17:10:06.154010] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:10:06.168821] [DEBUG] [LOCAL ] ALSN: Primary data saved (43263 records). [2025-09-29T17:10:06.168962] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-29T17:10:06.169508] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALSN took 26.1s. Estimated remaining: 4h 23m 57s. Rate: 8.7 symbols/min [2025-09-29T17:10:06.300923] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:10:06.369320] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:06.418876] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-29T17:10:06.419230] [INFO ] [MAIN ] ALV: Loaded 43217 existing records. [2025-09-29T17:10:06.611678] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:06.611939] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-29T17:10:06.612012] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-29T17:10:06.612475] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-29T17:10:06.612618] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-29T17:10:06.755516] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-29T17:10:06.988178] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:07.548125] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-29T17:10:07.604611] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T17:10:08.082119] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T17:10:08.348113] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-29T17:10:09.155664] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-29T17:10:09.160939] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:10:09.948078] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-29T17:10:10.052421] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T17:10:10.062091] [INFO ] [REMOTE ] ALLE: Full fetch complete (64766 records). [2025-09-29T17:10:10.062272] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-29T17:10:10.494109] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:10:10.586427] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-29T17:10:10.586568] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-29T17:10:10.587299] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-29T17:10:10.587365] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-29T17:10:10.588766] [DEBUG] [LOCAL ] ALLE: Trimmed 64766 records to 44821 (keeping 200 days of data) [2025-09-29T17:10:10.785877] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-29T17:10:10.892996] [DEBUG] [LOCAL ] ALLE: Primary data saved (44821 records). [2025-09-29T17:10:10.893141] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-29T17:10:10.893246] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALLE took 45.8s. Estimated remaining: 4h 22m 53s. Rate: 8.7 symbols/min [2025-09-29T17:10:11.071897] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:11.080279] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-29T17:10:11.080471] [INFO ] [MAIN ] ALX: Loaded 6121 existing records. [2025-09-29T17:10:11.271559] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:11.271808] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-29T17:10:11.271864] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-29T17:10:11.272287] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-29T17:10:11.272347] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-29T17:10:11.548730] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-29T17:10:11.705040] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:11.729524] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T17:10:12.248852] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T17:10:12.254330] [INFO ] [REMOTE ] ALTG: Full fetch complete (33692 records). [2025-09-29T17:10:12.254464] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-29T17:10:12.353210] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-29T17:10:12.676820] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-29T17:10:12.677025] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-29T17:10:12.677587] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-29T17:10:12.677697] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-29T17:10:12.692903] [DEBUG] [LOCAL ] ALTG: Trimmed 33692 records to 23671 (keeping 200 days of data) [2025-09-29T17:10:12.694357] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T17:10:12.837188] [DEBUG] [LOCAL ] ALTG: Primary data saved (23671 records). [2025-09-29T17:10:12.837339] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-29T17:10:12.837435] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 30.4s. Estimated remaining: 4h 20m 38s. Rate: 8.8 symbols/min [2025-09-29T17:10:13.024884] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:13.081799] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-29T17:10:13.082154] [INFO ] [MAIN ] AM: Loaded 52887 existing records. [2025-09-29T17:10:13.153424] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-29T17:10:13.287745] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:13.287961] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-29T17:10:13.288008] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-29T17:10:13.288490] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-29T17:10:13.288554] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-29T17:10:13.686546] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:13.948099] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-29T17:10:14.050098] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:10:14.349634] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T17:10:14.611508] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-29T17:10:14.748152] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-29T17:10:15.548171] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-29T17:10:15.970500] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T17:10:16.047229] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T17:10:16.348124] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-29T17:10:16.929815] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T17:10:17.148116] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-29T17:10:17.654547] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T17:10:17.948123] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-29T17:10:18.748116] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-29T17:10:19.356150] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T17:10:19.548137] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-29T17:10:19.997056] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-29T17:10:20.302235] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T17:10:20.348103] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-29T17:10:20.847996] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T17:10:21.148123] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-29T17:10:21.948130] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-29T17:10:22.073268] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T17:10:22.748134] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-29T17:10:23.430338] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:10:23.548126] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-29T17:10:24.348133] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-29T17:10:24.462514] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:10:25.097840] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T17:10:25.148099] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-29T17:10:25.301229] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T17:10:25.915516] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T17:10:25.917399] [INFO ] [REMOTE ] ALUR: Full fetch complete (20475 records). [2025-09-29T17:10:25.917480] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-29T17:10:25.918205] [FATAL] [VALIDATOR ] ALUR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:10:25.918293] [FATAL] [MAIN ] ALUR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:10:25.918337] [WARN ] [MAIN ] ALUR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:10:25.918376] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-29T17:10:25.918433] [DEBUG] [LOCAL ] ALUR: No primary data file found to delete. [2025-09-29T17:10:25.918468] [INFO ] [LOCAL ] ALUR: Starting deletion of derivative data. [2025-09-29T17:10:25.919236] [DEBUG] [LOCAL ] ALUR: Deleted derivative data file. [2025-09-29T17:10:25.919343] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 20.7s. Estimated remaining: 4h 23m 9s. Rate: 8.7 symbols/min [2025-09-29T17:10:25.953194] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-29T17:10:26.107857] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:26.148993] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-29T17:10:26.149291] [INFO ] [MAIN ] AMBC: Loaded 37453 existing records. [2025-09-29T17:10:26.342850] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:26.343094] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-29T17:10:26.343145] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-29T17:10:26.343628] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-29T17:10:26.343746] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-29T17:10:26.755167] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:26.755323] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-29T17:10:27.548138] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-29T17:10:27.878190] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T17:10:28.323315] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T17:10:28.348122] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-29T17:10:28.505150] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T17:10:29.148118] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-29T17:10:29.713371] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:10:29.738903] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T17:10:29.948109] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-29T17:10:30.748160] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-29T17:10:30.884900] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T17:10:31.548169] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-29T17:10:32.304792] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T17:10:32.348135] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-29T17:10:32.593065] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:10:33.148144] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-29T17:10:33.170335] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T17:10:33.948095] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-29T17:10:34.322243] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T17:10:34.748167] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-29T17:10:34.810538] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T17:10:34.812767] [INFO ] [REMOTE ] ALX: Full fetch complete (7010 records). [2025-09-29T17:10:34.812843] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-29T17:10:35.198247] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-29T17:10:35.198340] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-29T17:10:35.198596] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-29T17:10:35.198674] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-29T17:10:35.199185] [DEBUG] [LOCAL ] ALX: Trimmed 7010 records to 6134 (keeping 200 days of data) [2025-09-29T17:10:35.238903] [DEBUG] [LOCAL ] ALX: Primary data saved (6134 records). [2025-09-29T17:10:35.239039] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-29T17:10:35.239122] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 24.3s. Estimated remaining: 4h 24m 3s. Rate: 8.6 symbols/min [2025-09-29T17:10:35.414954] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:35.461854] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-29T17:10:35.462292] [INFO ] [MAIN ] AMBP: Loaded 45863 existing records. [2025-09-29T17:10:35.553313] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-29T17:10:35.654265] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:35.654473] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-29T17:10:35.654523] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-29T17:10:35.655226] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-29T17:10:35.655288] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-29T17:10:36.028542] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:36.348094] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-29T17:10:36.412288] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T17:10:37.148107] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-29T17:10:37.335033] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:10:37.948144] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-29T17:10:38.283537] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:10:38.691537] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T17:10:38.748120] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-29T17:10:39.203571] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T17:10:39.548123] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-29T17:10:40.347302] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T17:10:40.359291] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-29T17:10:41.113437] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T17:10:41.148119] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-29T17:10:41.948203] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-29T17:10:42.034221] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:10:42.622901] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T17:10:42.748155] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-29T17:10:43.548097] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-29T17:10:43.973687] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T17:10:44.348201] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-29T17:10:44.416775] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:10:44.923858] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:10:45.148116] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-29T17:10:45.890680] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:10:45.948195] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-29T17:10:46.748192] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-29T17:10:46.900611] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T17:10:47.512520] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T17:10:47.548185] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-29T17:10:48.031802] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T17:10:48.348125] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-29T17:10:49.148171] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-29T17:10:49.369748] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:10:49.380888] [INFO ] [REMOTE ] AM: Full fetch complete (75601 records). [2025-09-29T17:10:49.381056] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-29T17:10:49.785449] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-29T17:10:49.785709] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-29T17:10:49.786638] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-29T17:10:49.796330] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-29T17:10:49.813597] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T17:10:49.823051] [DEBUG] [LOCAL ] AM: Trimmed 75601 records to 52096 (keeping 200 days of data) [2025-09-29T17:10:49.951883] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-29T17:10:50.151542] [DEBUG] [LOCAL ] AM: Primary data saved (52096 records). [2025-09-29T17:10:50.151778] [INFO ] [MAIN ] AM: Full history saved. [2025-09-29T17:10:50.156518] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. AM took 37.3s. Estimated remaining: 4h 27m 13s. Rate: 8.5 symbols/min [2025-09-29T17:10:50.340265] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:50.340471] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-29T17:10:50.340558] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-29T17:10:50.340718] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-29T17:10:50.340768] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-29T17:10:50.340809] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-29T17:10:50.340841] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-29T17:10:50.734615] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:50.748107] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-29T17:10:50.792589] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:10:50.801672] [INFO ] [REMOTE ] ALV: Full fetch complete (61875 records). [2025-09-29T17:10:50.801853] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-29T17:10:51.220878] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-29T17:10:51.220972] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-29T17:10:51.221603] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-29T17:10:51.221670] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-29T17:10:51.223044] [DEBUG] [LOCAL ] ALV: Trimmed 61875 records to 42485 (keeping 200 days of data) [2025-09-29T17:10:51.505966] [DEBUG] [LOCAL ] ALV: Primary data saved (42485 records). [2025-09-29T17:10:51.506101] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-29T17:10:51.507214] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. ALV took 45.3s. Estimated remaining: 4h 24m 47s. Rate: 8.6 symbols/min [2025-09-29T17:10:51.551599] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-29T17:10:51.689026] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:51.753772] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-29T17:10:51.754205] [INFO ] [MAIN ] AMC: Loaded 54539 existing records. [2025-09-29T17:10:51.894485] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:10:51.919310] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T17:10:51.934232] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-29T17:10:51.936292] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:10:51.963627] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-29T17:10:52.023811] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:10:52.030250] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:52.030696] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-29T17:10:52.030887] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-29T17:10:52.030997] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-29T17:10:52.031343] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-29T17:10:52.031581] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-29T17:10:52.031891] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-29T17:10:52.032031] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBQ took 1.9s. Estimated remaining: 4h 22m 4s. Rate: 8.7 symbols/min [2025-09-29T17:10:52.040474] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-29T17:10:52.104263] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-29T17:10:52.139381] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T17:10:52.350978] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-29T17:10:52.392203] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:52.707462] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:52.725281] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-29T17:10:52.725740] [INFO ] [MAIN ] AMCR: Loaded 54449 existing records. [2025-09-29T17:10:52.910985] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:52.911198] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-29T17:10:52.911247] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-29T17:10:52.911911] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-29T17:10:52.911977] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-29T17:10:53.153309] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-29T17:10:53.297306] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:53.915322] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T17:10:53.948078] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-29T17:10:54.748133] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-29T17:10:55.548182] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-29T17:10:55.655822] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:10:55.747098] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-29T17:10:56.165894] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:10:56.348174] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-29T17:10:57.144764] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T17:10:57.158594] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-29T17:10:57.802117] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T17:10:57.948125] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-29T17:10:58.611470] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T17:10:58.748111] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-29T17:10:59.548125] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-29T17:10:59.712743] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T17:11:00.348101] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-29T17:11:00.419366] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T17:11:00.428683] [INFO ] [REMOTE ] AMBP: Full fetch complete (65823 records). [2025-09-29T17:11:00.428850] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-29T17:11:00.874372] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-29T17:11:00.874622] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-29T17:11:00.875351] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-29T17:11:00.882191] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-29T17:11:00.901574] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:11:00.911553] [DEBUG] [LOCAL ] AMBP: Trimmed 65823 records to 45121 (keeping 200 days of data) [2025-09-29T17:11:00.912613] [INFO ] [REMOTE ] AMBC: Full fetch complete (51106 records). [2025-09-29T17:11:00.913196] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-29T17:11:01.160821] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-29T17:11:01.457203] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-29T17:11:01.459348] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-29T17:11:01.460151] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-29T17:11:01.460240] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-29T17:11:01.465269] [DEBUG] [LOCAL ] AMBC: Trimmed 51106 records to 36595 (keeping 200 days of data) [2025-09-29T17:11:01.774771] [DEBUG] [LOCAL ] AMBP: Primary data saved (45121 records). [2025-09-29T17:11:01.776810] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-29T17:11:01.780158] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBP took 26.5s. Estimated remaining: 4h 23m 5s. Rate: 8.7 symbols/min [2025-09-29T17:11:02.053055] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:02.083171] [DEBUG] [LOCAL ] AMBC: Primary data saved (36595 records). [2025-09-29T17:11:02.083494] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-29T17:11:02.083695] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBC took 36.2s. Estimated remaining: 4h 20m 21s. Rate: 8.7 symbols/min [2025-09-29T17:11:02.311494] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:02.338362] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-29T17:11:02.339548] [INFO ] [MAIN ] AME: Loaded 49252 existing records. [2025-09-29T17:11:02.532879] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-29T17:11:02.583215] [INFO ] [MAIN ] AMG: Loaded 21046 existing records. [2025-09-29T17:11:02.582788] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:02.626019] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-29T17:11:02.651680] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-29T17:11:02.683160] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-29T17:11:02.707334] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-29T17:11:02.910609] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:02.921045] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-29T17:11:02.931761] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-29T17:11:03.070184] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-29T17:11:03.146510] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-29T17:11:03.198660] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-09-29T17:11:03.206736] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T17:11:03.320246] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-29T17:11:03.339586] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:03.360932] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-29T17:11:03.560794] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-29T17:11:03.702398] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:04.348183] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-29T17:11:05.248568] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T17:11:05.259064] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-29T17:11:05.462845] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:11:05.642208] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-29T17:11:05.695066] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T17:11:05.948107] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-29T17:11:06.748172] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-29T17:11:06.906189] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:11:06.969497] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T17:11:07.548154] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-29T17:11:08.348147] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-29T17:11:09.019296] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-29T17:11:09.148089] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-29T17:11:09.154094] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T17:11:09.202796] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T17:11:09.948108] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-29T17:11:10.745426] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T17:11:10.750586] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-29T17:11:11.544938] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-29T17:11:11.555552] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-29T17:11:12.348162] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-29T17:11:12.876360] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T17:11:12.972245] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-29T17:11:13.148133] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-29T17:11:13.948123] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-29T17:11:14.748086] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-29T17:11:14.847176] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-29T17:11:15.150697] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T17:11:15.548162] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-29T17:11:15.787310] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:11:16.109444] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:11:16.348141] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-29T17:11:17.148155] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-29T17:11:17.388556] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:11:17.948126] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-29T17:11:18.253122] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T17:11:18.291848] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T17:11:18.748162] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-29T17:11:19.548154] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-29T17:11:19.641033] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T17:11:19.901698] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T17:11:20.348133] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-29T17:11:21.148116] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-29T17:11:21.948123] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-29T17:11:22.001333] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T17:11:22.105129] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-29T17:11:22.135916] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T17:11:22.748162] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-29T17:11:23.548121] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-29T17:11:23.659904] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T17:11:24.348119] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-29T17:11:25.148187] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-29T17:11:25.404543] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-29T17:11:25.626042] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:11:25.948100] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-29T17:11:26.024764] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T17:11:26.606966] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T17:11:26.611961] [INFO ] [REMOTE ] AMG: Full fetch complete (29843 records). [2025-09-29T17:11:26.612121] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-29T17:11:26.753274] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-29T17:11:27.034311] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-29T17:11:27.034406] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-29T17:11:27.034857] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-29T17:11:27.034936] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-29T17:11:27.036010] [DEBUG] [LOCAL ] AMG: Trimmed 29843 records to 20495 (keeping 200 days of data) [2025-09-29T17:11:27.188064] [DEBUG] [LOCAL ] AMG: Primary data saved (20495 records). [2025-09-29T17:11:27.188214] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-29T17:11:27.188341] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMG took 25.1s. Estimated remaining: 4h 27m 21s. Rate: 8.5 symbols/min [2025-09-29T17:11:27.409438] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:27.474047] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-29T17:11:27.474436] [INFO ] [MAIN ] AMH: Loaded 52467 existing records. [2025-09-29T17:11:27.553314] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-29T17:11:27.669911] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:27.670206] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-29T17:11:27.670290] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-29T17:11:27.671144] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-29T17:11:27.671226] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-29T17:11:28.054110] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:28.348162] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-29T17:11:28.432030] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-29T17:11:28.443706] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-29T17:11:28.443894] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-29T17:11:28.869983] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-29T17:11:28.870195] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-29T17:11:28.871290] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-29T17:11:28.871453] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-29T17:11:28.873282] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53760 (keeping 200 days of data) [2025-09-29T17:11:29.003192] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-29T17:11:29.019367] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-29T17:11:29.023254] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-29T17:11:29.397291] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T17:11:29.475699] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-29T17:11:29.603375] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-29T17:11:29.642085] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-29T17:11:29.643785] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-29T17:11:29.644836] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-29T17:11:29.648714] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53669 (keeping 200 days of data) [2025-09-29T17:11:30.099946] [DEBUG] [LOCAL ] AMC: Primary data saved (53760 records). [2025-09-29T17:11:30.103872] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-29T17:11:30.106530] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-09-29T17:11:30.105072] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMC took 38.6s. Estimated remaining: 4h 25m 38s. Rate: 8.6 symbols/min [2025-09-29T17:11:30.106701] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-29T17:11:30.119317] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMCR took 38.1s. Estimated remaining: 4h 22m 51s. Rate: 8.6 symbols/min [2025-09-29T17:11:30.369069] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T17:11:30.448383] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-29T17:11:30.513431] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:30.535755] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:30.590391] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-29T17:11:30.590935] [INFO ] [MAIN ] AMP: Loaded 32959 existing records. [2025-09-29T17:11:30.774540] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-29T17:11:30.819231] [INFO ] [MAIN ] AMN: Loaded 42588 existing records. [2025-09-29T17:11:30.848721] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:30.898952] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-29T17:11:30.912813] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-29T17:11:30.935281] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-29T17:11:30.953997] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-29T17:11:31.183381] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:31.204321] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-29T17:11:31.266316] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-29T17:11:31.313010] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-29T17:11:31.313232] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-29T17:11:31.599520] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:31.620753] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-29T17:11:31.828478] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-29T17:11:31.908145] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-29T17:11:31.915328] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:32.289136] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T17:11:32.348117] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-29T17:11:33.148120] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-29T17:11:33.202037] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T17:11:33.784171] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T17:11:33.795030] [INFO ] [REMOTE ] AME: Full fetch complete (69851 records). [2025-09-29T17:11:33.795230] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-29T17:11:33.961065] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-29T17:11:34.137472] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T17:11:34.273926] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-29T17:11:34.274015] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-29T17:11:34.274797] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-29T17:11:34.274872] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-29T17:11:34.276458] [DEBUG] [LOCAL ] AME: Trimmed 69851 records to 48537 (keeping 200 days of data) [2025-09-29T17:11:34.603623] [DEBUG] [LOCAL ] AME: Primary data saved (48537 records). [2025-09-29T17:11:34.603850] [INFO ] [MAIN ] AME: Full history saved. [2025-09-29T17:11:34.604000] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AME took 32.8s. Estimated remaining: 4h 21m 48s. Rate: 8.7 symbols/min [2025-09-29T17:11:34.753289] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-29T17:11:34.804001] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:34.865436] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-29T17:11:34.865873] [INFO ] [MAIN ] AMPX: Loaded 52949 existing records. [2025-09-29T17:11:35.088422] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:35.088920] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-29T17:11:35.089583] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-29T17:11:35.092029] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:11:35.101062] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-29T17:11:35.102064] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-29T17:11:35.495557] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:35.522261] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T17:11:35.548088] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-29T17:11:36.324053] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T17:11:36.348077] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-29T17:11:37.148124] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-29T17:11:37.824180] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:11:37.948112] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-29T17:11:38.605931] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:11:38.748144] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-29T17:11:38.808408] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (3.26 seconds). [2025-09-29T17:11:39.548124] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-29T17:11:39.610770] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T17:11:40.350993] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-29T17:11:40.356453] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T17:11:41.148078] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-29T17:11:41.452028] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T17:11:41.948098] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-29T17:11:42.048155] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T17:11:42.453944] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T17:11:42.748174] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-29T17:11:43.548096] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-29T17:11:43.751384] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:11:44.297251] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T17:11:44.348105] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-29T17:11:44.783291] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T17:11:45.148117] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-29T17:11:45.588334] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T17:11:45.948117] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-29T17:11:46.748121] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-29T17:11:47.051870] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:11:47.467121] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:11:47.548139] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-29T17:11:48.348101] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-29T17:11:48.579825] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T17:11:48.887204] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T17:11:49.148193] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-29T17:11:49.948122] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-29T17:11:50.314414] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T17:11:50.531980] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:11:50.748129] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-29T17:11:51.152174] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T17:11:51.548114] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-29T17:11:52.025515] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:11:52.348113] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-29T17:11:53.148090] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-29T17:11:53.459982] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T17:11:53.870196] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:11:53.948106] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-29T17:11:54.551924] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T17:11:54.748124] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-29T17:11:55.465627] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T17:11:55.548116] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-29T17:11:56.169134] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T17:11:56.348145] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-29T17:11:57.148124] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-29T17:11:57.892630] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T17:11:57.948088] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-29T17:11:58.150472] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-29T17:11:58.748115] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-29T17:11:58.773467] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T17:11:58.780493] [INFO ] [REMOTE ] AMP: Full fetch complete (47629 records). [2025-09-29T17:11:58.780610] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-29T17:11:59.175224] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-29T17:11:59.175347] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-29T17:11:59.175943] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-29T17:11:59.176008] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-29T17:11:59.177123] [DEBUG] [LOCAL ] AMP: Trimmed 47629 records to 32281 (keeping 200 days of data) [2025-09-29T17:11:59.392914] [DEBUG] [LOCAL ] AMP: Primary data saved (32281 records). [2025-09-29T17:11:59.393076] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-29T17:11:59.393167] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMP took 29.3s. Estimated remaining: 4h 28m 23s. Rate: 8.5 symbols/min [2025-09-29T17:11:59.550936] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-29T17:11:59.589368] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:59.622604] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T17:11:59.670557] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-29T17:11:59.670924] [INFO ] [MAIN ] AMPY: Loaded 38164 existing records. [2025-09-29T17:11:59.860317] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:59.860602] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-29T17:11:59.860686] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-29T17:11:59.861095] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-29T17:11:59.861156] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-29T17:12:00.245835] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:00.349986] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-29T17:12:00.364188] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T17:12:00.376319] [INFO ] [REMOTE ] AMH: Full fetch complete (74785 records). [2025-09-29T17:12:00.376485] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-29T17:12:00.788544] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-29T17:12:00.788666] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-29T17:12:00.789481] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-29T17:12:00.789551] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-29T17:12:00.791305] [DEBUG] [LOCAL ] AMH: Trimmed 74785 records to 51699 (keeping 200 days of data) [2025-09-29T17:12:01.119550] [DEBUG] [LOCAL ] AMH: Primary data saved (51699 records). [2025-09-29T17:12:01.119754] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-29T17:12:01.119861] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 33.9s. Estimated remaining: 4h 26m 16s. Rate: 8.5 symbols/min [2025-09-29T17:12:01.158794] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-29T17:12:01.307990] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:01.345217] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-29T17:12:01.345497] [INFO ] [MAIN ] AMR: Loaded 29441 existing records. [2025-09-29T17:12:01.538077] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:01.538929] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-29T17:12:01.539078] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-29T17:12:01.539590] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-29T17:12:01.539686] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-29T17:12:01.858192] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:12:01.956952] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-29T17:12:02.006465] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:02.045058] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-29T17:12:02.748096] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-29T17:12:02.986411] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T17:12:02.995754] [INFO ] [REMOTE ] AMN: Full fetch complete (60298 records). [2025-09-29T17:12:02.995924] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-29T17:12:03.385904] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T17:12:03.446119] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-29T17:12:03.446215] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-29T17:12:03.447001] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-29T17:12:03.447072] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-29T17:12:03.448533] [DEBUG] [LOCAL ] AMN: Trimmed 60298 records to 41796 (keeping 200 days of data) [2025-09-29T17:12:03.548624] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-29T17:12:03.718764] [DEBUG] [LOCAL ] AMN: Primary data saved (41796 records). [2025-09-29T17:12:03.718907] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-29T17:12:03.720401] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMN took 33.6s. Estimated remaining: 4h 24m 32s. Rate: 8.6 symbols/min [2025-09-29T17:12:03.896204] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:03.909903] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T17:12:03.953031] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-29T17:12:03.953359] [INFO ] [MAIN ] AMRC: Loaded 38981 existing records. [2025-09-29T17:12:04.138061] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:04.138278] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-29T17:12:04.138389] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-29T17:12:04.138739] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-29T17:12:04.138801] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-29T17:12:04.357151] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-29T17:12:04.518869] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:05.148113] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-29T17:12:05.556706] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T17:12:05.735374] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-29T17:12:05.747155] [INFO ] [REMOTE ] AMPX: Full fetch complete (74626 records). [2025-09-29T17:12:05.747342] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-29T17:12:05.959795] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-29T17:12:06.202552] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-29T17:12:06.202686] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-29T17:12:06.203460] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-29T17:12:06.203526] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-29T17:12:06.205051] [DEBUG] [LOCAL ] AMPX: Trimmed 74626 records to 52224 (keeping 200 days of data) [2025-09-29T17:12:06.513051] [DEBUG] [LOCAL ] AMPX: Primary data saved (52224 records). [2025-09-29T17:12:06.513205] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-29T17:12:06.513294] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 31.9s. Estimated remaining: 4h 22m 53s. Rate: 8.6 symbols/min [2025-09-29T17:12:06.639739] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T17:12:06.719598] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:06.719805] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-29T17:12:06.719864] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-29T17:12:06.719981] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-29T17:12:06.720025] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-29T17:12:06.720069] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-29T17:12:06.720103] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-29T17:12:06.753218] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-29T17:12:07.115020] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:07.492325] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:12:07.548076] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-29T17:12:07.670495] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T17:12:08.348131] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-29T17:12:09.105330] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T17:12:09.148100] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-29T17:12:09.204541] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T17:12:09.948129] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-29T17:12:10.644497] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T17:12:10.748172] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-29T17:12:11.389259] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:12:11.548140] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-29T17:12:11.761749] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:12:11.762117] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-29T17:12:11.762220] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:12:11.762281] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-29T17:12:11.762372] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:12:11.762477] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-29T17:12:11.762600] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-29T17:12:11.762710] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-29T17:12:11.762819] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-29T17:12:11.762926] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMRZ took 5.2s. Estimated remaining: 4h 22m 9s. Rate: 8.6 symbols/min [2025-09-29T17:12:11.962377] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:12.021799] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-29T17:12:12.022156] [INFO ] [MAIN ] AMT: Loaded 53212 existing records. [2025-09-29T17:12:12.209812] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:12.210178] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-29T17:12:12.210270] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-29T17:12:12.212205] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-29T17:12:12.212272] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-29T17:12:12.359793] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-29T17:12:12.642636] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:12.645376] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T17:12:13.148130] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-29T17:12:13.793428] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T17:12:13.948133] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-29T17:12:14.748126] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-29T17:12:15.143168] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T17:12:15.548114] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-29T17:12:15.753917] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:12:16.252082] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T17:12:16.348129] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-29T17:12:17.148172] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-29T17:12:17.197857] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:12:17.845996] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T17:12:17.948165] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-29T17:12:18.748113] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-29T17:12:18.894173] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:12:19.548161] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-29T17:12:19.676814] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T17:12:20.099534] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T17:12:20.348141] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-29T17:12:20.769735] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T17:12:21.148174] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-29T17:12:21.940474] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T17:12:21.948110] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-29T17:12:21.948016] [INFO ] [REMOTE ] AMPY: Full fetch complete (50478 records). [2025-09-29T17:12:21.948390] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-29T17:12:21.950322] [FATAL] [VALIDATOR ] AMPY: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:12:21.950533] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:12:21.950619] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:12:21.950759] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-29T17:12:21.950856] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-29T17:12:21.950914] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-09-29T17:12:21.951874] [DEBUG] [LOCAL ] AMPY: Deleted derivative data file. [2025-09-29T17:12:21.956444] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMPY took 22.6s. Estimated remaining: 4h 23m 12s. Rate: 8.6 symbols/min [2025-09-29T17:12:22.144899] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:22.172954] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-29T17:12:22.173436] [INFO ] [MAIN ] AMTB: Loaded 20599 existing records. [2025-09-29T17:12:22.361809] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:22.362267] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-29T17:12:22.362349] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-29T17:12:22.371446] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-29T17:12:22.385674] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-29T17:12:22.445276] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T17:12:22.752295] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-29T17:12:22.778723] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:23.548120] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-29T17:12:23.847586] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:12:24.075077] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:12:24.348109] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-29T17:12:24.457908] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T17:12:25.148142] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-29T17:12:25.948092] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-29T17:12:26.080689] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T17:12:26.379922] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-29T17:12:26.748124] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-29T17:12:27.218257] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T17:12:27.425036] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T17:12:27.548158] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-29T17:12:28.348127] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-29T17:12:28.555957] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T17:12:29.148149] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-29T17:12:29.905117] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T17:12:29.948139] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-29T17:12:30.283543] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T17:12:30.748157] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-29T17:12:31.297221] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:12:31.548166] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-29T17:12:31.723019] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T17:12:32.348152] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-29T17:12:33.002660] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T17:12:33.148138] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-29T17:12:33.817465] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T17:12:33.948124] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-29T17:12:34.049782] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T17:12:34.748112] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-29T17:12:35.548098] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-29T17:12:35.960482] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T17:12:36.068493] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T17:12:36.077495] [INFO ] [REMOTE ] AMRC: Full fetch complete (52807 records). [2025-09-29T17:12:36.077689] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-29T17:12:36.353400] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-29T17:12:36.513316] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-29T17:12:36.513420] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-29T17:12:36.514171] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-29T17:12:36.514244] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-29T17:12:36.515440] [DEBUG] [LOCAL ] AMRC: Trimmed 52807 records to 38202 (keeping 200 days of data) [2025-09-29T17:12:36.737807] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T17:12:36.772938] [DEBUG] [LOCAL ] AMRC: Primary data saved (38202 records). [2025-09-29T17:12:36.773090] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-29T17:12:36.775406] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 33.1s. Estimated remaining: 4h 25m 51s. Rate: 8.5 symbols/min [2025-09-29T17:12:36.947406] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:36.955243] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-29T17:12:36.955479] [INFO ] [MAIN ] AMTD: Loaded 3622 existing records. [2025-09-29T17:12:37.147770] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:37.148020] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-29T17:12:37.148285] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-29T17:12:37.148117] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-29T17:12:37.148709] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-29T17:12:37.149431] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-29T17:12:37.534814] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:37.948115] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-29T17:12:38.201029] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:12:38.634490] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T17:12:38.748121] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-29T17:12:38.996315] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T17:12:39.546865] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T17:12:39.549050] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-29T17:12:39.947762] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T17:12:40.348137] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-29T17:12:41.148137] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-29T17:12:41.950206] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-29T17:12:42.200315] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T17:12:42.502077] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:12:42.508232] [INFO ] [REMOTE ] AMR: Full fetch complete (39842 records). [2025-09-29T17:12:42.508384] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-29T17:12:42.753201] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-29T17:12:42.941847] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-29T17:12:42.941984] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-29T17:12:42.942674] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-29T17:12:42.942791] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-29T17:12:42.945199] [DEBUG] [LOCAL ] AMR: Trimmed 39842 records to 28957 (keeping 200 days of data) [2025-09-29T17:12:43.053814] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:12:43.066098] [INFO ] [REMOTE ] AMTB: Full fetch complete (30067 records). [2025-09-29T17:12:43.070771] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-29T17:12:43.346441] [DEBUG] [LOCAL ] AMR: Primary data saved (28957 records). [2025-09-29T17:12:43.360585] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-29T17:12:43.394321] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMR took 42.3s. Estimated remaining: 4h 25m 35s. Rate: 8.5 symbols/min [2025-09-29T17:12:43.548626] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-29T17:12:43.759469] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-29T17:12:43.765173] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-29T17:12:43.794363] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-29T17:12:43.847208] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-29T17:12:43.847085] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:43.848729] [DEBUG] [LOCAL ] AMTB: Trimmed 30067 records to 20251 (keeping 200 days of data) [2025-09-29T17:12:43.975904] [DEBUG] [LOCAL ] AMTB: Primary data saved (20251 records). [2025-09-29T17:12:43.976096] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-29T17:12:43.976200] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 22.0s. Estimated remaining: 4h 23m 14s. Rate: 8.6 symbols/min [2025-09-29T17:12:44.195188] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:44.196845] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-29T17:12:44.197502] [INFO ] [MAIN ] AMTM: Loaded 51451 existing records. [2025-09-29T17:12:44.284229] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T17:12:44.317011] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-29T17:12:44.330591] [INFO ] [MAIN ] AMWL: Loaded 8830 existing records. [2025-09-29T17:12:44.353250] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-29T17:12:44.551514] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:44.552117] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-29T17:12:44.558145] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-29T17:12:44.568685] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-29T17:12:44.574056] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-29T17:12:44.703367] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:44.731546] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-29T17:12:44.742785] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-29T17:12:44.757092] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-29T17:12:44.798142] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-29T17:12:44.854140] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T17:12:45.164263] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-29T17:12:45.277389] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-29T17:12:45.329037] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:45.502009] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:45.700631] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T17:12:45.948157] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-29T17:12:46.748098] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-29T17:12:47.548082] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-29T17:12:47.708896] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T17:12:48.002568] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T17:12:48.013974] [INFO ] [REMOTE ] AMT: Full fetch complete (76015 records). [2025-09-29T17:12:48.014125] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-29T17:12:48.107229] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T17:12:48.353229] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-29T17:12:48.449299] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-29T17:12:48.449390] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-29T17:12:48.450217] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-29T17:12:48.450285] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-29T17:12:48.454735] [DEBUG] [LOCAL ] AMT: Trimmed 76015 records to 52433 (keeping 200 days of data) [2025-09-29T17:12:48.797626] [DEBUG] [LOCAL ] AMT: Primary data saved (52433 records). [2025-09-29T17:12:48.797822] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-29T17:12:48.797935] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMT took 37.0s. Estimated remaining: 4h 22m 22s. Rate: 8.6 symbols/min [2025-09-29T17:12:48.980849] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:49.048667] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-29T17:12:49.049144] [INFO ] [MAIN ] AMX: Loaded 49855 existing records. [2025-09-29T17:12:49.155584] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-29T17:12:49.247588] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:49.247866] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-29T17:12:49.247923] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-29T17:12:49.248736] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-29T17:12:49.248803] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-29T17:12:49.516551] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T17:12:49.658908] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:49.948111] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-29T17:12:50.748076] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-29T17:12:50.762530] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T17:12:51.073514] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:12:51.548119] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-29T17:12:52.136369] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T17:12:52.299883] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T17:12:52.348080] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-29T17:12:53.112386] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T17:12:53.148111] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-29T17:12:53.948111] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-29T17:12:54.028109] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T17:12:54.742872] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T17:12:54.748066] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-29T17:12:55.548121] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-29T17:12:56.348136] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-29T17:12:56.403850] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T17:12:56.867814] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T17:12:57.148088] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-29T17:12:57.338278] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:12:57.948088] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-29T17:12:57.976303] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:12:58.748117] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-29T17:12:59.396604] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T17:12:59.505195] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:12:59.548073] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-29T17:13:00.348112] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-29T17:13:01.149347] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-29T17:13:01.151214] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-29T17:13:01.306692] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T17:13:01.948146] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-29T17:13:01.968213] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T17:13:01.969948] [INFO ] [REMOTE ] AMTD: Full fetch complete (5568 records). [2025-09-29T17:13:01.970024] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-29T17:13:02.364048] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-29T17:13:02.364130] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-29T17:13:02.364332] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-29T17:13:02.364420] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-29T17:13:02.364993] [DEBUG] [LOCAL ] AMTD: Trimmed 5568 records to 3600 (keeping 200 days of data) [2025-09-29T17:13:02.387618] [DEBUG] [LOCAL ] AMTD: Primary data saved (3600 records). [2025-09-29T17:13:02.387775] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-29T17:13:02.387862] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTD took 25.6s. Estimated remaining: 4h 24m 30s. Rate: 8.5 symbols/min [2025-09-29T17:13:02.567953] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:02.613140] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-29T17:13:02.613442] [INFO ] [MAIN ] AN: Loaded 32842 existing records. [2025-09-29T17:13:02.762231] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-29T17:13:02.810572] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:02.810924] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-29T17:13:02.810996] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-29T17:13:02.811387] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-29T17:13:02.811450] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-29T17:13:03.192190] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:03.548163] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-29T17:13:04.085388] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-29T17:13:04.348142] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-29T17:13:04.648964] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:13:05.076685] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:13:05.123157] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T17:13:05.148118] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-29T17:13:05.948145] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-29T17:13:06.191780] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T17:13:06.748110] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-29T17:13:07.548076] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-29T17:13:07.668037] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T17:13:08.348086] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-29T17:13:08.495383] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:13:08.572364] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T17:13:08.575228] [INFO ] [REMOTE ] AMWL: Full fetch complete (14003 records). [2025-09-29T17:13:08.575341] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-29T17:13:08.960546] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-29T17:13:08.960676] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-29T17:13:08.960943] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-29T17:13:08.961020] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-29T17:13:08.961518] [DEBUG] [LOCAL ] AMWL: Trimmed 14003 records to 8685 (keeping 200 days of data) [2025-09-29T17:13:09.013739] [DEBUG] [LOCAL ] AMWL: Primary data saved (8685 records). [2025-09-29T17:13:09.013895] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-29T17:13:09.014012] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMWL took 25.0s. Estimated remaining: 4h 24m 15s. Rate: 8.5 symbols/min [2025-09-29T17:13:09.153292] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-29T17:13:09.204191] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:09.292195] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-29T17:13:09.292760] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-09-29T17:13:09.491194] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:09.491407] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-29T17:13:09.491480] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-29T17:13:09.492443] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-29T17:13:09.492530] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-29T17:13:09.880564] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:09.918391] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T17:13:09.948108] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-29T17:13:10.748074] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-29T17:13:10.867132] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T17:13:11.548120] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-29T17:13:12.355902] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-29T17:13:12.377431] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-29T17:13:12.434503] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:13:12.884228] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T17:13:13.148127] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-29T17:13:13.948161] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-29T17:13:14.168999] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:13:14.258802] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:13:14.748137] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-29T17:13:15.548115] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-29T17:13:16.019052] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-29T17:13:16.348086] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-29T17:13:16.413484] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T17:13:17.148117] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-29T17:13:17.216702] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T17:13:17.948156] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-29T17:13:18.748089] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-29T17:13:18.784628] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-29T17:13:18.819700] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:13:19.548077] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-29T17:13:19.771995] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:13:19.782226] [INFO ] [REMOTE ] AMX: Full fetch complete (70727 records). [2025-09-29T17:13:19.782422] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-29T17:13:20.211846] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-29T17:13:20.212033] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-29T17:13:20.212973] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-29T17:13:20.213043] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-29T17:13:20.215117] [DEBUG] [LOCAL ] AMX: Trimmed 70727 records to 49128 (keeping 200 days of data) [2025-09-29T17:13:20.348461] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-29T17:13:20.487310] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:13:20.589566] [DEBUG] [LOCAL ] AMX: Primary data saved (49128 records). [2025-09-29T17:13:20.589758] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-29T17:13:20.589876] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMX took 31.8s. Estimated remaining: 4h 25m 39s. Rate: 8.5 symbols/min [2025-09-29T17:13:20.770682] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:20.843550] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-29T17:13:20.844163] [INFO ] [MAIN ] ANF: Loaded 52967 existing records. [2025-09-29T17:13:21.035388] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T17:13:21.071495] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:21.072226] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-29T17:13:21.072866] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-29T17:13:21.073543] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-29T17:13:21.073605] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-29T17:13:21.153266] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-29T17:13:21.454418] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:21.948140] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-29T17:13:22.479490] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T17:13:22.748090] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-29T17:13:22.797117] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-29T17:13:23.289457] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:13:23.548115] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-29T17:13:24.163534] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:13:24.348131] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-29T17:13:25.148171] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-29T17:13:25.541025] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:13:25.948116] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-29T17:13:26.034861] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-29T17:13:26.748117] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-29T17:13:27.051740] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:13:27.062518] [INFO ] [REMOTE ] AMTM: Full fetch complete (73951 records). [2025-09-29T17:13:27.062754] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-29T17:13:27.483335] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-29T17:13:27.483465] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-29T17:13:27.484345] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-29T17:13:27.484430] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-29T17:13:27.502625] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T17:13:27.509876] [DEBUG] [LOCAL ] AMTM: Trimmed 73951 records to 50658 (keeping 200 days of data) [2025-09-29T17:13:27.510082] [INFO ] [REMOTE ] AN: Full fetch complete (47599 records). [2025-09-29T17:13:27.510725] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-29T17:13:27.580381] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-29T17:13:28.070040] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-29T17:13:28.070480] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-29T17:13:28.071067] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-29T17:13:28.071503] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-29T17:13:28.075537] [DEBUG] [LOCAL ] AN: Trimmed 47599 records to 32121 (keeping 200 days of data) [2025-09-29T17:13:28.466262] [DEBUG] [LOCAL ] AMTM: Primary data saved (50658 records). [2025-09-29T17:13:28.467303] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-29T17:13:28.467480] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMTM took 45.0s. Estimated remaining: 4h 25m 48s. Rate: 8.5 symbols/min [2025-09-29T17:13:28.639586] [DEBUG] [LOCAL ] AN: Primary data saved (32121 records). [2025-09-29T17:13:28.646207] [INFO ] [MAIN ] AN: Full history saved. [2025-09-29T17:13:28.670497] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AN took 26.3s. Estimated remaining: 4h 23m 27s. Rate: 8.6 symbols/min [2025-09-29T17:13:28.676597] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:28.724832] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-29T17:13:28.765629] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-29T17:13:28.790713] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-29T17:13:28.791119] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-29T17:13:28.796742] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-29T17:13:28.796841] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-29T17:13:28.949553] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:29.138581] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-29T17:13:29.161461] [INFO ] [MAIN ] ANRO: Loaded 19387 existing records. [2025-09-29T17:13:29.432575] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:29.433507] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-29T17:13:29.522358] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:29.523626] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-29T17:13:29.523802] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-29T17:13:29.524221] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-29T17:13:29.524283] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-29T17:13:29.652447] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-09-29T17:13:29.690868] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-29T17:13:29.719714] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:13:29.773298] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-29T17:13:29.791353] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:13:29.825710] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-29T17:13:29.848157] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:13:29.871149] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-29T17:13:29.891800] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-29T17:13:29.892056] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-29T17:13:29.892148] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-29T17:13:29.892561] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANGX took 1.4s. Estimated remaining: 4h 21m 27s. Rate: 8.6 symbols/min [2025-09-29T17:13:30.060941] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:30.071207] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-29T17:13:30.128682] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-29T17:13:30.214376] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:30.245065] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-29T17:13:30.245349] [INFO ] [MAIN ] ANVS: Loaded 23508 existing records. [2025-09-29T17:13:30.454945] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:30.455264] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-29T17:13:30.455319] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-29T17:13:30.456371] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-29T17:13:30.456432] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-29T17:13:30.753380] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-29T17:13:30.863311] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:31.548155] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-29T17:13:31.648116] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T17:13:31.932789] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-29T17:13:32.348091] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-29T17:13:32.674529] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-29T17:13:33.060791] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:13:33.148139] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-29T17:13:33.948158] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-29T17:13:34.755598] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-29T17:13:34.762001] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-29T17:13:34.874502] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T17:13:34.988522] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T17:13:35.548102] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-29T17:13:35.746221] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-29T17:13:36.348106] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-29T17:13:37.148118] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-29T17:13:37.862531] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:13:37.953304] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-29T17:13:37.975537] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-29T17:13:38.748122] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-29T17:13:38.942054] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T17:13:38.973870] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T17:13:39.548138] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-29T17:13:40.348098] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-29T17:13:40.803093] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T17:13:41.148092] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-29T17:13:41.338766] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-29T17:13:41.350706] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-29T17:13:41.350852] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-29T17:13:41.662334] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T17:13:41.811712] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-29T17:13:41.811824] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-29T17:13:41.812767] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-29T17:13:41.812860] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-29T17:13:41.814496] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 53766 (keeping 200 days of data) [2025-09-29T17:13:41.948132] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-29T17:13:42.173277] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-29T17:13:42.173452] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-29T17:13:42.173556] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANET took 33.2s. Estimated remaining: 4h 23m 3s. Rate: 8.6 symbols/min [2025-09-29T17:13:42.455990] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T17:13:42.748104] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-29T17:13:43.459036] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T17:13:43.548120] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-29T17:13:43.858207] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T17:13:44.348131] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-29T17:13:44.749582] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T17:13:45.148169] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-29T17:13:45.948126] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-29T17:13:46.422391] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T17:13:46.748105] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-29T17:13:46.876180] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-29T17:13:47.179971] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T17:13:47.548077] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-29T17:13:47.900548] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T17:13:48.348106] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-29T17:13:48.420936] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T17:13:49.148113] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-29T17:13:49.948093] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-29T17:13:50.026543] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T17:13:50.029488] [INFO ] [REMOTE ] ANRO: Full fetch complete (29920 records). [2025-09-29T17:13:50.029577] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-29T17:13:50.458250] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-29T17:13:50.456638] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-29T17:13:50.468214] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-29T17:13:50.468747] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-29T17:13:50.468922] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-29T17:13:50.470267] [DEBUG] [LOCAL ] ANRO: Trimmed 29920 records to 18969 (keeping 200 days of data) [2025-09-29T17:13:50.585879] [DEBUG] [LOCAL ] ANRO: Primary data saved (18969 records). [2025-09-29T17:13:50.586028] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-29T17:13:50.586116] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 21.9s. Estimated remaining: 4h 23m 23s. Rate: 8.6 symbols/min [2025-09-29T17:13:50.748098] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-29T17:13:51.093859] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:13:51.548176] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-29T17:13:52.633389] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T17:13:52.646179] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-29T17:13:52.765956] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T17:13:53.148275] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-29T17:13:54.140689] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T17:13:54.146176] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-29T17:13:54.566626] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T17:13:54.748114] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-29T17:13:55.290806] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T17:13:55.295323] [INFO ] [REMOTE ] ANVS: Full fetch complete (36481 records). [2025-09-29T17:13:55.295442] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-29T17:13:55.695863] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-29T17:13:55.695975] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-29T17:13:55.696506] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-29T17:13:55.696568] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-29T17:13:55.697595] [DEBUG] [LOCAL ] ANVS: Trimmed 36481 records to 23113 (keeping 200 days of data) [2025-09-29T17:13:55.827413] [DEBUG] [LOCAL ] ANVS: Primary data saved (23113 records). [2025-09-29T17:13:55.827547] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-29T17:13:55.827635] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANVS took 25.9s. Estimated remaining: 4h 22m 42s. Rate: 8.6 symbols/min [2025-09-29T17:13:56.754374] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T17:13:56.765090] [INFO ] [REMOTE ] ANF: Full fetch complete (75627 records). [2025-09-29T17:13:56.765253] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-29T17:13:57.182424] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-29T17:13:57.182540] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-29T17:13:57.183368] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-29T17:13:57.183438] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-29T17:13:57.185150] [DEBUG] [LOCAL ] ANF: Trimmed 75627 records to 52173 (keeping 200 days of data) [2025-09-29T17:13:57.506059] [DEBUG] [LOCAL ] ANF: Primary data saved (52173 records). [2025-09-29T17:13:57.506197] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-29T17:13:57.506291] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANF took 36.9s. Estimated remaining: 4h 20m 55s. Rate: 8.6 symbols/min [2025-09-29T17:13:58.048302] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:58.130828] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-29T17:13:58.155995] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-29T17:13:58.221773] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-29T17:13:58.296486] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:58.300818] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:58.296607] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-29T17:13:58.305293] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:58.305928] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-29T17:13:58.306160] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-29T17:13:58.462720] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-29T17:13:58.463892] [INFO ] [MAIN ] AOMR: Loaded 16852 existing records. [2025-09-29T17:13:58.555983] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-29T17:13:58.647971] [INFO ] [MAIN ] AOD: Loaded 30414 existing records. [2025-09-29T17:13:58.897558] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-29T17:13:58.981628] [INFO ] [MAIN ] AON: Loaded 46248 existing records. [2025-09-29T17:13:59.242050] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:59.351559] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:59.363054] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-29T17:13:59.372487] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-29T17:13:59.377471] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-29T17:13:59.377187] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:59.390153] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-29T17:13:59.398147] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-29T17:13:59.402270] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-29T17:13:59.402062] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-29T17:13:59.407584] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-29T17:13:59.451242] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-29T17:13:59.617419] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:13:59.682069] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:59.682234] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-29T17:13:59.703664] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:13:59.738106] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-29T17:13:59.732762] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-29T17:13:59.778350] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:13:59.844229] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-29T17:13:59.844160] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-29T17:13:59.932377] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-29T17:13:59.937965] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-29T17:13:59.932546] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-29T17:14:00.001261] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-29T17:14:00.065745] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-29T17:14:00.112627] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.6s. Estimated remaining: 4h 19m 28s. Rate: 8.7 symbols/min [2025-09-29T17:14:00.386127] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:00.452601] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-29T17:14:00.747402] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:00.782080] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-29T17:14:00.885140] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:00.974216] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:00.974680] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-29T17:14:00.999123] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-29T17:14:00.999396] [INFO ] [MAIN ] AORT: Loaded 30087 existing records. [2025-09-29T17:14:01.200886] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:01.201186] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-29T17:14:01.201290] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-29T17:14:01.201795] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-29T17:14:01.201900] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-29T17:14:01.602505] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:01.602999] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-29T17:14:01.679515] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:14:01.684783] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-29T17:14:02.382905] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T17:14:02.389521] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-29T17:14:02.539927] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T17:14:02.543017] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-29T17:14:02.771458] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:14:02.781232] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-29T17:14:02.970030] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:14:02.975159] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-29T17:14:03.609058] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T17:14:03.614412] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-29T17:14:03.706230] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T17:14:04.092263] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T17:14:04.277238] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T17:14:04.325885] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T17:14:04.348079] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-29T17:14:05.148123] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-29T17:14:05.944002] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:14:05.952196] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-29T17:14:06.375628] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T17:14:06.748165] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-29T17:14:07.047243] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:14:07.548138] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-29T17:14:08.348103] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-29T17:14:08.415465] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:14:09.148151] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-29T17:14:09.320407] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T17:14:09.452626] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:14:09.948131] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-29T17:14:10.438878] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T17:14:10.748107] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-29T17:14:11.000454] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T17:14:11.548136] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-29T17:14:11.900141] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T17:14:12.348128] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-29T17:14:13.148101] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-29T17:14:13.192311] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T17:14:13.218208] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T17:14:13.948146] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-29T17:14:14.748127] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-29T17:14:14.802622] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:14:15.020130] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:14:15.548138] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-29T17:14:15.705729] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-29T17:14:16.348136] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-29T17:14:16.878880] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T17:14:17.148113] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-29T17:14:17.253700] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T17:14:17.948113] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-29T17:14:18.621999] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T17:14:18.748092] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-29T17:14:19.067599] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T17:14:19.548163] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-29T17:14:19.884377] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:14:20.348117] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-29T17:14:20.891334] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T17:14:21.148111] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-29T17:14:21.618962] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T17:14:21.948130] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-29T17:14:22.447821] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T17:14:22.748115] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-29T17:14:23.548139] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-29T17:14:23.600028] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:14:23.964269] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T17:14:23.972182] [INFO ] [REMOTE ] AOD: Full fetch complete (44136 records). [2025-09-29T17:14:23.972345] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-29T17:14:24.363236] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-29T17:14:24.383702] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-29T17:14:24.383807] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-29T17:14:24.384338] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-29T17:14:24.384385] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-29T17:14:24.385732] [DEBUG] [LOCAL ] AOD: Trimmed 44136 records to 30055 (keeping 200 days of data) [2025-09-29T17:14:24.578974] [DEBUG] [LOCAL ] AOD: Primary data saved (30055 records). [2025-09-29T17:14:24.579119] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-29T17:14:24.579215] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOD took 27.1s. Estimated remaining: 4h 24m 44s. Rate: 8.5 symbols/min [2025-09-29T17:14:24.762955] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:24.817273] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-29T17:14:24.817799] [INFO ] [MAIN ] AOS: Loaded 49769 existing records. [2025-09-29T17:14:25.008069] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:25.008863] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-29T17:14:25.008937] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-29T17:14:25.009455] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-29T17:14:25.009521] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-29T17:14:25.133631] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T17:14:25.148115] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-29T17:14:25.461061] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:25.948088] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-29T17:14:26.233602] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:14:26.307351] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T17:14:26.311710] [INFO ] [REMOTE ] AOMR: Full fetch complete (23123 records). [2025-09-29T17:14:26.311797] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-29T17:14:26.745377] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-29T17:14:26.745478] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-29T17:14:26.745854] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-29T17:14:26.745922] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-29T17:14:26.746823] [DEBUG] [LOCAL ] AOMR: Trimmed 23123 records to 16553 (keeping 200 days of data) [2025-09-29T17:14:26.748106] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-29T17:14:26.855697] [DEBUG] [LOCAL ] AOMR: Primary data saved (16553 records). [2025-09-29T17:14:26.855856] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-29T17:14:26.855956] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOMR took 29.3s. Estimated remaining: 4h 23m 10s. Rate: 8.5 symbols/min [2025-09-29T17:14:27.050212] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:27.061574] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-29T17:14:27.061853] [INFO ] [MAIN ] AP: Loaded 7236 existing records. [2025-09-29T17:14:27.264899] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:27.265126] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-29T17:14:27.265339] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-29T17:14:27.265780] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-29T17:14:27.265875] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-29T17:14:27.462951] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T17:14:27.501067] [INFO ] [REMOTE ] AORT: Full fetch complete (41748 records). [2025-09-29T17:14:27.554752] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-29T17:14:27.554558] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-29T17:14:27.847789] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:28.117558] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-29T17:14:28.117660] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-29T17:14:28.118129] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-29T17:14:28.118173] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-29T17:14:28.119149] [DEBUG] [LOCAL ] AORT: Trimmed 41748 records to 29482 (keeping 200 days of data) [2025-09-29T17:14:28.299314] [DEBUG] [LOCAL ] AORT: Primary data saved (29482 records). [2025-09-29T17:14:28.299670] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-29T17:14:28.299781] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AORT took 28.1s. Estimated remaining: 4h 21m 21s. Rate: 8.6 symbols/min [2025-09-29T17:14:28.357475] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-29T17:14:28.494417] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:28.521633] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:14:28.567246] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-29T17:14:28.567662] [INFO ] [MAIN ] APAM: Loaded 36969 existing records. [2025-09-29T17:14:28.767428] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:28.767669] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-29T17:14:28.767748] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-29T17:14:28.768334] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-29T17:14:28.768395] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-29T17:14:29.143728] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T17:14:29.164242] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-29T17:14:29.169726] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:29.288230] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T17:14:29.948131] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-29T17:14:30.748116] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-29T17:14:30.836801] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T17:14:30.845993] [INFO ] [REMOTE ] AON: Full fetch complete (64865 records). [2025-09-29T17:14:30.846113] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-29T17:14:31.299693] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-29T17:14:31.299800] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-29T17:14:31.300551] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-29T17:14:31.300613] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-29T17:14:31.302183] [DEBUG] [LOCAL ] AON: Trimmed 64865 records to 45463 (keeping 200 days of data) [2025-09-29T17:14:31.373371] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T17:14:31.548705] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-29T17:14:31.611415] [DEBUG] [LOCAL ] AON: Primary data saved (45463 records). [2025-09-29T17:14:31.611598] [INFO ] [MAIN ] AON: Full history saved. [2025-09-29T17:14:31.611752] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 34.1s. Estimated remaining: 4h 20m 9s. Rate: 8.6 symbols/min [2025-09-29T17:14:31.772161] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T17:14:31.864123] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:31.918343] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-29T17:14:31.918733] [INFO ] [MAIN ] APD: Loaded 46087 existing records. [2025-09-29T17:14:32.121316] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:32.121788] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-29T17:14:32.121860] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-29T17:14:32.122507] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-29T17:14:32.122566] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-29T17:14:32.358418] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-29T17:14:32.525253] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:32.917817] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:14:33.148139] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-29T17:14:33.499364] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T17:14:33.817591] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:14:33.948104] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-29T17:14:34.748101] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-29T17:14:35.302778] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T17:14:35.548127] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-29T17:14:35.703510] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T17:14:36.348137] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-29T17:14:36.484188] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T17:14:36.933345] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T17:14:37.148142] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-29T17:14:37.948137] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-29T17:14:38.753179] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-29T17:14:38.766360] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T17:14:39.548126] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-29T17:14:39.728455] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T17:14:39.805746] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T17:14:40.348119] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-29T17:14:40.907488] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T17:14:41.148129] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-29T17:14:41.948127] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-29T17:14:42.075398] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T17:14:42.748155] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-29T17:14:42.817595] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T17:14:43.128855] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T17:14:43.548136] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-29T17:14:44.348272] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-29T17:14:44.459901] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:14:45.123935] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T17:14:45.148109] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-29T17:14:45.204899] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T17:14:45.948194] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-29T17:14:46.602483] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T17:14:46.667490] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T17:14:46.748123] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-29T17:14:47.548154] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-29T17:14:47.565519] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T17:14:47.567735] [INFO ] [REMOTE ] AP: Full fetch complete (8910 records). [2025-09-29T17:14:47.567930] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-29T17:14:47.979555] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-29T17:14:47.979639] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-29T17:14:47.979924] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-29T17:14:47.979971] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-29T17:14:47.980915] [DEBUG] [LOCAL ] AP: Trimmed 8910 records to 7191 (keeping 200 days of data) [2025-09-29T17:14:48.025554] [DEBUG] [LOCAL ] AP: Primary data saved (7191 records). [2025-09-29T17:14:48.025716] [INFO ] [MAIN ] AP: Full history saved. [2025-09-29T17:14:48.025835] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 21.2s. Estimated remaining: 4h 22m 50s. Rate: 8.5 symbols/min [2025-09-29T17:14:48.206979] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:48.274596] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-29T17:14:48.274954] [INFO ] [MAIN ] APG: Loaded 50931 existing records. [2025-09-29T17:14:48.353235] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-29T17:14:48.476438] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:48.476674] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-29T17:14:48.476735] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-29T17:14:48.477417] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-29T17:14:48.477478] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-29T17:14:48.857787] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:49.148087] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-29T17:14:49.245728] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:14:49.955749] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-29T17:14:49.976207] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T17:14:50.579617] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T17:14:50.748151] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-29T17:14:51.548114] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-29T17:14:51.689980] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T17:14:51.997583] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:14:52.348107] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-29T17:14:53.129763] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T17:14:53.148076] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-29T17:14:53.948088] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-29T17:14:54.137634] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T17:14:54.748098] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-29T17:14:54.789591] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T17:14:55.297580] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:14:55.307477] [INFO ] [REMOTE ] AOS: Full fetch complete (70582 records). [2025-09-29T17:14:55.307630] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-29T17:14:55.558180] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-29T17:14:55.734729] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-29T17:14:55.734829] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-29T17:14:55.735626] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-29T17:14:55.735709] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-29T17:14:55.737122] [DEBUG] [LOCAL ] AOS: Trimmed 70582 records to 48890 (keeping 200 days of data) [2025-09-29T17:14:56.053817] [DEBUG] [LOCAL ] AOS: Primary data saved (48890 records). [2025-09-29T17:14:56.053984] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-29T17:14:56.054082] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 31.5s. Estimated remaining: 4h 23m 1s. Rate: 8.5 symbols/min [2025-09-29T17:14:56.231988] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:56.296252] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-29T17:14:56.296670] [INFO ] [MAIN ] APH: Loaded 54471 existing records. [2025-09-29T17:14:56.370821] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-29T17:14:56.434578] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:14:56.529253] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:56.529563] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-29T17:14:56.529618] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-29T17:14:56.531669] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-29T17:14:56.531737] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-29T17:14:56.900018] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:57.141528] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T17:14:57.151737] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-29T17:14:57.948074] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-29T17:14:58.058253] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T17:14:58.748126] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-29T17:14:59.250436] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T17:14:59.548084] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-29T17:14:59.643598] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:14:59.705172] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T17:15:00.348148] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-29T17:15:01.148158] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-29T17:15:01.569453] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T17:15:01.948161] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-29T17:15:02.097408] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T17:15:02.708282] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T17:15:02.714968] [INFO ] [REMOTE ] APAM: Full fetch complete (51404 records). [2025-09-29T17:15:02.715079] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-29T17:15:02.715721] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:15:02.715809] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:15:02.715853] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:15:02.715893] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-29T17:15:02.715992] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-29T17:15:02.716047] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-09-29T17:15:02.717289] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-09-29T17:15:02.719627] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 34.4s. Estimated remaining: 4h 22m 48s. Rate: 8.5 symbols/min [2025-09-29T17:15:02.752027] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-29T17:15:02.903871] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:02.968574] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-29T17:15:02.968967] [INFO ] [MAIN ] APLE: Loaded 52769 existing records. [2025-09-29T17:15:03.154884] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:03.155094] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-29T17:15:03.155146] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-29T17:15:03.156061] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-29T17:15:03.156121] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-29T17:15:03.536715] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:03.548069] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-29T17:15:03.744767] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:15:04.348088] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-29T17:15:04.616847] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:15:05.148135] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-29T17:15:05.266833] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:15:05.948109] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-29T17:15:06.165032] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T17:15:06.746082] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:15:06.755843] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-29T17:15:07.548079] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-29T17:15:07.655806] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:15:08.348141] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-29T17:15:08.624450] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T17:15:08.812964] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T17:15:08.821819] [INFO ] [REMOTE ] APD: Full fetch complete (66288 records). [2025-09-29T17:15:08.821981] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-29T17:15:08.822856] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:15:08.822958] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:15:08.823001] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:15:08.823066] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-29T17:15:08.823133] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-29T17:15:08.823170] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-09-29T17:15:08.823997] [DEBUG] [LOCAL ] APD: Deleted derivative data file. [2025-09-29T17:15:08.824106] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 37.2s. Estimated remaining: 4h 22m 24s. Rate: 8.5 symbols/min [2025-09-29T17:15:09.002762] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:09.072407] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-29T17:15:09.072795] [INFO ] [MAIN ] APO: Loaded 54162 existing records. [2025-09-29T17:15:09.153295] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-29T17:15:09.260332] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:09.260550] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-29T17:15:09.260598] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-29T17:15:09.261509] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-29T17:15:09.261572] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-29T17:15:09.646723] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:09.948106] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-29T17:15:10.024447] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T17:15:10.748171] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-29T17:15:11.542182] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-29T17:15:11.557729] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-29T17:15:11.686704] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T17:15:12.348075] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-29T17:15:12.392501] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T17:15:13.148075] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-29T17:15:13.552194] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-29T17:15:13.948126] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-29T17:15:14.132959] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:15:14.748147] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-29T17:15:15.167287] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T17:15:15.548148] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-29T17:15:16.199795] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-29T17:15:16.348092] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-29T17:15:16.451688] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:15:17.153243] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-29T17:15:17.172475] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T17:15:17.948119] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-29T17:15:18.194905] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T17:15:18.748174] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-29T17:15:19.031964] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T17:15:19.548099] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-29T17:15:19.765219] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:15:20.348132] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-29T17:15:20.718384] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T17:15:21.148144] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-29T17:15:21.322550] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T17:15:21.948138] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-29T17:15:22.238218] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T17:15:22.748099] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-29T17:15:22.850760] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T17:15:23.548116] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-29T17:15:23.894226] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T17:15:24.348174] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-29T17:15:24.831742] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-29T17:15:25.131318] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T17:15:25.148066] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-29T17:15:25.948149] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-29T17:15:26.065057] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:15:26.748105] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-29T17:15:26.918216] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T17:15:26.929010] [INFO ] [REMOTE ] APG: Full fetch complete (71272 records). [2025-09-29T17:15:26.929252] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-29T17:15:26.931119] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:15:26.931403] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:15:26.931479] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:15:26.931565] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-29T17:15:26.931669] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-29T17:15:26.931733] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-09-29T17:15:26.932307] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-09-29T17:15:26.932444] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 38.9s. Estimated remaining: 4h 25m 28s. Rate: 8.4 symbols/min [2025-09-29T17:15:27.110834] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:27.121776] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-29T17:15:27.122019] [INFO ] [MAIN ] APOS: Loaded 7568 existing records. [2025-09-29T17:15:27.305962] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:27.306231] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-29T17:15:27.306287] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-29T17:15:27.306724] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-29T17:15:27.306808] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-29T17:15:27.557074] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-29T17:15:27.721110] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:27.754855] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T17:15:28.348125] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-29T17:15:28.679354] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:15:28.856163] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-29T17:15:29.148179] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-29T17:15:29.809735] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-29T17:15:29.821289] [INFO ] [REMOTE ] APH: Full fetch complete (77683 records). [2025-09-29T17:15:29.821475] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-29T17:15:29.953285] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-29T17:15:30.253004] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-29T17:15:30.253104] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-29T17:15:30.253909] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-29T17:15:30.253981] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-29T17:15:30.255531] [DEBUG] [LOCAL ] APH: Trimmed 77683 records to 53691 (keeping 200 days of data) [2025-09-29T17:15:30.625600] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-09-29T17:15:30.631559] [INFO ] [MAIN ] APH: Full history saved. [2025-09-29T17:15:30.634586] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 34.6s. Estimated remaining: 4h 24m 23s. Rate: 8.5 symbols/min [2025-09-29T17:15:30.641150] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T17:15:30.753229] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-29T17:15:30.850946] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:30.885553] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:15:30.958994] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-29T17:15:30.959437] [INFO ] [MAIN ] APTV: Loaded 52964 existing records. [2025-09-29T17:15:31.172554] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:31.172851] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-29T17:15:31.172900] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-29T17:15:31.173859] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-29T17:15:31.173922] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-29T17:15:31.543478] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T17:15:31.558787] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-29T17:15:31.612433] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:32.348145] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-29T17:15:33.060078] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T17:15:33.148089] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-29T17:15:33.479471] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T17:15:33.490370] [INFO ] [REMOTE ] APLE: Full fetch complete (74272 records). [2025-09-29T17:15:33.490542] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-29T17:15:33.911738] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-29T17:15:33.911845] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-29T17:15:33.912601] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-29T17:15:33.912685] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-29T17:15:33.914242] [DEBUG] [LOCAL ] APLE: Trimmed 74272 records to 51976 (keeping 200 days of data) [2025-09-29T17:15:33.970143] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-29T17:15:34.262827] [DEBUG] [LOCAL ] APLE: Primary data saved (51976 records). [2025-09-29T17:15:34.263037] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-29T17:15:34.263938] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 31.5s. Estimated remaining: 4h 23m 18s. Rate: 8.5 symbols/min [2025-09-29T17:15:34.457437] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:34.521953] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-29T17:15:34.522343] [INFO ] [MAIN ] AQN: Loaded 52684 existing records. [2025-09-29T17:15:34.725777] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:34.725999] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-29T17:15:34.726060] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-29T17:15:34.728107] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-29T17:15:34.728254] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-29T17:15:34.753904] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-29T17:15:35.165316] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:35.198499] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T17:15:35.548109] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-29T17:15:35.765346] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:15:35.798267] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T17:15:36.348118] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-29T17:15:37.148141] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-29T17:15:37.327171] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T17:15:37.765567] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T17:15:37.891403] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T17:15:37.948189] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-29T17:15:38.748178] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-29T17:15:39.548132] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-29T17:15:40.023532] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:15:40.348144] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-29T17:15:40.382596] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:15:40.473401] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T17:15:41.148125] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-29T17:15:41.948179] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-29T17:15:42.402587] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T17:15:42.415576] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-09-29T17:15:42.415789] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-29T17:15:42.756828] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-29T17:15:42.942228] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-29T17:15:42.942347] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-29T17:15:42.943187] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-29T17:15:42.943267] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-29T17:15:42.961248] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 53382 (keeping 200 days of data) [2025-09-29T17:15:42.976971] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T17:15:43.348694] [DEBUG] [LOCAL ] APO: Primary data saved (53382 records). [2025-09-29T17:15:43.348965] [INFO ] [MAIN ] APO: Full history saved. [2025-09-29T17:15:43.349173] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APO took 34.5s. Estimated remaining: 4h 23m 45s. Rate: 8.5 symbols/min [2025-09-29T17:15:43.532154] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T17:15:43.563328] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:43.563421] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-29T17:15:43.573591] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-29T17:15:43.573919] [INFO ] [MAIN ] AQNB: Loaded 4228 existing records. [2025-09-29T17:15:43.790128] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:43.790512] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-29T17:15:43.790610] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-29T17:15:43.791365] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-29T17:15:43.791433] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-29T17:15:43.917462] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T17:15:44.234813] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:44.348131] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-29T17:15:45.089541] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T17:15:45.151438] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-29T17:15:45.157922] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T17:15:45.786507] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T17:15:45.948162] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-29T17:15:46.748130] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-29T17:15:47.548109] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-29T17:15:47.820318] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T17:15:48.348130] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-29T17:15:48.455155] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T17:15:48.458201] [INFO ] [REMOTE ] APOS: Full fetch complete (10420 records). [2025-09-29T17:15:48.458371] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-29T17:15:48.811867] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:15:48.909393] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-29T17:15:48.909479] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-29T17:15:48.909736] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-29T17:15:48.909813] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-29T17:15:48.910342] [DEBUG] [LOCAL ] APOS: Trimmed 10420 records to 7514 (keeping 200 days of data) [2025-09-29T17:15:48.958143] [DEBUG] [LOCAL ] APOS: Primary data saved (7514 records). [2025-09-29T17:15:48.958319] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-29T17:15:48.958451] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APOS took 22.0s. Estimated remaining: 4h 23m 13s. Rate: 8.5 symbols/min [2025-09-29T17:15:49.135443] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:49.148133] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-29T17:15:49.199792] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-29T17:15:49.200239] [INFO ] [MAIN ] AR: Loaded 54364 existing records. [2025-09-29T17:15:49.388195] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:49.388443] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-29T17:15:49.388544] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-29T17:15:49.390035] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-29T17:15:49.390127] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-29T17:15:49.762958] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:49.948116] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-29T17:15:50.050573] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T17:15:50.638048] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T17:15:50.748123] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-29T17:15:51.548130] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-29T17:15:51.698750] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:15:52.348108] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-29T17:15:52.497903] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T17:15:53.148129] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-29T17:15:53.193681] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:15:53.690349] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-29T17:15:53.948101] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-29T17:15:54.048614] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:15:54.748121] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-29T17:15:55.275689] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-29T17:15:55.548113] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-29T17:15:55.633756] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:15:55.947997] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-29T17:15:56.348130] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-29T17:15:57.148107] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-29T17:15:57.752467] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T17:15:57.948097] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-29T17:15:58.053780] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T17:15:58.564951] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T17:15:58.748143] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-29T17:15:59.447383] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:15:59.548127] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-29T17:16:00.348140] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-29T17:16:01.148134] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-29T17:16:01.424962] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T17:16:01.948188] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-29T17:16:02.367520] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-29T17:16:02.412332] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T17:16:02.423419] [INFO ] [REMOTE ] APTV: Full fetch complete (75991 records). [2025-09-29T17:16:02.423595] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-29T17:16:02.751537] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-29T17:16:02.874539] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-29T17:16:02.874816] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-29T17:16:02.875814] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-29T17:16:02.875950] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-29T17:16:02.877885] [DEBUG] [LOCAL ] APTV: Trimmed 75991 records to 52148 (keeping 200 days of data) [2025-09-29T17:16:03.038131] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:16:03.261389] [DEBUG] [LOCAL ] APTV: Primary data saved (52148 records). [2025-09-29T17:16:03.261613] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-29T17:16:03.262887] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. APTV took 32.6s. Estimated remaining: 4h 25m 6s. Rate: 8.4 symbols/min [2025-09-29T17:16:03.372205] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T17:16:03.451107] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:03.506851] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-29T17:16:03.507318] [INFO ] [MAIN ] ARCO: Loaded 45249 existing records. [2025-09-29T17:16:03.553534] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-29T17:16:03.704842] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:03.705175] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-29T17:16:03.705239] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-29T17:16:03.709069] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-29T17:16:03.709136] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-29T17:16:04.076227] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:04.348167] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-29T17:16:05.072106] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T17:16:05.073518] [INFO ] [REMOTE ] AQNB: Full fetch complete (5886 records). [2025-09-29T17:16:05.073597] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-29T17:16:05.148855] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-29T17:16:05.262580] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:16:05.503599] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-29T17:16:05.503719] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-29T17:16:05.503937] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-29T17:16:05.503982] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-29T17:16:05.504439] [DEBUG] [LOCAL ] AQNB: Trimmed 5886 records to 4142 (keeping 200 days of data) [2025-09-29T17:16:05.535299] [DEBUG] [LOCAL ] AQNB: Primary data saved (4142 records). [2025-09-29T17:16:05.535472] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-29T17:16:05.535584] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. AQNB took 22.2s. Estimated remaining: 4h 23m 39s. Rate: 8.5 symbols/min [2025-09-29T17:16:05.718002] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:05.738093] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-29T17:16:05.738432] [INFO ] [MAIN ] ARDC: Loaded 14821 existing records. [2025-09-29T17:16:05.961754] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:05.955193] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-29T17:16:05.962511] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-29T17:16:05.963366] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-29T17:16:05.963708] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-29T17:16:05.963771] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-29T17:16:06.340774] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:06.748168] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-29T17:16:07.023433] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T17:16:07.355073] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T17:16:07.548104] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-29T17:16:07.715472] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T17:16:08.136278] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T17:16:08.348224] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-29T17:16:09.148164] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-29T17:16:09.965128] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-29T17:16:09.969110] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T17:16:10.748102] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-29T17:16:10.831481] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T17:16:11.548112] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-29T17:16:11.868283] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T17:16:12.353458] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-29T17:16:12.373317] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:16:12.564444] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T17:16:13.148149] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-29T17:16:13.948094] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-29T17:16:14.138471] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T17:16:14.459401] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-29T17:16:14.469525] [INFO ] [REMOTE ] AQN: Full fetch complete (74900 records). [2025-09-29T17:16:14.469719] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-29T17:16:14.470574] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:16:14.470713] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:16:14.470806] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:16:14.470881] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-29T17:16:14.470950] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-09-29T17:16:14.470989] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-09-29T17:16:14.471757] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-09-29T17:16:14.472566] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 40.2s. Estimated remaining: 4h 24m 3s. Rate: 8.5 symbols/min [2025-09-29T17:16:14.656454] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:14.693418] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-29T17:16:14.693746] [INFO ] [MAIN ] ARDT: Loaded 28513 existing records. [2025-09-29T17:16:14.759233] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-29T17:16:14.883567] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:14.883792] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-29T17:16:14.883841] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-29T17:16:14.884141] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-29T17:16:14.884198] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-29T17:16:15.269188] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:15.464044] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:16:15.548103] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-29T17:16:15.817579] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T17:16:16.348128] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-29T17:16:17.148079] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-29T17:16:17.267051] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T17:16:17.948096] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-29T17:16:18.033487] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T17:16:18.128946] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T17:16:18.748160] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-29T17:16:19.548139] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-29T17:16:19.703115] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:16:20.348125] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-29T17:16:20.514085] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T17:16:20.725302] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T17:16:21.148155] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-29T17:16:21.574698] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:16:21.948153] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-29T17:16:22.504512] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T17:16:22.748119] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-29T17:16:23.467768] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T17:16:23.497771] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T17:16:23.548140] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-29T17:16:24.348132] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-29T17:16:24.415227] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T17:16:25.148141] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-29T17:16:25.707363] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:16:25.948122] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-29T17:16:26.748103] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-29T17:16:27.170150] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T17:16:27.181589] [INFO ] [REMOTE ] AR: Full fetch complete (77532 records). [2025-09-29T17:16:27.181843] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-29T17:16:27.562054] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-29T17:16:27.642726] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-29T17:16:27.644803] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:16:27.644984] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-29T17:16:27.659210] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-29T17:16:27.659671] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-29T17:16:27.662477] [DEBUG] [LOCAL ] AR: Trimmed 77532 records to 53584 (keeping 200 days of data) [2025-09-29T17:16:28.000759] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T17:16:28.028410] [DEBUG] [LOCAL ] AR: Primary data saved (53584 records). [2025-09-29T17:16:28.028571] [INFO ] [MAIN ] AR: Full history saved. [2025-09-29T17:16:28.028685] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 39.1s. Estimated remaining: 4h 25m 40s. Rate: 8.4 symbols/min [2025-09-29T17:16:28.221541] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:28.278014] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-29T17:16:28.278441] [INFO ] [MAIN ] ARE: Loaded 51319 existing records. [2025-09-29T17:16:28.353330] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-29T17:16:28.483077] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:28.483324] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-29T17:16:28.483373] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-29T17:16:28.483888] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-29T17:16:28.483950] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-29T17:16:28.861255] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:28.909832] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T17:16:29.148148] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-29T17:16:29.574352] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T17:16:29.948183] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-29T17:16:30.748205] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-29T17:16:30.820671] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T17:16:31.392635] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:16:31.548170] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-29T17:16:31.634606] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T17:16:32.348119] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-29T17:16:33.148083] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-29T17:16:33.278530] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T17:16:33.722809] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T17:16:33.948151] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-29T17:16:34.748136] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-29T17:16:34.937924] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T17:16:35.548093] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-29T17:16:35.963359] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-29T17:16:36.348138] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-29T17:16:36.393875] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T17:16:36.397713] [INFO ] [REMOTE ] ARDC: Full fetch complete (20511 records). [2025-09-29T17:16:36.397801] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-29T17:16:36.803186] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-29T17:16:36.803374] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-29T17:16:36.803909] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-29T17:16:36.804028] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-29T17:16:36.805138] [DEBUG] [LOCAL ] ARDC: Trimmed 20511 records to 14689 (keeping 200 days of data) [2025-09-29T17:16:36.900840] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T17:16:36.932726] [DEBUG] [LOCAL ] ARDC: Primary data saved (14689 records). [2025-09-29T17:16:36.932891] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-29T17:16:36.932982] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 31.4s. Estimated remaining: 4h 26m 1s. Rate: 8.4 symbols/min [2025-09-29T17:16:37.116298] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:37.151881] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-29T17:16:37.176876] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-29T17:16:37.177268] [INFO ] [MAIN ] ARES: Loaded 50322 existing records. [2025-09-29T17:16:37.377842] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:37.378101] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-29T17:16:37.378174] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-29T17:16:37.381409] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-29T17:16:37.381477] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-29T17:16:37.774550] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:37.948141] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-29T17:16:37.998915] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T17:16:38.748180] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-29T17:16:38.902112] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:16:39.208269] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T17:16:39.213778] [INFO ] [REMOTE ] ARDT: Full fetch complete (41125 records). [2025-09-29T17:16:39.213908] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-29T17:16:39.214532] [FATAL] [VALIDATOR ] ARDT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:16:39.214622] [FATAL] [MAIN ] ARDT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:16:39.214711] [WARN ] [MAIN ] ARDT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:16:39.214787] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-29T17:16:39.214890] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-29T17:16:39.214948] [INFO ] [LOCAL ] ARDT: Starting deletion of derivative data. [2025-09-29T17:16:39.215294] [DEBUG] [LOCAL ] ARDT: Deleted derivative data file. [2025-09-29T17:16:39.215392] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARDT took 24.7s. Estimated remaining: 4h 24m 37s. Rate: 8.4 symbols/min [2025-09-29T17:16:39.403045] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:39.454624] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-29T17:16:39.454977] [INFO ] [MAIN ] ARI: Loaded 44009 existing records. [2025-09-29T17:16:39.557354] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-29T17:16:39.678281] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:39.678519] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-29T17:16:39.678569] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-29T17:16:39.681433] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-29T17:16:39.681502] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-29T17:16:40.109967] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:40.348134] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-29T17:16:40.501133] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:16:41.148118] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-29T17:16:41.615540] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:16:41.952194] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-29T17:16:42.081751] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T17:16:42.748090] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-29T17:16:42.846860] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:16:43.505578] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T17:16:43.514808] [INFO ] [REMOTE ] ARCO: Full fetch complete (65627 records). [2025-09-29T17:16:43.515021] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-29T17:16:43.553265] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-29T17:16:43.940364] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-29T17:16:43.940469] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-29T17:16:43.941155] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-29T17:16:43.941220] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-29T17:16:43.942569] [DEBUG] [LOCAL ] ARCO: Trimmed 65627 records to 44534 (keeping 200 days of data) [2025-09-29T17:16:44.233044] [DEBUG] [LOCAL ] ARCO: Primary data saved (44534 records). [2025-09-29T17:16:44.233222] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-29T17:16:44.233347] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARCO took 41.0s. Estimated remaining: 4h 23m 56s. Rate: 8.4 symbols/min [2025-09-29T17:16:44.353473] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-29T17:16:44.471382] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:44.496906] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T17:16:44.548832] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-29T17:16:44.549165] [INFO ] [MAIN ] ARIS: Loaded 42624 existing records. [2025-09-29T17:16:44.735681] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:44.735887] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-29T17:16:44.735936] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-29T17:16:44.736430] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-29T17:16:44.736491] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-29T17:16:45.127131] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:45.148073] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-29T17:16:45.337014] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:16:45.948114] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-29T17:16:46.388230] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T17:16:46.436908] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:16:46.748110] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-29T17:16:47.402002] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T17:16:47.548123] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-29T17:16:48.348172] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-29T17:16:48.650007] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:16:49.077354] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:16:49.148131] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-29T17:16:49.655853] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T17:16:49.948116] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-29T17:16:50.748102] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-29T17:16:50.802547] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T17:16:51.548092] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-29T17:16:51.722813] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T17:16:52.348094] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-29T17:16:52.657401] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T17:16:53.148133] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-29T17:16:53.419414] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T17:16:53.901958] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T17:16:53.948106] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-29T17:16:54.721066] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T17:16:54.748114] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-29T17:16:55.475618] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T17:16:55.548030] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-29T17:16:56.348099] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-29T17:16:56.377007] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T17:16:57.148092] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-29T17:16:57.328404] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T17:16:57.953202] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-29T17:16:57.968416] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:16:58.441408] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T17:16:58.748138] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-29T17:16:59.548152] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-29T17:16:59.696555] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:17:00.334182] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T17:17:00.348072] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-29T17:17:01.050190] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T17:17:01.148148] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-29T17:17:01.825988] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:17:01.948167] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-29T17:17:02.711874] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T17:17:02.748120] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-29T17:17:03.548112] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-29T17:17:03.874228] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:17:04.345399] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T17:17:04.354917] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-29T17:17:04.357501] [INFO ] [REMOTE ] ARE: Full fetch complete (72593 records). [2025-09-29T17:17:04.357772] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-29T17:17:04.786142] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-29T17:17:04.786272] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-29T17:17:04.787187] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-29T17:17:04.787340] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-29T17:17:04.791377] [DEBUG] [LOCAL ] ARE: Trimmed 72593 records to 50593 (keeping 200 days of data) [2025-09-29T17:17:04.917451] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T17:17:05.148196] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-29T17:17:05.157942] [DEBUG] [LOCAL ] ARE: Primary data saved (50593 records). [2025-09-29T17:17:05.158101] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-29T17:17:05.158204] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARE took 37.1s. Estimated remaining: 4h 27m 26s. Rate: 8.3 symbols/min [2025-09-29T17:17:05.346373] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:05.397987] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-29T17:17:05.398309] [INFO ] [MAIN ] ARLO: Loaded 44493 existing records. [2025-09-29T17:17:05.590558] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:05.590844] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-29T17:17:05.590909] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-29T17:17:05.594082] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-29T17:17:05.594156] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-29T17:17:05.950965] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-29T17:17:05.975765] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:06.337086] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:17:06.348235] [INFO ] [REMOTE ] ARI: Full fetch complete (62687 records). [2025-09-29T17:17:06.348395] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-29T17:17:06.754659] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-29T17:17:06.827939] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-29T17:17:06.824247] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T17:17:06.838095] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-29T17:17:06.839454] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-29T17:17:06.839959] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-29T17:17:06.841450] [DEBUG] [LOCAL ] ARI: Trimmed 62687 records to 43363 (keeping 200 days of data) [2025-09-29T17:17:07.116823] [DEBUG] [LOCAL ] ARI: Primary data saved (43363 records). [2025-09-29T17:17:07.116962] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-29T17:17:07.118315] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARI took 27.9s. Estimated remaining: 4h 25m 57s. Rate: 8.4 symbols/min [2025-09-29T17:17:07.296534] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:07.355926] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-29T17:17:07.356397] [INFO ] [MAIN ] ARMK: Loaded 51112 existing records. [2025-09-29T17:17:07.560544] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:07.560979] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-29T17:17:07.556545] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-29T17:17:07.562063] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-29T17:17:07.567209] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-29T17:17:07.567306] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-29T17:17:07.924367] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T17:17:07.997338] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:08.354611] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-29T17:17:08.360130] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:17:09.148143] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-29T17:17:09.276810] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:17:09.285847] [INFO ] [REMOTE ] ARIS: Full fetch complete (59830 records). [2025-09-29T17:17:09.286062] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-29T17:17:09.286872] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:17:09.286963] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:17:09.287010] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:17:09.287054] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-29T17:17:09.287114] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-29T17:17:09.287154] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-09-29T17:17:09.287598] [DEBUG] [LOCAL ] ARIS: Deleted derivative data file. [2025-09-29T17:17:09.288852] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARIS took 25.1s. Estimated remaining: 4h 24m 33s. Rate: 8.4 symbols/min [2025-09-29T17:17:09.474616] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:09.531133] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-29T17:17:09.531500] [INFO ] [MAIN ] AROC: Loaded 49733 existing records. [2025-09-29T17:17:09.719142] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:09.719436] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-29T17:17:09.719490] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-29T17:17:09.725142] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-29T17:17:09.725210] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-29T17:17:09.967358] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-29T17:17:10.088254] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:10.349704] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T17:17:10.360932] [INFO ] [REMOTE ] ARES: Full fetch complete (70673 records). [2025-09-29T17:17:10.361106] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-29T17:17:10.757535] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-29T17:17:10.800886] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-29T17:17:10.801083] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-29T17:17:10.801982] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-29T17:17:10.802075] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-29T17:17:10.828730] [DEBUG] [LOCAL ] ARES: Trimmed 70673 records to 49525 (keeping 200 days of data) [2025-09-29T17:17:10.829901] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T17:17:11.177701] [DEBUG] [LOCAL ] ARES: Primary data saved (49525 records). [2025-09-29T17:17:11.177860] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-29T17:17:11.177949] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARES took 34.2s. Estimated remaining: 4h 23m 5s. Rate: 8.5 symbols/min [2025-09-29T17:17:11.364396] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:11.440417] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-29T17:17:11.440822] [INFO ] [MAIN ] ARR: Loaded 52809 existing records. [2025-09-29T17:17:11.552799] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-29T17:17:11.646124] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:11.646491] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-29T17:17:11.646606] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-29T17:17:11.654304] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-29T17:17:11.654400] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-29T17:17:11.890774] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:17:12.099040] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:12.348142] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-29T17:17:12.515398] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T17:17:12.969441] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:17:13.148136] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-29T17:17:13.689584] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T17:17:13.948108] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-29T17:17:14.748115] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-29T17:17:14.858623] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:17:15.548191] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-29T17:17:15.736171] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T17:17:16.348113] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-29T17:17:17.124386] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-29T17:17:17.148076] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-29T17:17:17.216336] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T17:17:17.955030] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-29T17:17:17.957904] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T17:17:18.748074] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-29T17:17:18.933720] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:17:19.548094] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-29T17:17:19.749607] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T17:17:20.081080] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T17:17:20.348117] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-29T17:17:21.023606] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T17:17:21.148136] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-29T17:17:21.805459] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T17:17:21.948143] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-29T17:17:22.748113] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-29T17:17:22.921567] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:17:22.996670] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:17:23.548134] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-29T17:17:24.348139] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-29T17:17:24.692490] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T17:17:25.148144] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-29T17:17:25.376284] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:17:25.473908] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T17:17:25.948162] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-29T17:17:26.647341] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T17:17:26.748125] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-29T17:17:27.548154] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-29T17:17:27.810668] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T17:17:28.321339] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T17:17:28.348077] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-29T17:17:29.148112] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-29T17:17:29.184008] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T17:17:29.738547] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T17:17:29.948126] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-29T17:17:30.748142] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-29T17:17:30.808285] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T17:17:31.313477] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T17:17:31.548124] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-29T17:17:32.348120] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-29T17:17:32.739529] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T17:17:33.148169] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-29T17:17:33.252087] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T17:17:33.261389] [INFO ] [REMOTE ] ARLO: Full fetch complete (62238 records). [2025-09-29T17:17:33.261580] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-29T17:17:33.262289] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:17:33.262382] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:17:33.262427] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:17:33.262512] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-29T17:17:33.262582] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-09-29T17:17:33.262621] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-09-29T17:17:33.263064] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-09-29T17:17:33.263182] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 28.1s. Estimated remaining: 4h 26m 47s. Rate: 8.3 symbols/min [2025-09-29T17:17:33.442123] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:33.480941] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-29T17:17:33.481246] [INFO ] [MAIN ] ARW: Loaded 33660 existing records. [2025-09-29T17:17:33.674742] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:33.675112] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-29T17:17:33.675191] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-29T17:17:33.678406] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-29T17:17:33.678477] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-29T17:17:33.952696] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-29T17:17:34.075747] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:34.107278] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:17:34.748091] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-29T17:17:35.080975] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:17:35.548132] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-29T17:17:35.763212] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:17:36.348109] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-29T17:17:36.673402] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T17:17:36.683849] [INFO ] [REMOTE ] ARMK: Full fetch complete (72177 records). [2025-09-29T17:17:36.684070] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-29T17:17:36.685623] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:17:36.685748] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:17:36.685794] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:17:36.685862] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-29T17:17:36.685941] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-29T17:17:36.685993] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-09-29T17:17:36.686844] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-09-29T17:17:36.687908] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 29.6s. Estimated remaining: 4h 25m 43s. Rate: 8.4 symbols/min [2025-09-29T17:17:36.890751] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:36.891162] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-29T17:17:36.891338] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-29T17:17:36.891670] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-29T17:17:36.891745] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-29T17:17:36.891836] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-29T17:17:36.891926] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-29T17:17:37.111750] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:17:37.154130] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-29T17:17:37.344383] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:37.948143] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-29T17:17:38.076630] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T17:17:38.174389] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:17:38.174732] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-29T17:17:38.174842] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:17:38.174892] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-29T17:17:38.174949] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:17:38.175027] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-29T17:17:38.175111] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-29T17:17:38.175168] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-29T17:17:38.175211] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-29T17:17:38.175259] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 1.5s. Estimated remaining: 4h 24m 10s. Rate: 8.4 symbols/min [2025-09-29T17:17:38.372193] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:38.437782] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-29T17:17:38.438159] [INFO ] [MAIN ] AS: Loaded 53854 existing records. [2025-09-29T17:17:38.629420] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:38.629669] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-29T17:17:38.629749] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-29T17:17:38.642960] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-29T17:17:38.660716] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-29T17:17:38.708580] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T17:17:38.757107] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-29T17:17:39.096140] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:39.548162] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-29T17:17:40.348165] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-29T17:17:40.828555] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T17:17:40.924492] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T17:17:41.148161] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-29T17:17:41.852020] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T17:17:41.948092] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-29T17:17:42.748125] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-29T17:17:43.116448] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T17:17:43.548105] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-29T17:17:43.646174] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:17:44.348128] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-29T17:17:44.721035] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T17:17:44.731166] [INFO ] [REMOTE ] AROC: Full fetch complete (70354 records). [2025-09-29T17:17:44.731343] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-29T17:17:44.732251] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:17:44.732388] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:17:44.732433] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:17:44.732483] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-29T17:17:44.732578] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-29T17:17:44.732678] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-09-29T17:17:44.733523] [DEBUG] [LOCAL ] AROC: Deleted derivative data file. [2025-09-29T17:17:44.734691] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. AROC took 35.4s. Estimated remaining: 4h 23m 55s. Rate: 8.4 symbols/min [2025-09-29T17:17:44.912882] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:44.938982] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-29T17:17:44.939228] [INFO ] [MAIN ] ASA: Loaded 14109 existing records. [2025-09-29T17:17:45.131906] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:45.132126] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-29T17:17:45.132176] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-29T17:17:45.132479] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-29T17:17:45.132540] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-29T17:17:45.165816] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-29T17:17:45.599624] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:45.737839] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-29T17:17:45.753135] [INFO ] [REMOTE ] ARR: Full fetch complete (75155 records). [2025-09-29T17:17:45.753367] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-29T17:17:45.950055] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-29T17:17:46.212050] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-29T17:17:46.212222] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-29T17:17:46.213122] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-29T17:17:46.213207] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-29T17:17:46.242481] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:17:46.242620] [DEBUG] [LOCAL ] ARR: Trimmed 75155 records to 52025 (keeping 200 days of data) [2025-09-29T17:17:46.589949] [DEBUG] [LOCAL ] ARR: Primary data saved (52025 records). [2025-09-29T17:17:46.590093] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-29T17:17:46.590179] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARR took 35.4s. Estimated remaining: 4h 22m 29s. Rate: 8.5 symbols/min [2025-09-29T17:17:46.758465] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-29T17:17:46.796826] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:46.818766] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:17:46.886143] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-29T17:17:46.886476] [INFO ] [MAIN ] ASAN: Loaded 53512 existing records. [2025-09-29T17:17:47.020264] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T17:17:47.106526] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:47.106785] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-29T17:17:47.106836] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-29T17:17:47.111734] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-29T17:17:47.111827] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-29T17:17:47.475907] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:47.548111] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-29T17:17:48.348097] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-29T17:17:48.538993] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T17:17:49.148098] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-29T17:17:49.179722] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T17:17:49.774140] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T17:17:49.948109] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-29T17:17:50.748115] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-29T17:17:50.866854] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T17:17:51.548127] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-29T17:17:51.783750] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T17:17:51.816675] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T17:17:52.348127] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-29T17:17:53.135334] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:17:53.143921] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T17:17:53.148175] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-29T17:17:53.948113] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-29T17:17:54.758518] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-29T17:17:54.763850] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T17:17:55.548084] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-29T17:17:55.662957] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T17:17:56.348187] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-29T17:17:56.707999] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-29T17:17:56.724300] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T17:17:57.148123] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-29T17:17:57.893540] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T17:17:57.948142] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-29T17:17:58.204973] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T17:17:58.748114] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-29T17:17:59.285176] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T17:17:59.548115] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-29T17:18:00.348149] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-29T17:18:00.516874] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:18:01.148126] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-29T17:18:01.297118] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T17:18:01.782222] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T17:18:01.886824] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T17:18:01.948130] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-29T17:18:02.748091] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-29T17:18:02.903465] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T17:18:03.548162] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-29T17:18:04.184755] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T17:18:04.348132] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-29T17:18:04.529612] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T17:18:05.148124] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-29T17:18:05.698586] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T17:18:05.948135] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-29T17:18:06.757343] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-29T17:18:06.785602] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T17:18:07.281818] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T17:18:07.548160] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-29T17:18:08.078522] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T17:18:08.085792] [INFO ] [REMOTE ] ARW: Full fetch complete (47844 records). [2025-09-29T17:18:08.085913] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-29T17:18:08.353310] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-29T17:18:08.492334] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-29T17:18:08.492466] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-29T17:18:08.493184] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-29T17:18:08.493362] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-29T17:18:08.494534] [DEBUG] [LOCAL ] ARW: Trimmed 47844 records to 33065 (keeping 200 days of data) [2025-09-29T17:18:08.604322] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T17:18:08.611832] [INFO ] [REMOTE ] ASA: Full fetch complete (18677 records). [2025-09-29T17:18:08.613548] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-29T17:18:09.049489] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-29T17:18:09.049873] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-29T17:18:09.051674] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-29T17:18:09.052508] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-29T17:18:09.060467] [DEBUG] [LOCAL ] ASA: Trimmed 18677 records to 14041 (keeping 200 days of data) [2025-09-29T17:18:09.152241] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-29T17:18:09.233117] [DEBUG] [LOCAL ] ASA: Primary data saved (14041 records). [2025-09-29T17:18:09.234479] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-29T17:18:09.235190] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ASA took 24.5s. Estimated remaining: 4h 26m 11s. Rate: 8.3 symbols/min [2025-09-29T17:18:09.422020] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:09.428904] [DEBUG] [LOCAL ] ARW: Primary data saved (33065 records). [2025-09-29T17:18:09.429091] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-29T17:18:09.429203] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ARW took 36.2s. Estimated remaining: 4h 24m 22s. Rate: 8.4 symbols/min [2025-09-29T17:18:09.643843] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:09.662595] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-29T17:18:09.663181] [INFO ] [MAIN ] ASB: Loaded 50299 existing records. [2025-09-29T17:18:09.710718] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-29T17:18:09.763245] [INFO ] [MAIN ] ASBA: Loaded 3458 existing records. [2025-09-29T17:18:09.996975] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:10.017919] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-29T17:18:10.043289] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-29T17:18:10.088970] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:10.089676] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-29T17:18:10.089825] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-29T17:18:10.090136] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-29T17:18:10.090221] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-29T17:18:10.104562] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-29T17:18:10.124726] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-29T17:18:10.935065] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:10.938902] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-29T17:18:10.938571] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:10.939906] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-29T17:18:10.977501] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-29T17:18:11.029485] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T17:18:11.548114] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-29T17:18:11.659852] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T17:18:12.348165] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-29T17:18:12.631002] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T17:18:13.016903] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T17:18:13.148152] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-29T17:18:13.531278] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:18:13.542435] [INFO ] [REMOTE ] AS: Full fetch complete (76132 records). [2025-09-29T17:18:13.542668] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-29T17:18:13.543942] [FATAL] [VALIDATOR ] AS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:18:13.544051] [FATAL] [MAIN ] AS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:18:13.544098] [WARN ] [MAIN ] AS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:18:13.544143] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-29T17:18:13.544220] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-29T17:18:13.544261] [INFO ] [LOCAL ] AS: Starting deletion of derivative data. [2025-09-29T17:18:13.544631] [DEBUG] [LOCAL ] AS: Deleted derivative data file. [2025-09-29T17:18:13.545961] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. AS took 35.4s. Estimated remaining: 4h 23m 30s. Rate: 8.4 symbols/min [2025-09-29T17:18:13.752181] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:13.799326] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-29T17:18:13.799694] [INFO ] [MAIN ] ASC: Loaded 38153 existing records. [2025-09-29T17:18:13.958409] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-29T17:18:14.006028] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:14.006269] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-29T17:18:14.006355] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-29T17:18:14.009070] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-29T17:18:14.009137] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-29T17:18:14.389088] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:14.418515] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T17:18:14.748104] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-29T17:18:15.391333] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-29T17:18:15.412601] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T17:18:15.548144] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-29T17:18:16.348121] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-29T17:18:17.022721] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-29T17:18:17.148076] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-29T17:18:17.414171] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T17:18:17.948139] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-29T17:18:18.748107] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-29T17:18:18.786423] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:18:19.465536] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T17:18:19.548112] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-29T17:18:19.903663] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T17:18:19.914381] [INFO ] [REMOTE ] ASAN: Full fetch complete (76152 records). [2025-09-29T17:18:19.914521] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-29T17:18:19.915389] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:18:19.915494] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:18:19.915539] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:18:19.915582] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-29T17:18:19.915670] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-29T17:18:19.915741] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-09-29T17:18:19.916044] [DEBUG] [LOCAL ] ASAN: Deleted derivative data file. [2025-09-29T17:18:19.916159] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 33.3s. Estimated remaining: 4h 23m 12s. Rate: 8.4 symbols/min [2025-09-29T17:18:20.104134] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:20.126497] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-29T17:18:20.126814] [INFO ] [MAIN ] ASG: Loaded 20695 existing records. [2025-09-29T17:18:20.316451] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:20.316720] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-29T17:18:20.316781] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-29T17:18:20.319336] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-29T17:18:20.319400] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-29T17:18:20.353270] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-29T17:18:20.715721] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:20.910957] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T17:18:20.914754] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:18:21.148159] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-29T17:18:21.948131] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-29T17:18:22.309883] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T17:18:22.748136] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-29T17:18:23.541848] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T17:18:23.556506] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-29T17:18:23.813888] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T17:18:24.348148] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-29T17:18:25.110949] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:18:25.148089] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-29T17:18:25.707799] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:18:25.948142] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-29T17:18:26.425883] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T17:18:26.748133] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-29T17:18:27.548129] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-29T17:18:27.904272] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T17:18:28.343529] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:18:28.351797] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-29T17:18:28.406069] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T17:18:29.148135] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-29T17:18:29.948124] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-29T17:18:29.994894] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T17:18:30.203155] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T17:18:30.748122] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-29T17:18:31.498789] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T17:18:31.548072] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-29T17:18:32.348138] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-29T17:18:32.429305] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T17:18:33.071601] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:18:33.148169] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-29T17:18:33.793876] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T17:18:33.948132] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-29T17:18:34.614381] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T17:18:34.748077] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-29T17:18:34.992046] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T17:18:35.548119] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-29T17:18:36.317743] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T17:18:36.348071] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-29T17:18:37.025419] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:18:37.148111] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-29T17:18:37.694639] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T17:18:37.948104] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-29T17:18:38.056264] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T17:18:38.067263] [INFO ] [REMOTE ] ASB: Full fetch complete (71597 records). [2025-09-29T17:18:38.067452] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-29T17:18:38.500311] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-29T17:18:38.500424] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-29T17:18:38.501197] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-29T17:18:38.501276] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-29T17:18:38.502808] [DEBUG] [LOCAL ] ASB: Trimmed 71597 records to 49512 (keeping 200 days of data) [2025-09-29T17:18:38.615144] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T17:18:38.619879] [INFO ] [REMOTE ] ASBA: Full fetch complete (5257 records). [2025-09-29T17:18:38.622677] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-29T17:18:38.783121] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-29T17:18:39.164779] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-29T17:18:39.165102] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-29T17:18:39.165797] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-29T17:18:39.166148] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-29T17:18:39.167426] [DEBUG] [LOCAL ] ASBA: Trimmed 5257 records to 3427 (keeping 200 days of data) [2025-09-29T17:18:39.198098] [DEBUG] [LOCAL ] ASBA: Primary data saved (3427 records). [2025-09-29T17:18:39.198225] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-29T17:18:39.198353] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASBA took 29.8s. Estimated remaining: 4h 25m 59s. Rate: 8.3 symbols/min [2025-09-29T17:18:39.443313] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:39.463076] [DEBUG] [LOCAL ] ASB: Primary data saved (49512 records). [2025-09-29T17:18:39.463289] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-29T17:18:39.464010] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 30.2s. Estimated remaining: 4h 24m 13s. Rate: 8.4 symbols/min [2025-09-29T17:18:39.554468] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-29T17:18:39.589143] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-29T17:18:39.595178] [INFO ] [MAIN ] ASGI: Loaded 22711 existing records. [2025-09-29T17:18:39.788267] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:39.879078] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:39.879593] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-29T17:18:39.879696] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-29T17:18:39.881019] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-29T17:18:39.881087] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-29T17:18:40.084413] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T17:18:40.083612] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-29T17:18:40.086529] [INFO ] [MAIN ] ASGN: Loaded 36554 existing records. [2025-09-29T17:18:40.355808] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-29T17:18:40.475307] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:40.480954] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-29T17:18:40.486193] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-29T17:18:40.522246] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-29T17:18:40.545791] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-29T17:18:40.549898] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:40.939556] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:41.098512] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T17:18:41.148112] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-29T17:18:41.358783] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:18:41.948146] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-29T17:18:42.322976] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T17:18:42.748154] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-29T17:18:43.494740] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T17:18:43.548131] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-29T17:18:43.894901] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T17:18:44.348117] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-29T17:18:44.790336] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T17:18:45.148096] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-29T17:18:45.403202] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T17:18:45.948132] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-29T17:18:46.371837] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T17:18:46.748130] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-29T17:18:46.928407] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T17:18:47.548107] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-29T17:18:47.811972] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T17:18:48.348104] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-29T17:18:48.842833] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T17:18:48.847396] [INFO ] [REMOTE ] ASG: Full fetch complete (31255 records). [2025-09-29T17:18:48.847514] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-29T17:18:48.848135] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:18:48.848253] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:18:48.848313] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:18:48.848392] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-29T17:18:48.848467] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-29T17:18:48.848516] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-09-29T17:18:48.848834] [DEBUG] [LOCAL ] ASG: Deleted derivative data file. [2025-09-29T17:18:48.848936] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASG took 28.9s. Estimated remaining: 4h 24m 38s. Rate: 8.4 symbols/min [2025-09-29T17:18:49.148107] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-29T17:18:49.346795] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-29T17:18:49.948107] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-29T17:18:50.602512] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T17:18:50.610458] [INFO ] [REMOTE ] ASC: Full fetch complete (56567 records). [2025-09-29T17:18:50.610680] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-29T17:18:50.611553] [FATAL] [VALIDATOR ] ASC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:18:50.611672] [FATAL] [MAIN ] ASC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:18:50.611731] [WARN ] [MAIN ] ASC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:18:50.611826] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-29T17:18:50.611894] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-09-29T17:18:50.611932] [INFO ] [LOCAL ] ASC: Starting deletion of derivative data. [2025-09-29T17:18:50.612135] [DEBUG] [LOCAL ] ASC: Deleted derivative data file. [2025-09-29T17:18:50.612583] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASC took 37.1s. Estimated remaining: 4h 23m 15s. Rate: 8.4 symbols/min [2025-09-29T17:18:50.748113] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-29T17:18:51.046790] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:18:51.507305] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T17:18:51.548086] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-29T17:18:52.348149] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-29T17:18:52.664120] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T17:18:53.148161] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-29T17:18:53.852971] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T17:18:53.948100] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-29T17:18:54.259559] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T17:18:54.748533] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-29T17:18:55.523520] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T17:18:55.548083] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-29T17:18:55.842213] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T17:18:56.348113] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-29T17:18:56.912018] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:18:57.148092] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-29T17:18:57.471839] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T17:18:57.948146] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-29T17:18:58.453066] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T17:18:58.748130] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-29T17:18:59.440353] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:18:59.446182] [INFO ] [REMOTE ] ASGI: Full fetch complete (33552 records). [2025-09-29T17:18:59.446309] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-29T17:18:59.879366] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-29T17:18:59.879475] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-29T17:18:59.880022] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-29T17:18:59.880088] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-29T17:18:59.881039] [DEBUG] [LOCAL ] ASGI: Trimmed 33552 records to 22549 (keeping 200 days of data) [2025-09-29T17:19:00.026867] [DEBUG] [LOCAL ] ASGI: Primary data saved (22549 records). [2025-09-29T17:19:00.027140] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-29T17:19:00.027296] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 20.8s. Estimated remaining: 4h 23m 39s. Rate: 8.4 symbols/min [2025-09-29T17:19:00.070555] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:19:00.084359] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-29T17:19:01.645895] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T17:19:01.655244] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-29T17:19:03.362522] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T17:19:03.370775] [INFO ] [REMOTE ] ASGN: Full fetch complete (52050 records). [2025-09-29T17:19:03.370931] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-29T17:19:03.780191] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-29T17:19:03.780274] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-29T17:19:03.780834] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-29T17:19:03.780896] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-29T17:19:03.781964] [DEBUG] [LOCAL ] ASGN: Trimmed 52050 records to 35955 (keeping 200 days of data) [2025-09-29T17:19:04.000317] [DEBUG] [LOCAL ] ASGN: Primary data saved (35955 records). [2025-09-29T17:19:04.000536] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-29T17:19:04.000635] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 24.5s. Estimated remaining: 4h 22m 48s. Rate: 8.4 symbols/min [2025-09-29T17:19:04.811240] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:04.794729] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:04.848049] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:04.867101] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:04.881506] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-29T17:19:04.881838] [INFO ] [MAIN ] ASR: Loaded 9381 existing records. [2025-09-29T17:19:05.038844] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-29T17:19:05.057755] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-29T17:19:05.068516] [INFO ] [MAIN ] ASH: Loaded 38339 existing records. [2025-09-29T17:19:05.101364] [INFO ] [MAIN ] ASIX: Loaded 22834 existing records. [2025-09-29T17:19:05.302422] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:05.342771] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-29T17:19:05.365070] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-29T17:19:05.376820] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-29T17:19:05.413293] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-29T17:19:05.440133] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-29T17:19:05.440374] [INFO ] [MAIN ] ASPN: Loaded 50293 existing records. [2025-09-29T17:19:05.732338] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:05.771285] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-29T17:19:05.801674] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:05.830942] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-29T17:19:05.850283] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-29T17:19:05.850608] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-29T17:19:05.857000] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-29T17:19:05.868299] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-29T17:19:05.856936] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-29T17:19:06.049374] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-29T17:19:06.189120] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:06.226591] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-29T17:19:06.284960] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-29T17:19:06.362343] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-29T17:19:06.418782] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-29T17:19:06.885976] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:06.948113] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-29T17:19:07.289294] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:07.303056] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:07.311195] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-29T17:19:07.332295] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-29T17:19:07.490106] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:07.490471] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-29T17:19:08.006248] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-29T17:19:08.008434] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-29T17:19:08.448040] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T17:19:08.451838] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-29T17:19:08.780234] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T17:19:08.782265] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-29T17:19:08.923539] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:19:08.930918] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-29T17:19:09.336312] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T17:19:09.347551] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-29T17:19:09.527888] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T17:19:09.532256] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-29T17:19:09.648122] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T17:19:09.650221] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-29T17:19:10.263733] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T17:19:10.267725] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-29T17:19:10.359577] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T17:19:10.373262] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T17:19:10.748164] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-29T17:19:10.950199] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T17:19:11.342200] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:19:11.548128] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-29T17:19:11.608304] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T17:19:12.348118] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-29T17:19:12.970563] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:19:13.148088] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-29T17:19:13.210843] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T17:19:13.948094] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-29T17:19:14.093938] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T17:19:14.748119] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-29T17:19:15.491484] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T17:19:15.518732] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T17:19:15.548088] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-29T17:19:16.304714] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T17:19:16.348130] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-29T17:19:17.148123] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-29T17:19:17.415122] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T17:19:17.948146] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-29T17:19:18.682420] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:19:18.748076] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-29T17:19:18.830410] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T17:19:19.548126] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-29T17:19:20.350684] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-29T17:19:20.354066] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T17:19:20.357302] [INFO ] [REMOTE ] ASR: Full fetch complete (12336 records). [2025-09-29T17:19:20.357430] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-29T17:19:20.358054] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:19:20.358167] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:19:20.358249] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:19:20.358327] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-29T17:19:20.358439] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-29T17:19:20.358520] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-09-29T17:19:20.358973] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-09-29T17:19:20.359100] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 16.4s. Estimated remaining: 4h 24m 48s. Rate: 8.3 symbols/min [2025-09-29T17:19:20.582054] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T17:19:20.605732] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:20.671925] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-29T17:19:20.672330] [INFO ] [MAIN ] ASX: Loaded 53639 existing records. [2025-09-29T17:19:20.874716] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:20.875317] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-29T17:19:20.875393] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-29T17:19:20.880090] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-29T17:19:20.880158] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-29T17:19:21.153274] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-29T17:19:21.254830] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:21.948188] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-29T17:19:22.240029] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:19:22.748136] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-29T17:19:22.788107] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T17:19:23.016389] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T17:19:23.548129] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-29T17:19:24.348086] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-29T17:19:24.505208] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T17:19:24.588229] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:19:25.148114] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-29T17:19:25.948163] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-29T17:19:26.249271] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:19:26.634192] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T17:19:26.748109] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-29T17:19:26.808867] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T17:19:27.548128] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-29T17:19:28.348124] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-29T17:19:28.990791] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-29T17:19:29.038149] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T17:19:29.148109] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-29T17:19:29.948112] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-29T17:19:30.019993] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:19:30.748135] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-29T17:19:30.954993] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T17:19:31.548128] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-29T17:19:31.585980] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:19:31.594510] [INFO ] [REMOTE ] ASH: Full fetch complete (54941 records). [2025-09-29T17:19:31.594778] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-29T17:19:31.989218] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-29T17:19:31.989315] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-29T17:19:31.989915] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-29T17:19:31.989980] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-29T17:19:31.991170] [DEBUG] [LOCAL ] ASH: Trimmed 54941 records to 37715 (keeping 200 days of data) [2025-09-29T17:19:32.230874] [DEBUG] [LOCAL ] ASH: Primary data saved (37715 records). [2025-09-29T17:19:32.231003] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-29T17:19:32.231098] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASH took 28.2s. Estimated remaining: 4h 25m 44s. Rate: 8.3 symbols/min [2025-09-29T17:19:32.353247] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-29T17:19:32.414977] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:32.463050] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-29T17:19:32.463447] [INFO ] [MAIN ] ATEN: Loaded 40398 existing records. [2025-09-29T17:19:32.665632] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T17:19:32.690911] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:32.695259] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-29T17:19:32.695459] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-29T17:19:32.696365] [INFO ] [REMOTE ] ASIX: Full fetch complete (29786 records). [2025-09-29T17:19:32.696557] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-29T17:19:32.697289] [FATAL] [VALIDATOR ] ASIX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:19:32.697440] [FATAL] [MAIN ] ASIX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:19:32.697590] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:19:32.714213] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-29T17:19:32.709018] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-29T17:19:32.724519] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-29T17:19:32.727452] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-09-29T17:19:32.724406] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-29T17:19:32.778545] [DEBUG] [LOCAL ] ASIX: Deleted derivative data file. [2025-09-29T17:19:32.805845] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T17:19:32.811303] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASIX took 28.8s. Estimated remaining: 4h 24m 7s. Rate: 8.4 symbols/min [2025-09-29T17:19:33.152547] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-29T17:19:33.350377] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:33.347165] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:33.394466] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-29T17:19:33.394831] [INFO ] [MAIN ] ATGE: Loaded 32251 existing records. [2025-09-29T17:19:33.580781] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:33.581074] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-29T17:19:33.581150] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-29T17:19:33.585690] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-29T17:19:33.585757] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-29T17:19:33.948607] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-29T17:19:33.952020] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:34.436468] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T17:19:34.748082] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-29T17:19:34.830276] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T17:19:35.535071] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T17:19:35.548079] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-29T17:19:36.348107] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-29T17:19:36.619630] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:19:37.005856] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T17:19:37.148113] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-29T17:19:37.851335] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T17:19:37.948120] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-29T17:19:38.543306] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T17:19:38.748127] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-29T17:19:39.548138] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-29T17:19:39.777071] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:19:40.251406] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:19:40.348115] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-29T17:19:41.148094] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-29T17:19:41.342016] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T17:19:41.948110] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-29T17:19:42.050490] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T17:19:42.568340] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T17:19:42.748126] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-29T17:19:43.548125] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-29T17:19:43.921252] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T17:19:43.931451] [INFO ] [REMOTE ] ASPN: Full fetch complete (72279 records). [2025-09-29T17:19:43.931621] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-29T17:19:44.341203] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-29T17:19:44.341385] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-29T17:19:44.342239] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-29T17:19:44.342327] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-29T17:19:44.344059] [DEBUG] [LOCAL ] ASPN: Trimmed 72279 records to 49585 (keeping 200 days of data) [2025-09-29T17:19:44.348106] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-29T17:19:44.499608] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T17:19:44.691958] [DEBUG] [LOCAL ] ASPN: Primary data saved (49585 records). [2025-09-29T17:19:44.692107] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-29T17:19:44.692210] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 40.6s. Estimated remaining: 4h 25m 3s. Rate: 8.3 symbols/min [2025-09-29T17:19:44.877248] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:44.916782] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-29T17:19:44.917102] [INFO ] [MAIN ] ATHM: Loaded 33015 existing records. [2025-09-29T17:19:45.051759] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:19:45.138401] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:45.138619] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-29T17:19:45.138720] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-29T17:19:45.143889] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-29T17:19:45.143955] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-29T17:19:45.155518] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-29T17:19:45.526352] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:45.948090] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-29T17:19:46.127738] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T17:19:46.748098] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-29T17:19:46.921722] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T17:19:47.133370] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T17:19:47.548125] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-29T17:19:48.348107] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-29T17:19:48.480779] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T17:19:48.935136] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T17:19:49.148125] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-29T17:19:49.948094] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-29T17:19:50.054783] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T17:19:50.539536] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T17:19:50.748111] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-29T17:19:50.986771] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:19:51.548107] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-29T17:19:52.280505] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T17:19:52.348125] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-29T17:19:53.105503] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T17:19:53.148110] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-29T17:19:53.776844] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T17:19:53.948140] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-29T17:19:54.333396] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:19:54.748174] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-29T17:19:55.329351] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:19:55.548128] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-29T17:19:56.348137] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-29T17:19:56.726891] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:19:56.738610] [INFO ] [REMOTE ] ASX: Full fetch complete (76591 records). [2025-09-29T17:19:56.738800] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-29T17:19:57.033089] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T17:19:57.153248] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-29T17:19:57.244259] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-29T17:19:57.244351] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-29T17:19:57.245357] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-29T17:19:57.245430] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-29T17:19:57.247158] [DEBUG] [LOCAL ] ASX: Trimmed 76591 records to 52837 (keeping 200 days of data) [2025-09-29T17:19:57.582954] [DEBUG] [LOCAL ] ASX: Primary data saved (52837 records). [2025-09-29T17:19:57.583113] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-29T17:19:57.583214] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 37.2s. Estimated remaining: 4h 26m 12s. Rate: 8.3 symbols/min [2025-09-29T17:19:57.761979] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:57.770482] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-29T17:19:57.770714] [INFO ] [MAIN ] ATHS: Loaded 7145 existing records. [2025-09-29T17:19:57.955068] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-29T17:19:57.960904] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:57.962478] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-29T17:19:57.962687] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-29T17:19:57.963274] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-29T17:19:57.963493] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-29T17:19:58.106267] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:19:58.407184] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:19:58.436916] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:58.748132] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-29T17:19:59.548153] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-29T17:19:59.686693] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T17:19:59.695045] [INFO ] [REMOTE ] ATEN: Full fetch complete (57392 records). [2025-09-29T17:19:59.695228] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-29T17:20:00.168954] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-29T17:20:00.169108] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-29T17:20:00.170800] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-29T17:20:00.170881] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-29T17:20:00.173199] [DEBUG] [LOCAL ] ATEN: Trimmed 57392 records to 39679 (keeping 200 days of data) [2025-09-29T17:20:00.301881] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T17:20:00.395981] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-29T17:20:00.470215] [DEBUG] [LOCAL ] ATEN: Primary data saved (39679 records). [2025-09-29T17:20:00.470377] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-29T17:20:00.470466] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATEN took 28.2s. Estimated remaining: 4h 25m 7s. Rate: 8.3 symbols/min [2025-09-29T17:20:00.652439] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:00.709582] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-29T17:20:00.710036] [INFO ] [MAIN ] ATI: Loaded 52283 existing records. [2025-09-29T17:20:00.906755] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:00.907111] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-29T17:20:00.907176] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-29T17:20:00.912831] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-29T17:20:00.913046] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-29T17:20:01.160710] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-29T17:20:01.297385] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T17:20:01.359241] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:01.876961] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:20:01.948196] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-29T17:20:02.152637] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T17:20:02.748166] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-29T17:20:03.308433] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T17:20:03.548142] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-29T17:20:04.348163] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-29T17:20:04.648711] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:20:05.023623] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T17:20:05.032385] [INFO ] [REMOTE ] ATGE: Full fetch complete (46261 records). [2025-09-29T17:20:05.032583] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-29T17:20:05.151576] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-29T17:20:05.469716] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T17:20:05.495875] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-29T17:20:05.496422] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-29T17:20:05.497570] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-29T17:20:05.497733] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-29T17:20:05.499485] [DEBUG] [LOCAL ] ATGE: Trimmed 46261 records to 31631 (keeping 200 days of data) [2025-09-29T17:20:05.740277] [DEBUG] [LOCAL ] ATGE: Primary data saved (31631 records). [2025-09-29T17:20:05.740525] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-29T17:20:05.740684] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATGE took 32.9s. Estimated remaining: 4h 24m 34s. Rate: 8.3 symbols/min [2025-09-29T17:20:05.889005] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T17:20:05.944867] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:05.948090] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-29T17:20:05.993593] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-29T17:20:05.994130] [INFO ] [MAIN ] ATKR: Loaded 36196 existing records. [2025-09-29T17:20:06.189136] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:06.189438] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-29T17:20:06.189494] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-29T17:20:06.192825] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-29T17:20:06.193080] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-29T17:20:06.550908] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:06.665545] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T17:20:06.748136] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-29T17:20:07.548179] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-29T17:20:07.586912] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T17:20:08.348155] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-29T17:20:09.078494] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-29T17:20:09.148132] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-29T17:20:09.262408] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:20:09.948142] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-29T17:20:10.410990] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T17:20:10.663871] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T17:20:10.748108] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-29T17:20:11.521721] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T17:20:11.548078] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-29T17:20:12.348124] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-29T17:20:12.354956] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T17:20:13.148131] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-29T17:20:13.948166] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-29T17:20:14.748174] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-29T17:20:14.970536] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T17:20:15.155769] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-29T17:20:15.158970] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T17:20:15.166207] [INFO ] [REMOTE ] ATHM: Full fetch complete (51494 records). [2025-09-29T17:20:15.167367] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-29T17:20:15.548822] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-29T17:20:15.610910] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-29T17:20:15.611310] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-29T17:20:15.612062] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-29T17:20:15.612588] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-29T17:20:15.613792] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T17:20:15.623991] [DEBUG] [LOCAL ] ATHM: Trimmed 51494 records to 32365 (keeping 200 days of data) [2025-09-29T17:20:15.824451] [DEBUG] [LOCAL ] ATHM: Primary data saved (32365 records). [2025-09-29T17:20:15.824602] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-29T17:20:15.824716] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHM took 31.1s. Estimated remaining: 4h 25m 5s. Rate: 8.3 symbols/min [2025-09-29T17:20:16.005003] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:16.049677] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-29T17:20:16.049996] [INFO ] [MAIN ] ATMU: Loaded 40274 existing records. [2025-09-29T17:20:16.238936] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:16.239215] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-29T17:20:16.239264] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-29T17:20:16.240237] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-29T17:20:16.240300] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-29T17:20:16.353229] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-29T17:20:16.621513] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:17.148126] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-29T17:20:17.948190] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-29T17:20:18.612112] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T17:20:18.748141] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-29T17:20:18.843860] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-29T17:20:18.985884] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (3.44 seconds). [2025-09-29T17:20:18.995087] [INFO ] [REMOTE ] ATHS: Full fetch complete (10062 records). [2025-09-29T17:20:18.995357] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-29T17:20:19.557842] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-29T17:20:19.622065] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-29T17:20:19.622706] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-29T17:20:19.624681] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T17:20:19.625239] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-29T17:20:19.633486] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-29T17:20:19.635100] [DEBUG] [LOCAL ] ATHS: Trimmed 10062 records to 6984 (keeping 200 days of data) [2025-09-29T17:20:19.685888] [DEBUG] [LOCAL ] ATHS: Primary data saved (6984 records). [2025-09-29T17:20:19.686056] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-29T17:20:19.686153] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 22.1s. Estimated remaining: 4h 24m 14s. Rate: 8.3 symbols/min [2025-09-29T17:20:19.879552] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:19.929181] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-29T17:20:19.929520] [INFO ] [MAIN ] ATO: Loaded 42489 existing records. [2025-09-29T17:20:20.152414] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:20.152960] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-29T17:20:20.153474] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-29T17:20:20.154736] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T17:20:20.167570] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-29T17:20:20.168638] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-29T17:20:20.353734] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-29T17:20:20.545913] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:21.148159] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-29T17:20:21.396257] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:20:21.948077] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-29T17:20:21.988093] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T17:20:22.198152] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T17:20:22.748151] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-29T17:20:23.548128] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-29T17:20:23.732168] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:20:24.329436] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T17:20:24.348097] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-29T17:20:25.148152] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-29T17:20:25.187367] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T17:20:25.401831] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:20:25.948184] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-29T17:20:26.748137] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-29T17:20:27.003029] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:20:27.245100] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T17:20:27.548180] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-29T17:20:28.345792] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T17:20:28.354366] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-29T17:20:28.680881] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T17:20:29.148120] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-29T17:20:29.663396] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T17:20:29.948112] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-29T17:20:30.748150] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-29T17:20:30.846354] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T17:20:31.548138] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-29T17:20:31.665917] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T17:20:32.320891] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:20:32.348130] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-29T17:20:33.148154] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-29T17:20:33.375163] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T17:20:33.463610] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T17:20:33.948104] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-29T17:20:34.518768] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T17:20:34.748123] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-29T17:20:35.548276] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-29T17:20:35.809217] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T17:20:35.823152] [INFO ] [REMOTE ] ATI: Full fetch complete (73936 records). [2025-09-29T17:20:35.823342] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-29T17:20:36.270591] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-29T17:20:36.272234] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-29T17:20:36.272147] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T17:20:36.273273] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-29T17:20:36.280679] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-29T17:20:36.285539] [DEBUG] [LOCAL ] ATI: Trimmed 73936 records to 51503 (keeping 200 days of data) [2025-09-29T17:20:36.372550] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-29T17:20:36.607631] [DEBUG] [LOCAL ] ATI: Primary data saved (51503 records). [2025-09-29T17:20:36.607879] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-29T17:20:36.608033] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 36.1s. Estimated remaining: 4h 26m 13s. Rate: 8.3 symbols/min [2025-09-29T17:20:36.796621] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:36.839784] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-29T17:20:36.840063] [INFO ] [MAIN ] ATR: Loaded 30839 existing records. [2025-09-29T17:20:37.033582] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:37.033840] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-29T17:20:37.033891] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-29T17:20:37.038028] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-29T17:20:37.038112] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-29T17:20:37.148117] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-29T17:20:37.438576] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:37.465339] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T17:20:37.746873] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T17:20:37.948124] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-29T17:20:38.341416] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T17:20:38.748123] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-29T17:20:39.555712] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-29T17:20:39.559801] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:20:40.321077] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T17:20:40.329358] [INFO ] [REMOTE ] ATKR: Full fetch complete (53705 records). [2025-09-29T17:20:40.329526] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-29T17:20:40.354129] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-29T17:20:40.826849] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-29T17:20:40.826956] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-29T17:20:40.827721] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-29T17:20:40.827790] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-29T17:20:40.829381] [DEBUG] [LOCAL ] ATKR: Trimmed 53705 records to 35560 (keeping 200 days of data) [2025-09-29T17:20:41.079997] [DEBUG] [LOCAL ] ATKR: Primary data saved (35560 records). [2025-09-29T17:20:41.080231] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-29T17:20:41.080462] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 35.3s. Estimated remaining: 4h 25m 30s. Rate: 8.3 symbols/min [2025-09-29T17:20:41.151165] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-29T17:20:41.267845] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:41.297143] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:20:41.321190] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-29T17:20:41.321469] [INFO ] [MAIN ] ATS: Loaded 18145 existing records. [2025-09-29T17:20:41.510685] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:41.510935] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-29T17:20:41.511015] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-29T17:20:41.512693] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-29T17:20:41.512760] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-29T17:20:41.889446] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:41.907500] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:20:41.948111] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-29T17:20:42.748119] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-29T17:20:42.821692] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:20:43.403250] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:20:43.548121] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-29T17:20:43.900361] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T17:20:44.348162] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-29T17:20:45.148126] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-29T17:20:45.229142] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T17:20:45.238493] [INFO ] [REMOTE ] ATMU: Full fetch complete (56918 records). [2025-09-29T17:20:45.238708] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-29T17:20:45.657438] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-29T17:20:45.657540] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-29T17:20:45.658235] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-29T17:20:45.658306] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-29T17:20:45.659620] [DEBUG] [LOCAL ] ATMU: Trimmed 56918 records to 39533 (keeping 200 days of data) [2025-09-29T17:20:45.919183] [DEBUG] [LOCAL ] ATMU: Primary data saved (39533 records). [2025-09-29T17:20:45.919354] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-29T17:20:45.919457] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 30.1s. Estimated remaining: 4h 24m 52s. Rate: 8.3 symbols/min [2025-09-29T17:20:45.953626] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-29T17:20:46.112829] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:46.150071] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T17:20:46.172583] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T17:20:46.227591] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-29T17:20:46.227965] [INFO ] [MAIN ] ATUS: Loaded 49958 existing records. [2025-09-29T17:20:46.427821] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:46.428142] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-29T17:20:46.428223] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-29T17:20:46.431500] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-29T17:20:46.431571] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-29T17:20:46.753225] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-29T17:20:46.828145] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:46.845350] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T17:20:47.548108] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-29T17:20:48.348116] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-29T17:20:48.466861] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:20:48.937607] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T17:20:49.148119] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-29T17:20:49.337879] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T17:20:49.948134] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-29T17:20:50.653695] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T17:20:50.748085] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-29T17:20:50.887735] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T17:20:51.548148] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-29T17:20:52.348157] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-29T17:20:52.699787] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T17:20:53.123345] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T17:20:53.148106] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-29T17:20:53.859422] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T17:20:53.948109] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-29T17:20:54.713312] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T17:20:54.748154] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-29T17:20:55.165697] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T17:20:55.548178] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-29T17:20:56.113978] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T17:20:56.348168] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-29T17:20:56.602780] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:20:57.148129] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-29T17:20:57.706263] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T17:20:57.948141] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-29T17:20:58.748091] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-29T17:20:58.992475] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:20:59.001178] [INFO ] [REMOTE ] ATO: Full fetch complete (60495 records). [2025-09-29T17:20:59.001310] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-29T17:20:59.408296] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-29T17:20:59.408400] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-29T17:20:59.409059] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-29T17:20:59.409137] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-29T17:20:59.410460] [DEBUG] [LOCAL ] ATO: Trimmed 60495 records to 41864 (keeping 200 days of data) [2025-09-29T17:20:59.546063] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:20:59.555669] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-29T17:20:59.746923] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:20:59.753847] [DEBUG] [LOCAL ] ATO: Primary data saved (41864 records). [2025-09-29T17:20:59.753995] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-29T17:20:59.755823] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 40.1s. Estimated remaining: 4h 26m 8s. Rate: 8.3 symbols/min [2025-09-29T17:20:59.938771] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:00.002242] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-29T17:21:00.002594] [INFO ] [MAIN ] AU: Loaded 53715 existing records. [2025-09-29T17:21:00.193204] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:00.193422] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-29T17:21:00.193472] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-29T17:21:00.195054] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-29T17:21:00.195148] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-29T17:21:00.355159] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-29T17:21:00.589173] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:00.985668] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:21:01.148140] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-29T17:21:01.502571] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T17:21:01.948167] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-29T17:21:02.755615] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-29T17:21:02.758430] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T17:21:03.436891] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:21:03.443919] [INFO ] [REMOTE ] ATR: Full fetch complete (43472 records). [2025-09-29T17:21:03.444054] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-29T17:21:03.553421] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-29T17:21:03.865663] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-29T17:21:03.865787] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-29T17:21:03.866335] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-29T17:21:03.866399] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-29T17:21:03.867527] [DEBUG] [LOCAL ] ATR: Trimmed 43472 records to 30406 (keeping 200 days of data) [2025-09-29T17:21:04.068930] [DEBUG] [LOCAL ] ATR: Primary data saved (30406 records). [2025-09-29T17:21:04.069128] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-29T17:21:04.069224] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 27.5s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-09-29T17:21:04.255344] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:04.322509] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-29T17:21:04.322859] [INFO ] [MAIN ] AUB: Loaded 47072 existing records. [2025-09-29T17:21:04.362147] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-29T17:21:04.552182] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:04.552491] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-29T17:21:04.552568] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-29T17:21:04.564624] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-29T17:21:04.585797] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-29T17:21:04.653454] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:21:05.050865] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:05.148161] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-29T17:21:05.247343] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T17:21:05.318180] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:21:05.948166] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-29T17:21:06.748159] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-29T17:21:06.863898] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T17:21:06.868235] [INFO ] [REMOTE ] ATS: Full fetch complete (25635 records). [2025-09-29T17:21:06.868370] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-29T17:21:07.252328] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T17:21:07.326581] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-29T17:21:07.326692] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-29T17:21:07.327082] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-29T17:21:07.327127] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-29T17:21:07.327967] [DEBUG] [LOCAL ] ATS: Trimmed 25635 records to 17851 (keeping 200 days of data) [2025-09-29T17:21:07.436907] [DEBUG] [LOCAL ] ATS: Primary data saved (17851 records). [2025-09-29T17:21:07.437064] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-29T17:21:07.437155] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 26.4s. Estimated remaining: 4h 24m 28s. Rate: 8.3 symbols/min [2025-09-29T17:21:07.555744] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-29T17:21:07.638666] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:07.645299] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-29T17:21:07.645487] [INFO ] [MAIN ] AUNA: Loaded 4966 existing records. [2025-09-29T17:21:07.831941] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:07.832171] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-29T17:21:07.832226] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-29T17:21:07.832769] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-29T17:21:07.832835] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-29T17:21:08.225691] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:08.348085] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-29T17:21:08.626079] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:21:09.074711] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T17:21:09.148153] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-29T17:21:09.231239] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T17:21:09.948149] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-29T17:21:10.637204] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T17:21:10.653173] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T17:21:10.748182] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-29T17:21:11.384798] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T17:21:11.548115] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-29T17:21:12.350037] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-29T17:21:12.352190] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T17:21:13.148126] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-29T17:21:13.822584] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T17:21:13.948107] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-29T17:21:14.748189] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-29T17:21:15.141815] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-29T17:21:15.548195] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-29T17:21:15.668838] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T17:21:16.348129] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-29T17:21:16.383353] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T17:21:17.148126] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-29T17:21:17.221534] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:21:17.738819] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T17:21:17.948152] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-29T17:21:18.366373] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T17:21:18.748078] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-29T17:21:18.964067] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:21:19.548130] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-29T17:21:20.201281] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T17:21:20.348133] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-29T17:21:20.981284] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-29T17:21:21.068729] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T17:21:21.148148] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-29T17:21:21.789315] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T17:21:21.948121] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-29T17:21:22.571142] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T17:21:22.748141] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-29T17:21:23.548191] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-29T17:21:24.348204] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-29T17:21:24.505361] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T17:21:25.152344] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-29T17:21:25.158242] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:21:25.957437] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-29T17:21:25.984866] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T17:21:26.748188] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-29T17:21:27.024032] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T17:21:27.548092] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-29T17:21:27.626224] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T17:21:28.346061] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T17:21:28.348089] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-29T17:21:28.349680] [INFO ] [REMOTE ] AUNA: Full fetch complete (7669 records). [2025-09-29T17:21:28.349825] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-29T17:21:28.541032] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:21:28.600091] [INFO ] [REMOTE ] ATUS: Full fetch complete (70918 records). [2025-09-29T17:21:28.630443] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-29T17:21:29.051555] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-29T17:21:29.067044] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-29T17:21:29.108308] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-29T17:21:29.108525] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-29T17:21:29.109441] [DEBUG] [LOCAL ] AUNA: Trimmed 7669 records to 4872 (keeping 200 days of data) [2025-09-29T17:21:29.182454] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-29T17:21:29.235739] [DEBUG] [LOCAL ] AUNA: Primary data saved (4872 records). [2025-09-29T17:21:29.285032] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-29T17:21:29.285267] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. AUNA took 21.8s. Estimated remaining: 4h 27m 23s. Rate: 8.2 symbols/min [2025-09-29T17:21:29.744919] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:29.770540] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-29T17:21:29.771219] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-29T17:21:29.772029] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-29T17:21:29.772095] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-29T17:21:29.774389] [DEBUG] [LOCAL ] ATUS: Trimmed 70918 records to 49225 (keeping 200 days of data) [2025-09-29T17:21:29.921915] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-29T17:21:29.923443] [INFO ] [MAIN ] AVA: Loaded 40183 existing records. [2025-09-29T17:21:30.142935] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:30.148317] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-29T17:21:30.148440] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-29T17:21:30.152635] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-29T17:21:30.152844] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-29T17:21:30.661701] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-29T17:21:30.758211] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-29T17:21:30.757238] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:30.761489] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-29T17:21:30.803174] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T17:21:30.876379] [DEBUG] [LOCAL ] ATUS: Primary data saved (49225 records). [2025-09-29T17:21:30.876544] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-29T17:21:30.876668] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. ATUS took 45.0s. Estimated remaining: 4h 26m 5s. Rate: 8.2 symbols/min [2025-09-29T17:21:31.056888] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:31.069762] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-29T17:21:31.070019] [INFO ] [MAIN ] AVAL: Loaded 9040 existing records. [2025-09-29T17:21:31.258877] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:31.259172] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-29T17:21:31.259231] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-29T17:21:31.261217] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-29T17:21:31.261284] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-29T17:21:31.553251] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-29T17:21:31.676841] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:32.133862] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:21:32.348112] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-29T17:21:32.833558] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:21:33.143433] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T17:21:33.152581] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-29T17:21:33.677675] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T17:21:33.707933] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T17:21:33.948111] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-29T17:21:34.641269] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T17:21:34.748124] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-29T17:21:35.548111] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-29T17:21:35.623386] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T17:21:36.348364] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-29T17:21:37.148103] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-29T17:21:37.235547] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T17:21:37.244981] [INFO ] [REMOTE ] AUB: Full fetch complete (65568 records). [2025-09-29T17:21:37.245119] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-29T17:21:37.392736] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T17:21:37.691587] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-29T17:21:37.691717] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-29T17:21:37.692506] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-29T17:21:37.692561] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-29T17:21:37.694082] [DEBUG] [LOCAL ] AUB: Trimmed 65568 records to 46313 (keeping 200 days of data) [2025-09-29T17:21:37.948134] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-29T17:21:37.995685] [DEBUG] [LOCAL ] AUB: Primary data saved (46313 records). [2025-09-29T17:21:37.995854] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-29T17:21:37.995946] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AUB took 33.9s. Estimated remaining: 4h 25m 56s. Rate: 8.2 symbols/min [2025-09-29T17:21:38.198633] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:38.256789] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-29T17:21:38.257182] [INFO ] [MAIN ] AVB: Loaded 42457 existing records. [2025-09-29T17:21:38.457709] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:38.458191] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-29T17:21:38.458277] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-29T17:21:38.458977] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-29T17:21:38.459228] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-29T17:21:38.750437] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-29T17:21:38.908193] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:38.917178] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T17:21:38.930046] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T17:21:39.548107] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-29T17:21:40.348328] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-29T17:21:41.044839] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-29T17:21:41.092147] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T17:21:41.090385] [INFO ] [REMOTE ] AU: Full fetch complete (76271 records). [2025-09-29T17:21:41.100944] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-29T17:21:41.160477] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-29T17:21:41.548303] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-29T17:21:41.548401] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-29T17:21:41.549188] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-29T17:21:41.549258] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-29T17:21:41.552135] [DEBUG] [LOCAL ] AU: Trimmed 76271 records to 52987 (keeping 200 days of data) [2025-09-29T17:21:41.919572] [DEBUG] [LOCAL ] AU: Primary data saved (52987 records). [2025-09-29T17:21:41.919761] [INFO ] [MAIN ] AU: Full history saved. [2025-09-29T17:21:41.922057] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AU took 42.2s. Estimated remaining: 4h 25m 7s. Rate: 8.3 symbols/min [2025-09-29T17:21:41.957109] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-29T17:21:42.098448] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T17:21:42.171913] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:21:42.174982] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:42.185563] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-29T17:21:42.186020] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-29T17:21:42.186163] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-29T17:21:42.186217] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-29T17:21:42.186286] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-29T17:21:42.186322] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-29T17:21:42.587253] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:42.748119] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-29T17:21:43.538281] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T17:21:43.548067] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-29T17:21:43.558522] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T17:21:44.348111] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-29T17:21:44.641891] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:21:44.642244] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-29T17:21:44.642330] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:21:44.642378] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-29T17:21:44.642413] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:21:44.642453] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-29T17:21:44.642512] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-29T17:21:44.642551] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-29T17:21:44.642610] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-29T17:21:44.642713] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVBC took 2.7s. Estimated remaining: 4h 24m 5s. Rate: 8.3 symbols/min [2025-09-29T17:21:44.835108] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:44.859339] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-29T17:21:44.859593] [INFO ] [MAIN ] AVD: Loaded 23030 existing records. [2025-09-29T17:21:45.047509] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:45.047762] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-29T17:21:45.047816] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-29T17:21:45.048225] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-29T17:21:45.048289] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-29T17:21:45.152568] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-29T17:21:45.437242] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:45.459209] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-29T17:21:45.948134] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-29T17:21:46.381565] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T17:21:46.748119] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-29T17:21:47.538584] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:21:47.548057] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-29T17:21:48.104759] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:21:48.348120] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-29T17:21:49.148092] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-29T17:21:49.182755] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T17:21:49.220119] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-29T17:21:49.948138] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-29T17:21:50.731167] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T17:21:50.748079] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-29T17:21:51.181575] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:21:51.548156] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-29T17:21:52.282846] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T17:21:52.348108] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-29T17:21:52.383163] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T17:21:53.148141] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-29T17:21:53.957444] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-29T17:21:53.976687] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T17:21:54.634436] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T17:21:54.748128] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-29T17:21:54.884024] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T17:21:55.548126] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-29T17:21:56.355052] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-29T17:21:56.360638] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T17:21:56.369815] [INFO ] [REMOTE ] AVA: Full fetch complete (55724 records). [2025-09-29T17:21:56.369980] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-29T17:21:56.440800] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:21:56.883501] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-29T17:21:56.883600] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-29T17:21:56.884371] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-29T17:21:56.884445] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-29T17:21:56.885847] [DEBUG] [LOCAL ] AVA: Trimmed 55724 records to 39461 (keeping 200 days of data) [2025-09-29T17:21:57.138020] [DEBUG] [LOCAL ] AVA: Primary data saved (39461 records). [2025-09-29T17:21:57.138190] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-29T17:21:57.138318] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 27.9s. Estimated remaining: 4h 25m 1s. Rate: 8.3 symbols/min [2025-09-29T17:21:57.154049] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-29T17:21:57.353155] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:57.381115] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-29T17:21:57.381435] [INFO ] [MAIN ] AVK: Loaded 18064 existing records. [2025-09-29T17:21:57.584786] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:57.585127] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-29T17:21:57.585205] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-29T17:21:57.585628] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-29T17:21:57.585725] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-29T17:21:57.948280] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-29T17:21:57.993388] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:58.022302] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T17:21:58.079405] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T17:21:58.748186] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-29T17:21:58.838711] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T17:21:58.840680] [INFO ] [REMOTE ] AVAL: Full fetch complete (14605 records). [2025-09-29T17:21:58.840865] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-29T17:21:59.303132] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-29T17:21:59.303258] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-29T17:21:59.303709] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-29T17:21:59.303784] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-29T17:21:59.304708] [DEBUG] [LOCAL ] AVAL: Trimmed 14605 records to 8780 (keeping 200 days of data) [2025-09-29T17:21:59.370044] [DEBUG] [LOCAL ] AVAL: Primary data saved (8780 records). [2025-09-29T17:21:59.370203] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-29T17:21:59.370296] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVAL took 28.5s. Estimated remaining: 4h 23m 54s. Rate: 8.3 symbols/min [2025-09-29T17:21:59.549960] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-29T17:21:59.551603] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:59.597579] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-29T17:21:59.597977] [INFO ] [MAIN ] AVNS: Loaded 34132 existing records. [2025-09-29T17:21:59.790240] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:59.790442] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-29T17:21:59.790490] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-29T17:21:59.790944] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-29T17:21:59.791005] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-29T17:21:59.988951] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T17:22:00.288117] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:00.348159] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-29T17:22:01.100690] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T17:22:01.148161] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-29T17:22:01.861284] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:22:01.948157] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-29T17:22:02.577765] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:22:02.748138] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-29T17:22:03.178200] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:22:03.548136] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-29T17:22:04.113787] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T17:22:04.348125] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-29T17:22:04.774019] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:22:05.148133] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-29T17:22:05.677046] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T17:22:05.948148] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-29T17:22:06.212857] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T17:22:06.640571] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T17:22:06.748179] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-29T17:22:07.548165] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-29T17:22:08.090821] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T17:22:08.348115] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-29T17:22:08.595126] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T17:22:09.148153] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-29T17:22:09.783127] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T17:22:09.948146] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-29T17:22:10.157795] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T17:22:10.748140] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-29T17:22:11.031943] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T17:22:11.548164] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-29T17:22:12.348110] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-29T17:22:12.454254] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T17:22:12.463740] [INFO ] [REMOTE ] AVB: Full fetch complete (58478 records). [2025-09-29T17:22:12.463910] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-29T17:22:12.869550] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-29T17:22:12.869629] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-29T17:22:12.870416] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-29T17:22:12.870483] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-29T17:22:12.871789] [DEBUG] [LOCAL ] AVB: Trimmed 58478 records to 41892 (keeping 200 days of data) [2025-09-29T17:22:13.148560] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T17:22:13.149052] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-29T17:22:13.182752] [DEBUG] [LOCAL ] AVB: Primary data saved (41892 records). [2025-09-29T17:22:13.182925] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-29T17:22:13.183021] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVB took 35.2s. Estimated remaining: 4h 25m 5s. Rate: 8.3 symbols/min [2025-09-29T17:22:13.366797] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:13.413878] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-29T17:22:13.414208] [INFO ] [MAIN ] AVNT: Loaded 39887 existing records. [2025-09-29T17:22:13.601327] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:13.601795] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-29T17:22:13.601912] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-29T17:22:13.611008] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-29T17:22:13.617913] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-29T17:22:13.685704] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:22:13.949802] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-29T17:22:14.022581] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T17:22:14.049936] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:14.748127] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-29T17:22:15.329317] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:22:15.548173] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-29T17:22:15.852533] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:22:15.857343] [INFO ] [REMOTE ] AVD: Full fetch complete (33788 records). [2025-09-29T17:22:15.857453] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-29T17:22:16.250704] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-29T17:22:16.250790] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-29T17:22:16.251212] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-29T17:22:16.251252] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-29T17:22:16.252031] [DEBUG] [LOCAL ] AVD: Trimmed 33788 records to 22711 (keeping 200 days of data) [2025-09-29T17:22:16.350284] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-29T17:22:16.383943] [DEBUG] [LOCAL ] AVD: Primary data saved (22711 records). [2025-09-29T17:22:16.384085] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-29T17:22:16.384172] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 31.7s. Estimated remaining: 4h 24m 9s. Rate: 8.3 symbols/min [2025-09-29T17:22:16.564985] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:16.627287] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-29T17:22:16.627887] [INFO ] [MAIN ] AVTR: Loaded 54345 existing records. [2025-09-29T17:22:16.828091] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:22:16.862731] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:16.863384] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-29T17:22:16.863436] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-29T17:22:16.869771] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-29T17:22:16.869860] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-29T17:22:17.149565] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-29T17:22:17.262418] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T17:22:17.300813] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:17.948122] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-29T17:22:18.287697] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T17:22:18.298065] [INFO ] [REMOTE ] AVNS: Full fetch complete (48123 records). [2025-09-29T17:22:18.298263] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-29T17:22:18.714101] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-29T17:22:18.714191] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-29T17:22:18.714752] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-29T17:22:18.714836] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-29T17:22:18.716125] [DEBUG] [LOCAL ] AVNS: Trimmed 48123 records to 33542 (keeping 200 days of data) [2025-09-29T17:22:18.769465] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-29T17:22:18.926106] [DEBUG] [LOCAL ] AVNS: Primary data saved (33542 records). [2025-09-29T17:22:18.926256] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-29T17:22:18.926344] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVNS took 19.6s. Estimated remaining: 4h 23m 7s. Rate: 8.3 symbols/min [2025-09-29T17:22:19.111533] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:19.156455] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-29T17:22:19.156840] [INFO ] [MAIN ] AVY: Loaded 38102 existing records. [2025-09-29T17:22:19.365715] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:19.374977] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-29T17:22:19.376255] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T17:22:19.376550] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-29T17:22:19.390077] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-29T17:22:19.390236] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-29T17:22:19.553369] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-29T17:22:19.788353] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:20.348085] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-29T17:22:20.708045] [DEBUG] [REMOTE ] AVNT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-29T17:22:20.713902] [WARN ] [REMOTE ] AVNT: No data returned for month 2025-01 [2025-09-29T17:22:20.720994] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T17:22:20.722095] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:22:20.721074] [FATAL] [REMOTE ] AVNT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:22:20.737112] [FATAL] [MAIN ] AVNT: Failed to fetch primary data. [2025-09-29T17:22:20.737294] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:22:20.737875] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-29T17:22:20.737985] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-29T17:22:20.738053] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-09-29T17:22:20.739746] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-09-29T17:22:20.739838] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNT took 7.6s. Estimated remaining: 4h 21m 56s. Rate: 8.3 symbols/min [2025-09-29T17:22:20.978212] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:21.007362] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-29T17:22:21.007623] [INFO ] [MAIN ] AWF: Loaded 24608 existing records. [2025-09-29T17:22:21.153265] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-29T17:22:21.232351] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:21.232580] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-29T17:22:21.232630] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-29T17:22:21.236175] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-29T17:22:21.236282] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-29T17:22:21.674790] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:21.948201] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-29T17:22:22.748107] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-29T17:22:22.870746] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:22:22.979818] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T17:22:23.548146] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-29T17:22:23.702258] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T17:22:24.348107] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-29T17:22:24.589389] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T17:22:25.148158] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-29T17:22:25.485356] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T17:22:25.948137] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-29T17:22:26.189393] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T17:22:26.748130] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-29T17:22:27.095848] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T17:22:27.548161] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-29T17:22:28.348098] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-29T17:22:28.448959] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T17:22:28.694271] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-29T17:22:29.148145] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-29T17:22:29.948152] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-29T17:22:30.116460] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T17:22:30.398457] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T17:22:30.748169] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-29T17:22:31.159331] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T17:22:31.163734] [INFO ] [REMOTE ] AVK: Full fetch complete (26593 records). [2025-09-29T17:22:31.163842] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-29T17:22:31.556158] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-29T17:22:31.558207] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-29T17:22:31.558330] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-29T17:22:31.558818] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-29T17:22:31.558962] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-29T17:22:31.561100] [DEBUG] [LOCAL ] AVK: Trimmed 26593 records to 17863 (keeping 200 days of data) [2025-09-29T17:22:31.682415] [DEBUG] [LOCAL ] AVK: Primary data saved (17863 records). [2025-09-29T17:22:31.682568] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-29T17:22:31.682687] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVK took 34.5s. Estimated remaining: 4h 22m 32s. Rate: 8.3 symbols/min [2025-09-29T17:22:31.865589] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:31.895474] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-29T17:22:31.895788] [INFO ] [MAIN ] AWI: Loaded 26185 existing records. [2025-09-29T17:22:32.095798] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:32.096108] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-29T17:22:32.096189] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-29T17:22:32.097934] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-29T17:22:32.098002] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-29T17:22:32.353258] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-29T17:22:32.489258] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:32.522712] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:22:32.822552] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T17:22:33.148147] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-29T17:22:33.948128] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-29T17:22:34.064156] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:22:34.748130] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-29T17:22:34.950465] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T17:22:35.105577] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T17:22:35.548168] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-29T17:22:36.261167] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:22:36.348129] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-29T17:22:37.148124] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-29T17:22:37.364910] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T17:22:37.414373] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T17:22:37.948107] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-29T17:22:38.621548] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T17:22:38.748118] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-29T17:22:39.294162] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:22:39.548124] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-29T17:22:39.847258] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T17:22:40.348120] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-29T17:22:41.148148] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-29T17:22:41.427250] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:22:41.948143] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-29T17:22:42.074293] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T17:22:42.257136] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T17:22:42.748076] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-29T17:22:43.137744] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T17:22:43.548125] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-29T17:22:44.326580] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T17:22:44.348096] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-29T17:22:44.739878] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:22:45.148166] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-29T17:22:45.948104] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-29T17:22:46.150288] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T17:22:46.162161] [INFO ] [REMOTE ] AVTR: Full fetch complete (77052 records). [2025-09-29T17:22:46.162384] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-29T17:22:46.163402] [FATAL] [VALIDATOR ] AVTR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:22:46.163522] [FATAL] [MAIN ] AVTR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:22:46.163570] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:22:46.163664] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-29T17:22:46.163824] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-09-29T17:22:46.163896] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-09-29T17:22:46.165333] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-09-29T17:22:46.166843] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 29.8s. Estimated remaining: 4h 23m 50s. Rate: 8.3 symbols/min [2025-09-29T17:22:46.364823] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:46.432022] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T17:22:46.457571] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-29T17:22:46.458085] [INFO ] [MAIN ] AWK: Loaded 49489 existing records. [2025-09-29T17:22:46.653888] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:46.654131] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-29T17:22:46.654181] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-29T17:22:46.658425] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-29T17:22:46.658494] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-29T17:22:46.756843] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-29T17:22:47.076169] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:47.185610] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T17:22:47.191739] [INFO ] [REMOTE ] AWF: Full fetch complete (36017 records). [2025-09-29T17:22:47.191876] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-29T17:22:47.553352] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-29T17:22:47.607115] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-29T17:22:47.607295] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-29T17:22:47.607921] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-29T17:22:47.608000] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-29T17:22:47.609215] [DEBUG] [LOCAL ] AWF: Trimmed 36017 records to 24244 (keeping 200 days of data) [2025-09-29T17:22:47.772875] [DEBUG] [LOCAL ] AWF: Primary data saved (24244 records). [2025-09-29T17:22:47.773057] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-29T17:22:47.773171] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AWF took 27.0s. Estimated remaining: 4h 22m 37s. Rate: 8.3 symbols/min [2025-09-29T17:22:48.023033] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:48.048066] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-29T17:22:48.048351] [INFO ] [MAIN ] AWP: Loaded 21835 existing records. [2025-09-29T17:22:48.250040] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:48.250465] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-29T17:22:48.250726] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-29T17:22:48.254065] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-29T17:22:48.254162] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-29T17:22:48.367245] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-29T17:22:48.388360] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T17:22:48.736789] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:49.148105] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-29T17:22:49.202159] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:22:49.948128] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-29T17:22:50.495434] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T17:22:50.535320] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-29T17:22:50.748184] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-29T17:22:51.486077] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T17:22:51.548155] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-29T17:22:52.348121] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-29T17:22:53.148179] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-29T17:23:05.026014] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (13.48 seconds). [2025-09-29T17:23:05.031461] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-29T17:23:06.086524] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (15.34 seconds). [2025-09-29T17:23:06.098311] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-29T17:23:06.229676] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T17:23:06.236276] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-29T17:23:06.362451] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (13.21 seconds). [2025-09-29T17:23:06.368243] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-29T17:23:06.432945] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (14.08 seconds). [2025-09-29T17:23:06.441491] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-29T17:23:07.307256] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T17:23:07.311547] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-29T17:23:07.529311] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T17:23:07.534974] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-29T17:23:07.848125] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T17:23:07.858425] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-29T17:23:08.454968] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T17:23:08.460186] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-29T17:23:08.757950] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T17:23:08.765618] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-29T17:23:09.542887] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T17:23:09.548135] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-29T17:23:09.725483] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T17:23:09.736716] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-29T17:23:09.948166] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (3.51 seconds). [2025-09-29T17:23:09.956535] [INFO ] [REMOTE ] AVY: Full fetch complete (56181 records). [2025-09-29T17:23:09.956715] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-29T17:23:10.087707] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T17:23:10.136473] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-29T17:23:10.406183] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-29T17:23:10.406398] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-29T17:23:10.407473] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-29T17:23:10.407562] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-29T17:23:10.409259] [DEBUG] [LOCAL ] AVY: Trimmed 56181 records to 37420 (keeping 200 days of data) [2025-09-29T17:23:10.653954] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T17:23:10.660638] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-29T17:23:10.692533] [DEBUG] [LOCAL ] AVY: Primary data saved (37420 records). [2025-09-29T17:23:10.692721] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-29T17:23:10.692826] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AVY took 51.8s. Estimated remaining: 4h 25m 30s. Rate: 8.2 symbols/min [2025-09-29T17:23:10.879758] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:10.907406] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-29T17:23:10.907707] [INFO ] [MAIN ] AWR: Loaded 22993 existing records. [2025-09-29T17:23:11.107355] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:11.108208] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-29T17:23:11.108360] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-29T17:23:11.113481] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-29T17:23:11.113618] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-29T17:23:11.326902] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T17:23:11.387768] [INFO ] [REMOTE ] AWI: Full fetch complete (35270 records). [2025-09-29T17:23:11.422963] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-29T17:23:11.456848] [FATAL] [VALIDATOR ] AWI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:23:11.477982] [FATAL] [MAIN ] AWI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:23:11.496477] [WARN ] [MAIN ] AWI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:23:11.521139] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-29T17:23:11.529034] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-09-29T17:23:11.546754] [INFO ] [LOCAL ] AWI: Starting deletion of derivative data. [2025-09-29T17:23:11.546495] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:11.547291] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-29T17:23:11.548387] [DEBUG] [LOCAL ] AWI: Deleted derivative data file. [2025-09-29T17:23:11.548753] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 39.9s. Estimated remaining: 4h 24m 9s. Rate: 8.3 symbols/min [2025-09-29T17:23:11.731021] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T17:23:11.768940] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:11.769473] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-29T17:23:11.802269] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T17:23:11.814867] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-29T17:23:11.837864] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-29T17:23:11.838148] [INFO ] [MAIN ] AX: Loaded 28929 existing records. [2025-09-29T17:23:12.037955] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:12.038159] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-29T17:23:12.038207] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-29T17:23:12.040953] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-29T17:23:12.041020] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-29T17:23:12.424735] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:12.425095] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-29T17:23:13.149837] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:23:13.157584] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-29T17:23:13.200352] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:23:13.207247] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-29T17:23:13.255700] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:23:13.266512] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-29T17:23:13.783235] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T17:23:13.790144] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-29T17:23:14.354432] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T17:23:14.364061] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-29T17:23:14.435547] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T17:23:14.441577] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-29T17:23:14.633209] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T17:23:14.649554] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-29T17:23:15.014541] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T17:23:15.021996] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-29T17:23:15.525173] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T17:23:15.529930] [INFO ] [REMOTE ] AWP: Full fetch complete (32532 records). [2025-09-29T17:23:15.530059] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-29T17:23:15.701823] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T17:23:15.719067] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-29T17:23:15.973267] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-29T17:23:15.973585] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-29T17:23:15.974060] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-29T17:23:15.974295] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-29T17:23:15.990738] [DEBUG] [LOCAL ] AWP: Trimmed 32532 records to 21606 (keeping 200 days of data) [2025-09-29T17:23:15.992149] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T17:23:15.999289] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-29T17:23:16.133774] [DEBUG] [LOCAL ] AWP: Primary data saved (21606 records). [2025-09-29T17:23:16.133955] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-29T17:23:16.134109] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 28.4s. Estimated remaining: 4h 23m 31s. Rate: 8.3 symbols/min [2025-09-29T17:23:16.323517] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:16.355786] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:23:16.367396] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-29T17:23:16.419028] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-29T17:23:16.419388] [INFO ] [MAIN ] AXL: Loaded 51239 existing records. [2025-09-29T17:23:16.618621] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:16.618897] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-29T17:23:16.618951] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-29T17:23:16.624905] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-29T17:23:16.625012] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-29T17:23:17.012920] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:17.027724] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T17:23:17.148139] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-29T17:23:17.359461] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:23:17.886458] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T17:23:17.948089] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-29T17:23:18.748113] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-29T17:23:18.950390] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:23:19.548142] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-29T17:23:19.750491] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T17:23:19.791174] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:23:19.801473] [INFO ] [REMOTE ] AWK: Full fetch complete (70548 records). [2025-09-29T17:23:19.801615] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-29T17:23:20.207886] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-29T17:23:20.207979] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-29T17:23:20.208804] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-29T17:23:20.208911] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-29T17:23:20.210427] [DEBUG] [LOCAL ] AWK: Trimmed 70548 records to 48718 (keeping 200 days of data) [2025-09-29T17:23:20.349836] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-29T17:23:20.537035] [DEBUG] [LOCAL ] AWK: Primary data saved (48718 records). [2025-09-29T17:23:20.537211] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-29T17:23:20.538758] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWK took 34.4s. Estimated remaining: 4h 22m 52s. Rate: 8.3 symbols/min [2025-09-29T17:23:20.723086] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:20.795102] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-29T17:23:20.795438] [INFO ] [MAIN ] AXP: Loaded 53999 existing records. [2025-09-29T17:23:21.004416] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:21.005503] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-29T17:23:21.005554] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-29T17:23:21.006427] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-29T17:23:21.006491] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-29T17:23:21.150005] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-29T17:23:21.340568] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:23:21.450844] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:21.519992] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:23:21.948127] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-29T17:23:22.539010] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T17:23:22.748118] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-29T17:23:23.548127] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-29T17:23:23.893463] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:23:23.932271] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T17:23:24.348163] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-29T17:23:25.124217] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T17:23:25.148105] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-29T17:23:25.555606] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-29T17:23:25.948083] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-29T17:23:26.423960] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T17:23:26.748158] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-29T17:23:27.553205] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-29T17:23:27.570451] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T17:23:28.348129] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-29T17:23:28.680589] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T17:23:28.860314] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-29T17:23:29.148123] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-29T17:23:29.948130] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-29T17:23:30.171370] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:23:30.518836] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T17:23:30.525913] [INFO ] [REMOTE ] AWR: Full fetch complete (31953 records). [2025-09-29T17:23:30.526126] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-29T17:23:30.748407] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-29T17:23:30.979848] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-29T17:23:30.980369] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T17:23:30.985756] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-29T17:23:30.987013] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-29T17:23:30.987102] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-29T17:23:30.988604] [DEBUG] [LOCAL ] AWR: Trimmed 31953 records to 22508 (keeping 200 days of data) [2025-09-29T17:23:31.133293] [DEBUG] [LOCAL ] AWR: Primary data saved (22508 records). [2025-09-29T17:23:31.133467] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-29T17:23:31.133618] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 20.4s. Estimated remaining: 4h 23m 22s. Rate: 8.3 symbols/min [2025-09-29T17:23:31.317885] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:31.324503] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-29T17:23:31.324735] [INFO ] [MAIN ] AXR: Loaded 3220 existing records. [2025-09-29T17:23:31.508091] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:31.508350] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-29T17:23:31.508400] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-29T17:23:31.508634] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-29T17:23:31.508746] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-29T17:23:31.553306] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-29T17:23:31.897130] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:32.348123] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-29T17:23:32.583289] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:23:32.618395] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T17:23:32.967491] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T17:23:33.148155] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-29T17:23:33.948115] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-29T17:23:34.698661] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T17:23:34.748072] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-29T17:23:35.548098] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-29T17:23:35.993163] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T17:23:36.107053] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T17:23:36.348115] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-29T17:23:36.827722] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:23:37.148108] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-29T17:23:37.704687] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T17:23:37.948107] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-29T17:23:38.748762] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-29T17:23:38.748676] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T17:23:38.756715] [INFO ] [REMOTE ] AX: Full fetch complete (42682 records). [2025-09-29T17:23:38.756842] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-29T17:23:39.196768] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-29T17:23:39.196870] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-29T17:23:39.197449] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-29T17:23:39.197515] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-29T17:23:39.198463] [DEBUG] [LOCAL ] AX: Trimmed 42682 records to 28381 (keeping 200 days of data) [2025-09-29T17:23:39.371152] [DEBUG] [LOCAL ] AX: Primary data saved (28381 records). [2025-09-29T17:23:39.371294] [INFO ] [MAIN ] AX: Full history saved. [2025-09-29T17:23:39.371378] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 27.8s. Estimated remaining: 4h 23m 26s. Rate: 8.3 symbols/min [2025-09-29T17:23:39.550100] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:39.550235] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-29T17:23:39.593044] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-29T17:23:39.593359] [INFO ] [MAIN ] AXS: Loaded 38920 existing records. [2025-09-29T17:23:39.791707] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:39.792013] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-29T17:23:39.792075] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-29T17:23:39.795806] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-29T17:23:39.795879] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-29T17:23:40.185868] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:40.223042] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T17:23:40.226898] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-29T17:23:40.348149] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-29T17:23:41.150166] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-29T17:23:41.154032] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-29T17:23:41.165708] [INFO ] [REMOTE ] AXL: Full fetch complete (72613 records). [2025-09-29T17:23:41.165861] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-29T17:23:41.561328] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-29T17:23:41.561449] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-29T17:23:41.562536] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-29T17:23:41.562611] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-29T17:23:41.564626] [DEBUG] [LOCAL ] AXL: Trimmed 72613 records to 50519 (keeping 200 days of data) [2025-09-29T17:23:41.864814] [DEBUG] [LOCAL ] AXL: Primary data saved (50519 records). [2025-09-29T17:23:41.865058] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-29T17:23:41.865207] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 25.7s. Estimated remaining: 4h 22m 26s. Rate: 8.3 symbols/min [2025-09-29T17:23:41.962561] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-29T17:23:42.052227] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:42.119954] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-29T17:23:42.120460] [INFO ] [MAIN ] AXTA: Loaded 52835 existing records. [2025-09-29T17:23:42.307784] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:42.308400] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-29T17:23:42.308511] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-29T17:23:42.309306] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-29T17:23:42.309373] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-29T17:23:42.567035] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T17:23:42.711830] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:42.748374] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-29T17:23:42.749783] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-29T17:23:42.887315] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T17:23:43.548171] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-29T17:23:44.348095] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-29T17:23:44.775232] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T17:23:44.790436] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T17:23:44.983100] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T17:23:45.148178] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-29T17:23:45.948131] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-29T17:23:46.748129] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-29T17:23:46.786963] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:23:46.813628] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T17:23:47.548162] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-29T17:23:48.348112] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-29T17:23:48.861717] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T17:23:48.910329] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T17:23:48.934059] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T17:23:49.148138] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-29T17:23:49.948128] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-29T17:23:50.507191] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T17:23:50.743837] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:23:50.751824] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-29T17:23:51.548134] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-29T17:23:52.321214] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:23:52.348087] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-29T17:23:53.091976] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:23:53.148132] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-29T17:23:53.948140] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-29T17:23:54.088172] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:23:54.495634] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T17:23:54.748116] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-29T17:23:55.107587] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-29T17:23:55.548155] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-29T17:23:56.066504] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T17:23:56.233560] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T17:23:56.348076] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-29T17:23:57.148119] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-29T17:23:57.698108] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:23:57.948110] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-29T17:23:58.748120] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-29T17:23:59.233672] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T17:23:59.313814] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T17:23:59.548092] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-29T17:24:00.348093] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-29T17:24:00.441373] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:24:01.148097] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-29T17:24:01.613551] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:24:01.948131] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-29T17:24:02.139799] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:24:02.399183] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T17:24:02.400836] [INFO ] [REMOTE ] AXR: Full fetch complete (4968 records). [2025-09-29T17:24:02.400909] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-29T17:24:02.754134] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-29T17:24:02.874449] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-29T17:24:02.874673] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-29T17:24:02.874866] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-29T17:24:02.875065] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-29T17:24:02.895365] [DEBUG] [LOCAL ] AXR: Trimmed 4968 records to 3112 (keeping 200 days of data) [2025-09-29T17:24:02.899783] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T17:24:02.928527] [DEBUG] [LOCAL ] AXR: Primary data saved (3112 records). [2025-09-29T17:24:02.928712] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-29T17:24:02.928826] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 31.8s. Estimated remaining: 4h 24m 51s. Rate: 8.2 symbols/min [2025-09-29T17:24:03.548136] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-29T17:24:04.348168] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-29T17:24:04.451429] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:24:05.148162] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-29T17:24:05.902885] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-29T17:24:05.913913] [INFO ] [REMOTE ] AXP: Full fetch complete (76892 records). [2025-09-29T17:24:05.914077] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-29T17:24:06.274403] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T17:24:06.323590] [INFO ] [REMOTE ] AXS: Full fetch complete (55610 records). [2025-09-29T17:24:06.339486] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-29T17:24:06.460256] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-29T17:24:06.460390] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-29T17:24:06.461614] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-29T17:24:06.461770] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-29T17:24:06.475687] [DEBUG] [LOCAL ] AXP: Trimmed 76892 records to 53201 (keeping 200 days of data) [2025-09-29T17:24:07.192200] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T17:24:07.289268] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-29T17:24:07.315204] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-29T17:24:07.315447] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-29T17:24:07.317180] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-29T17:24:07.317875] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-29T17:24:07.320740] [DEBUG] [LOCAL ] AXS: Trimmed 55610 records to 38385 (keeping 200 days of data) [2025-09-29T17:24:07.787707] [DEBUG] [LOCAL ] AXS: Primary data saved (38385 records). [2025-09-29T17:24:07.789159] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-29T17:24:07.793082] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXS took 28.4s. Estimated remaining: 4h 24m 17s. Rate: 8.2 symbols/min [2025-09-29T17:24:07.806220] [DEBUG] [LOCAL ] AXP: Primary data saved (53201 records). [2025-09-29T17:24:07.806401] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-29T17:24:07.810129] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXP took 47.3s. Estimated remaining: 4h 22m 50s. Rate: 8.3 symbols/min [2025-09-29T17:24:09.061405] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:24:09.073090] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-29T17:24:10.819319] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T17:24:10.830190] [INFO ] [REMOTE ] AXTA: Full fetch complete (74929 records). [2025-09-29T17:24:10.830343] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-29T17:24:11.248524] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-29T17:24:11.248691] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-29T17:24:11.249540] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-29T17:24:11.249614] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-29T17:24:11.254541] [DEBUG] [LOCAL ] AXTA: Trimmed 74929 records to 52065 (keeping 200 days of data) [2025-09-29T17:24:11.567623] [DEBUG] [LOCAL ] AXTA: Primary data saved (52065 records). [2025-09-29T17:24:11.567830] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-29T17:24:11.567971] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 29.7s. Estimated remaining: 4h 22m 5s. Rate: 8.3 symbols/min [2025-09-29T17:24:12.239459] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:12.164906] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:12.265318] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-29T17:24:12.309435] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-29T17:24:12.327122] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:12.327603] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-29T17:24:12.335613] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-29T17:24:12.364804] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:12.368193] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-29T17:24:12.368305] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-29T17:24:12.474811] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-29T17:24:12.503317] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-29T17:24:12.502863] [INFO ] [MAIN ] AZO: Loaded 11687 existing records. [2025-09-29T17:24:12.509463] [INFO ] [MAIN ] AZZ: Loaded 22359 existing records. [2025-09-29T17:24:12.938991] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-29T17:24:13.060807] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:13.049313] [INFO ] [MAIN ] AYI: Loaded 25446 existing records. [2025-09-29T17:24:13.094905] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:13.100436] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-29T17:24:13.116219] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-29T17:24:13.141934] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-29T17:24:13.152432] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-29T17:24:13.165707] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-29T17:24:13.165815] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-29T17:24:13.203773] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-29T17:24:13.250186] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-29T17:24:13.549385] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:13.585912] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-29T17:24:13.770902] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:13.791332] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-29T17:24:13.796610] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-29T17:24:13.833713] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-29T17:24:13.844086] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-29T17:24:14.295527] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:14.326544] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-29T17:24:14.459832] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:14.472014] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-29T17:24:14.638880] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:14.639190] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-29T17:24:14.926303] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T17:24:14.934046] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-29T17:24:15.486760] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T17:24:15.491030] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-29T17:24:15.794719] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T17:24:15.799181] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-29T17:24:15.816986] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T17:24:15.824125] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-29T17:24:15.909842] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T17:24:15.915400] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-29T17:24:16.029289] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:24:16.029598] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-29T17:24:16.029707] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:24:16.029787] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-29T17:24:16.029829] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:24:16.029868] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-29T17:24:16.029927] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-29T17:24:16.029963] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-29T17:24:16.030046] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-29T17:24:16.030117] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.4s. Estimated remaining: 4h 21m 28s. Rate: 8.3 symbols/min [2025-09-29T17:24:16.213857] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:16.276303] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-29T17:24:16.276724] [INFO ] [MAIN ] BA: Loaded 54571 existing records. [2025-09-29T17:24:16.402887] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T17:24:16.436082] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-29T17:24:16.481243] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:16.481453] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-29T17:24:16.481501] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-29T17:24:16.489574] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-29T17:24:16.489660] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-29T17:24:16.870415] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:16.870783] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-29T17:24:17.069740] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T17:24:17.074013] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-29T17:24:17.318372] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T17:24:17.321253] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-29T17:24:17.396019] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:24:17.874346] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T17:24:17.948140] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-29T17:24:18.515022] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T17:24:18.748134] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-29T17:24:19.014588] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:24:19.454766] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-29T17:24:19.548085] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-29T17:24:19.871333] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T17:24:20.348147] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-29T17:24:21.148134] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-29T17:24:21.713151] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T17:24:21.933628] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-29T17:24:21.948064] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-29T17:24:22.177199] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T17:24:22.748114] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-29T17:24:23.548131] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-29T17:24:23.609484] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T17:24:24.124136] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-29T17:24:24.348098] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-29T17:24:24.527716] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T17:24:25.148101] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-29T17:24:25.343390] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:24:25.948109] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-29T17:24:26.306162] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T17:24:26.748094] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-29T17:24:26.825329] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T17:24:27.548091] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-29T17:24:27.564353] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T17:24:28.348150] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-29T17:24:29.035824] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T17:24:29.148156] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-29T17:24:29.519728] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T17:24:29.935138] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T17:24:29.948081] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-29T17:24:30.748119] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-29T17:24:31.270325] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:24:31.548112] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-29T17:24:32.348140] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-29T17:24:32.401931] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:24:32.790004] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T17:24:33.148082] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-29T17:24:33.549056] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T17:24:33.948114] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-29T17:24:34.748109] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-29T17:24:35.225129] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T17:24:35.229520] [INFO ] [REMOTE ] AZZ: Full fetch complete (30875 records). [2025-09-29T17:24:35.229605] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-29T17:24:35.550385] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-29T17:24:35.619357] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-29T17:24:35.619767] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-29T17:24:35.620423] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-29T17:24:35.620515] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-29T17:24:35.635585] [DEBUG] [LOCAL ] AZZ: Trimmed 30875 records to 21975 (keeping 200 days of data) [2025-09-29T17:24:35.636544] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T17:24:35.782699] [DEBUG] [LOCAL ] AZZ: Primary data saved (21975 records). [2025-09-29T17:24:35.783002] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-29T17:24:35.783172] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZZ took 24.2s. Estimated remaining: 4h 23m 35s. Rate: 8.2 symbols/min [2025-09-29T17:24:35.989280] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:36.011992] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-29T17:24:36.087752] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-29T17:24:36.088185] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-09-29T17:24:36.274293] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:36.274566] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-29T17:24:36.274701] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-29T17:24:36.281699] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-29T17:24:36.281836] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-29T17:24:36.350225] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-29T17:24:36.522629] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T17:24:36.680242] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:37.148119] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-29T17:24:37.948125] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-29T17:24:38.748112] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-29T17:24:38.955620] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-29T17:24:39.208085] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T17:24:39.213734] [INFO ] [REMOTE ] AYI: Full fetch complete (36682 records). [2025-09-29T17:24:39.213912] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-29T17:24:39.552618] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-29T17:24:39.668746] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-29T17:24:39.668903] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-29T17:24:39.677165] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T17:24:39.676854] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-29T17:24:39.680910] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-29T17:24:39.681199] [INFO ] [REMOTE ] AZO: Full fetch complete (16292 records). [2025-09-29T17:24:39.681502] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-29T17:24:39.711770] [DEBUG] [LOCAL ] AYI: Trimmed 36682 records to 25060 (keeping 200 days of data) [2025-09-29T17:24:40.078265] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-09-29T17:24:40.327956] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-29T17:24:40.328875] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-29T17:24:40.329542] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-29T17:24:40.329627] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-29T17:24:40.336003] [DEBUG] [LOCAL ] AZO: Trimmed 16292 records to 11372 (keeping 200 days of data) [2025-09-29T17:24:40.335863] [DEBUG] [LOCAL ] AYI: Primary data saved (25060 records). [2025-09-29T17:24:40.336511] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-29T17:24:40.336891] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 28.8s. Estimated remaining: 4h 22m 58s. Rate: 8.2 symbols/min [2025-09-29T17:24:40.373007] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-29T17:24:40.553791] [DEBUG] [LOCAL ] AZO: Primary data saved (11372 records). [2025-09-29T17:24:40.583688] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-29T17:24:40.600437] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AZO took 29.0s. Estimated remaining: 4h 21m 37s. Rate: 8.3 symbols/min [2025-09-29T17:24:40.604290] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:40.792355] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:40.841245] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-29T17:24:40.841701] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-09-29T17:24:41.074577] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:41.076191] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-29T17:24:41.076303] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-29T17:24:41.076012] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-29T17:24:41.076759] [INFO ] [MAIN ] BAH: Loaded 52477 existing records. [2025-09-29T17:24:41.113737] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-29T17:24:41.150216] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-29T17:24:41.400885] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:41.427307] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-29T17:24:41.432596] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-29T17:24:41.459114] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-29T17:24:41.469886] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-29T17:24:41.904786] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:41.928290] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-29T17:24:42.143859] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:42.144374] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-29T17:24:42.196918] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-29T17:24:42.748120] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-29T17:24:42.981818] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-29T17:24:43.548140] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-29T17:24:43.702284] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:24:44.348164] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-29T17:24:44.551832] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-29T17:24:44.789344] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T17:24:45.148162] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-29T17:24:45.777806] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-29T17:24:45.948133] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-29T17:24:46.238772] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T17:24:46.748122] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-29T17:24:47.437430] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-29T17:24:47.548160] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-29T17:24:48.348080] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-29T17:24:48.684639] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-29T17:24:49.148072] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-29T17:24:49.256750] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-29T17:24:49.716156] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-29T17:24:49.948092] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-29T17:24:49.951003] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:24:50.748153] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-29T17:24:51.548148] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-29T17:24:51.857782] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-29T17:24:52.246109] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-29T17:24:52.257448] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-29T17:24:52.257614] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-29T17:24:52.354193] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-29T17:24:52.692753] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-29T17:24:52.692870] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-29T17:24:52.694080] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-29T17:24:52.694182] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-29T17:24:52.696084] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 53791 (keeping 200 days of data) [2025-09-29T17:24:53.051830] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-29T17:24:53.051984] [INFO ] [MAIN ] BA: Full history saved. [2025-09-29T17:24:53.052075] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 37.0s. Estimated remaining: 4h 22m 24s. Rate: 8.3 symbols/min [2025-09-29T17:24:53.251349] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:53.285375] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:24:53.297748] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-29T17:24:53.345444] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-29T17:24:53.372064] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-29T17:24:53.372370] [INFO ] [MAIN ] BAK: Loaded 39413 existing records. [2025-09-29T17:24:53.568013] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:53.568234] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-29T17:24:53.568288] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-29T17:24:53.571990] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-29T17:24:53.572061] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-29T17:24:53.956189] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-29T17:24:53.981420] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:54.748122] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-29T17:24:55.220599] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-09-29T17:24:55.562191] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-29T17:24:55.565504] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T17:24:56.286107] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-29T17:24:56.348079] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-29T17:24:56.458153] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T17:24:57.148142] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-29T17:24:57.948130] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-29T17:24:58.157697] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-29T17:24:58.607507] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T17:24:58.748162] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-29T17:24:58.870870] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-29T17:24:59.548176] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-29T17:24:59.776874] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:25:00.348170] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-29T17:25:01.148131] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-29T17:25:01.444534] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-29T17:25:01.497877] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T17:25:01.848835] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-29T17:25:01.948194] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-29T17:25:02.748149] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-29T17:25:02.998328] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:25:03.548141] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-29T17:25:04.348145] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-29T17:25:04.882254] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-09-29T17:25:05.148142] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-29T17:25:05.501182] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T17:25:05.576721] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T17:25:05.891904] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-09-29T17:25:05.948103] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-29T17:25:06.748163] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-29T17:25:07.548144] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-29T17:25:08.117092] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-29T17:25:08.131909] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-29T17:25:08.132052] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-29T17:25:08.604540] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-29T17:25:08.637251] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-29T17:25:08.643586] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-29T17:25:08.657075] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-29T17:25:08.657420] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-29T17:25:08.690084] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-29T17:25:08.692220] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-09-29T17:25:08.693730] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-29T17:25:09.102425] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-29T17:25:09.102622] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-29T17:25:09.103722] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BABA took 33.3s. Estimated remaining: 4h 23m 50s. Rate: 8.2 symbols/min [2025-09-29T17:25:09.150269] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-29T17:25:09.321171] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:25:09.350605] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:09.410590] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-29T17:25:09.410995] [INFO ] [MAIN ] BALL: Loaded 52583 existing records. [2025-09-29T17:25:09.621502] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:09.621823] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-29T17:25:09.621874] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-29T17:25:09.628684] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-29T17:25:09.628762] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-29T17:25:09.953294] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-29T17:25:10.058268] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:10.748178] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-29T17:25:11.230143] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T17:25:11.241723] [INFO ] [REMOTE ] BAH: Full fetch complete (74827 records). [2025-09-29T17:25:11.241975] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-29T17:25:11.340666] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-29T17:25:11.422464] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-29T17:25:11.463930] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-29T17:25:11.980994] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T17:25:12.074277] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-29T17:25:12.080173] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-29T17:25:12.082029] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-29T17:25:12.082474] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-29T17:25:12.096017] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-29T17:25:12.190390] [DEBUG] [LOCAL ] BAH: Trimmed 74827 records to 51698 (keeping 200 days of data) [2025-09-29T17:25:12.414518] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-29T17:25:12.414980] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-29T17:25:12.416081] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-29T17:25:12.416805] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-29T17:25:12.423319] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-09-29T17:25:12.723667] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T17:25:12.741005] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-29T17:25:13.078736] [DEBUG] [LOCAL ] BAH: Primary data saved (51698 records). [2025-09-29T17:25:13.079695] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-29T17:25:13.080776] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAH took 32.5s. Estimated remaining: 4h 23m 7s. Rate: 8.2 symbols/min [2025-09-29T17:25:13.283310] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:13.287233] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-29T17:25:13.287711] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-29T17:25:13.295136] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-29T17:25:13.295526] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-29T17:25:13.296223] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-29T17:25:13.296536] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-29T17:25:13.371430] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-29T17:25:13.411222] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-29T17:25:13.417802] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAC took 33.1s. Estimated remaining: 4h 21m 48s. Rate: 8.3 symbols/min [2025-09-29T17:25:13.818639] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:13.901392] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:13.902073] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-29T17:25:13.927592] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:25:13.957788] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-29T17:25:13.982181] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-29T17:25:13.982522] [INFO ] [MAIN ] BAM: Loaded 52779 existing records. [2025-09-29T17:25:14.173596] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:14.173816] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-29T17:25:14.173864] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-29T17:25:14.181218] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-29T17:25:14.181288] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-29T17:25:14.578970] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:14.619743] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:25:14.748157] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-29T17:25:15.083157] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T17:25:15.504815] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T17:25:15.548132] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-29T17:25:16.348137] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-29T17:25:16.502968] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:25:17.109941] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:25:17.148166] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-29T17:25:17.427867] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T17:25:17.948137] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-29T17:25:18.607923] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T17:25:18.748121] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-29T17:25:18.956378] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:25:19.548156] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-29T17:25:20.084093] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:25:20.348117] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-29T17:25:21.148091] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-29T17:25:21.359009] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T17:25:21.948160] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-29T17:25:22.050003] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T17:25:22.058289] [INFO ] [REMOTE ] BAK: Full fetch complete (57024 records). [2025-09-29T17:25:22.058471] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-29T17:25:22.536672] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-29T17:25:22.537415] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-29T17:25:22.538709] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-29T17:25:22.538834] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-29T17:25:22.537770] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T17:25:22.543151] [DEBUG] [LOCAL ] BAK: Trimmed 57024 records to 39012 (keeping 200 days of data) [2025-09-29T17:25:22.749623] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-29T17:25:22.790977] [DEBUG] [LOCAL ] BAK: Primary data saved (39012 records). [2025-09-29T17:25:22.791135] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-29T17:25:22.791254] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BAK took 29.7s. Estimated remaining: 4h 22m 2s. Rate: 8.3 symbols/min [2025-09-29T17:25:22.986718] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:23.025946] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:25:23.102114] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-29T17:25:23.102499] [INFO ] [MAIN ] BANC: Loaded 52019 existing records. [2025-09-29T17:25:23.306417] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:23.306691] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-29T17:25:23.306790] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-29T17:25:23.312545] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-29T17:25:23.312612] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-29T17:25:23.554312] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-29T17:25:23.589348] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T17:25:23.702513] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:24.348161] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-29T17:25:25.148113] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-29T17:25:25.528299] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T17:25:25.948087] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-29T17:25:26.341342] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T17:25:26.361170] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-29T17:25:26.748117] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-29T17:25:27.548088] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-29T17:25:27.732588] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:25:28.348089] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-29T17:25:28.522078] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T17:25:28.521800] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T17:25:29.148112] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-29T17:25:29.663223] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:25:29.948115] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-29T17:25:30.748092] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-29T17:25:30.777777] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:25:31.548144] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-29T17:25:31.688988] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:25:32.332658] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T17:25:32.348087] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-29T17:25:32.480480] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T17:25:33.148119] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-29T17:25:33.948120] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-29T17:25:34.043288] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T17:25:34.599130] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T17:25:34.748106] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-29T17:25:35.548121] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-29T17:25:35.671292] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T17:25:36.348124] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-29T17:25:36.706853] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T17:25:37.148124] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-29T17:25:37.535870] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T17:25:37.547625] [INFO ] [REMOTE ] BALL: Full fetch complete (75358 records). [2025-09-29T17:25:37.547866] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-29T17:25:37.960010] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-29T17:25:37.985930] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-29T17:25:37.987142] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-29T17:25:37.988166] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-29T17:25:37.988667] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-29T17:25:37.990593] [DEBUG] [LOCAL ] BALL: Trimmed 75358 records to 51786 (keeping 200 days of data) [2025-09-29T17:25:38.090674] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:25:38.373250] [DEBUG] [LOCAL ] BALL: Primary data saved (51786 records). [2025-09-29T17:25:38.373432] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-29T17:25:38.374124] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALL took 29.3s. Estimated remaining: 4h 23m 21s. Rate: 8.2 symbols/min [2025-09-29T17:25:38.564380] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:38.593735] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-29T17:25:38.594023] [INFO ] [MAIN ] BAP: Loaded 26635 existing records. [2025-09-29T17:25:38.751753] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-29T17:25:38.820129] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:38.821383] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T17:25:38.821681] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-29T17:25:38.821864] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-29T17:25:38.828118] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-29T17:25:38.828220] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-29T17:25:39.161672] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T17:25:39.259503] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:39.548148] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-29T17:25:40.348142] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-29T17:25:40.592067] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T17:25:40.808621] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T17:25:41.148137] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-29T17:25:41.744639] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T17:25:41.948146] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-29T17:25:42.748071] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-29T17:25:42.927142] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T17:25:43.548092] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-29T17:25:43.835669] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T17:25:43.988509] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T17:25:44.187599] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T17:25:44.190744] [INFO ] [REMOTE ] BALY: Full fetch complete (17074 records). [2025-09-29T17:25:44.190888] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-29T17:25:44.357820] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-29T17:25:44.395597] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T17:25:44.396261] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:25:44.396334] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:25:44.396409] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-29T17:25:44.396477] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-29T17:25:44.396516] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-29T17:25:44.396599] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-29T17:25:44.396716] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALY took 31.3s. Estimated remaining: 4h 23m 0s. Rate: 8.2 symbols/min [2025-09-29T17:25:44.574176] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:44.611523] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-29T17:25:44.611876] [INFO ] [MAIN ] BARK: Loaded 38893 existing records. [2025-09-29T17:25:44.809604] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:44.809865] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-29T17:25:44.809936] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-29T17:25:44.813850] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-29T17:25:44.813936] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-29T17:25:45.153246] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-29T17:25:45.215144] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:45.948130] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-29T17:25:46.042182] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T17:25:46.748120] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-29T17:25:47.110269] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T17:25:47.159122] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T17:25:47.548145] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-29T17:25:48.348155] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-29T17:25:48.646798] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:25:48.664410] [INFO ] [REMOTE ] BAM: Full fetch complete (74187 records). [2025-09-29T17:25:48.664635] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-29T17:25:49.125230] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-29T17:25:49.125385] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-29T17:25:49.126393] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-29T17:25:49.126586] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-29T17:25:49.132085] [DEBUG] [LOCAL ] BAM: Trimmed 74187 records to 51993 (keeping 200 days of data) [2025-09-29T17:25:49.187276] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-29T17:25:49.263373] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:25:49.497061] [DEBUG] [LOCAL ] BAM: Primary data saved (51993 records). [2025-09-29T17:25:49.497219] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-29T17:25:49.497305] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BAM took 36.1s. Estimated remaining: 4h 22m 30s. Rate: 8.2 symbols/min [2025-09-29T17:25:49.691713] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:49.693731] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T17:25:49.752966] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-29T17:25:49.753314] [INFO ] [MAIN ] BAX: Loaded 54273 existing records. [2025-09-29T17:25:49.944828] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:49.945061] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-29T17:25:49.945110] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-29T17:25:49.948127] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-29T17:25:49.951273] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-29T17:25:49.951356] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-29T17:25:50.342947] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:50.748160] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-29T17:25:51.194195] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T17:25:51.205418] [INFO ] [REMOTE ] BANC: Full fetch complete (74203 records). [2025-09-29T17:25:51.205566] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-29T17:25:51.551683] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-29T17:25:51.653812] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-29T17:25:51.653953] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-29T17:25:51.654959] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-29T17:25:51.655164] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-29T17:25:51.657579] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:25:51.668044] [DEBUG] [LOCAL ] BANC: Trimmed 74203 records to 51232 (keeping 200 days of data) [2025-09-29T17:25:51.995411] [DEBUG] [LOCAL ] BANC: Primary data saved (51232 records). [2025-09-29T17:25:51.995567] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-29T17:25:51.995682] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 29.2s. Estimated remaining: 4h 21m 34s. Rate: 8.3 symbols/min [2025-09-29T17:25:52.190669] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:52.253018] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-29T17:25:52.253355] [INFO ] [MAIN ] BB: Loaded 53701 existing records. [2025-09-29T17:25:52.357009] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-29T17:25:52.466309] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:52.466840] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-29T17:25:52.466981] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-29T17:25:52.467528] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-29T17:25:52.467588] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-29T17:25:52.866330] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:52.892174] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-29T17:25:53.038198] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T17:25:53.148159] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-29T17:25:53.948109] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-29T17:25:53.984908] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:25:54.400710] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T17:25:54.748126] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-29T17:25:55.391836] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:25:55.548088] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-29T17:25:55.867976] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T17:25:56.348139] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-29T17:25:56.709254] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T17:25:57.148110] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-29T17:25:57.948165] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-29T17:25:58.559622] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-29T17:25:58.643030] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:25:58.748085] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-29T17:25:59.179749] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T17:25:59.548143] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-29T17:26:00.360197] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-29T17:26:00.368005] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T17:26:00.829686] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:26:01.148152] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-29T17:26:01.948148] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-29T17:26:02.445232] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-29T17:26:02.643909] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T17:26:02.748151] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-29T17:26:03.132368] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T17:26:03.138573] [INFO ] [REMOTE ] BAP: Full fetch complete (37745 records). [2025-09-29T17:26:03.138731] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-29T17:26:03.527723] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-29T17:26:03.527832] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-29T17:26:03.528405] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-29T17:26:03.528448] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-29T17:26:03.529551] [DEBUG] [LOCAL ] BAP: Trimmed 37745 records to 26168 (keeping 200 days of data) [2025-09-29T17:26:03.585472] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-29T17:26:03.702373] [DEBUG] [LOCAL ] BAP: Primary data saved (26168 records). [2025-09-29T17:26:03.702609] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-29T17:26:03.702755] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 25.3s. Estimated remaining: 4h 22m 12s. Rate: 8.2 symbols/min [2025-09-29T17:26:03.875812] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:03.945082] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-29T17:26:03.945685] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-09-29T17:26:04.123062] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:04.123387] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-29T17:26:04.123441] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-29T17:26:04.124155] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-29T17:26:04.124218] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-29T17:26:04.352734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-29T17:26:04.491223] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:04.808964] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:26:05.028634] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:26:05.148169] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-29T17:26:05.948187] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-29T17:26:06.137593] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:26:06.748098] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-29T17:26:06.883530] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:26:07.548141] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-29T17:26:08.348147] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-29T17:26:08.749101] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-09-29T17:26:08.906199] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-29T17:26:09.148156] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-29T17:26:09.328395] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T17:26:09.948105] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-29T17:26:10.153718] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T17:26:10.748209] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-29T17:26:11.125665] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-29T17:26:11.548105] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-29T17:26:11.935516] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T17:26:12.348179] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-29T17:26:13.148101] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-29T17:26:13.272619] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-29T17:26:13.513161] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T17:26:13.948102] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-29T17:26:14.407819] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T17:26:14.748084] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-29T17:26:14.950621] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T17:26:15.379383] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:26:15.548121] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-29T17:26:16.348102] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-29T17:26:16.449511] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:26:17.148131] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-29T17:26:17.530227] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:26:17.541553] [INFO ] [REMOTE ] BAX: Full fetch complete (77052 records). [2025-09-29T17:26:17.541715] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-29T17:26:17.542552] [FATAL] [VALIDATOR ] BAX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:26:17.542664] [FATAL] [MAIN ] BAX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:26:17.542734] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:26:17.542823] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-29T17:26:17.542923] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-29T17:26:17.542978] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-09-29T17:26:17.543883] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-09-29T17:26:17.544142] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BAX took 28.0s. Estimated remaining: 4h 23m 10s. Rate: 8.2 symbols/min [2025-09-29T17:26:17.727492] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:17.777089] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-29T17:26:17.777489] [INFO ] [MAIN ] BBAR: Loaded 41988 existing records. [2025-09-29T17:26:17.956452] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-29T17:26:17.963773] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:17.964051] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-29T17:26:17.964132] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-29T17:26:17.964564] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-29T17:26:17.964621] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-29T17:26:18.348181] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:18.737101] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-29T17:26:18.748054] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-29T17:26:18.988438] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T17:26:19.548124] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-29T17:26:19.593369] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:26:19.601278] [INFO ] [REMOTE ] BARK: Full fetch complete (56710 records). [2025-09-29T17:26:19.601447] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-29T17:26:20.015526] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-29T17:26:20.015609] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-29T17:26:20.016305] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-29T17:26:20.016372] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-29T17:26:20.017586] [DEBUG] [LOCAL ] BARK: Trimmed 56710 records to 38149 (keeping 200 days of data) [2025-09-29T17:26:20.249906] [DEBUG] [LOCAL ] BARK: Primary data saved (38149 records). [2025-09-29T17:26:20.250765] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-29T17:26:20.251506] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BARK took 35.9s. Estimated remaining: 4h 22m 17s. Rate: 8.2 symbols/min [2025-09-29T17:26:20.356174] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-29T17:26:20.440613] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:20.499966] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-29T17:26:20.500366] [INFO ] [MAIN ] BBD: Loaded 53959 existing records. [2025-09-29T17:26:20.698265] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:20.698592] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-29T17:26:20.698666] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-29T17:26:20.699239] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-29T17:26:20.699312] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-29T17:26:21.120638] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:21.148099] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-29T17:26:21.266916] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:26:21.330420] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-29T17:26:21.948111] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-29T17:26:22.434570] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:26:22.625532] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T17:26:22.748133] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-29T17:26:23.167837] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T17:26:23.548132] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-29T17:26:24.348117] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-29T17:26:24.848992] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-29T17:26:24.860096] [INFO ] [REMOTE ] BB: Full fetch complete (76984 records). [2025-09-29T17:26:24.860244] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-29T17:26:25.152437] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-29T17:26:25.298408] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-29T17:26:25.298532] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-29T17:26:25.299621] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-29T17:26:25.299763] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-29T17:26:25.330280] [DEBUG] [LOCAL ] BB: Trimmed 76984 records to 52924 (keeping 200 days of data) [2025-09-29T17:26:25.331588] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T17:26:25.676980] [DEBUG] [LOCAL ] BB: Primary data saved (52924 records). [2025-09-29T17:26:25.677133] [INFO ] [MAIN ] BB: Full history saved. [2025-09-29T17:26:25.677219] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 33.7s. Estimated remaining: 4h 21m 51s. Rate: 8.2 symbols/min [2025-09-29T17:26:25.853871] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:25.893757] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-29T17:26:25.894052] [INFO ] [MAIN ] BBDC: Loaded 33756 existing records. [2025-09-29T17:26:25.960394] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-29T17:26:26.084156] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:26.084458] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-29T17:26:26.084510] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-29T17:26:26.085186] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-29T17:26:26.085251] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-29T17:26:26.458901] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:26.747686] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:26:26.755781] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-29T17:26:27.028149] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-29T17:26:27.548080] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-29T17:26:27.660509] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:26:28.296736] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T17:26:28.348124] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-29T17:26:28.986817] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T17:26:29.148119] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-29T17:26:29.948106] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-29T17:26:30.207937] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T17:26:30.748114] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-29T17:26:31.548123] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-29T17:26:31.648964] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T17:26:32.082504] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-29T17:26:32.171120] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:26:32.348112] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-29T17:26:32.577500] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T17:26:33.148120] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-29T17:26:33.948108] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-29T17:26:34.571030] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:26:34.748133] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-29T17:26:35.108810] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-29T17:26:35.548122] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-29T17:26:35.952245] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T17:26:36.348146] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-29T17:26:36.469628] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T17:26:37.148127] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-29T17:26:37.948097] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-29T17:26:38.019940] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-29T17:26:38.058973] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T17:26:38.753919] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-29T17:26:38.757483] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T17:26:39.402235] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T17:26:39.548108] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-29T17:26:40.348150] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-29T17:26:41.148094] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-29T17:26:41.326189] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T17:26:41.421893] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-29T17:26:41.948093] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-29T17:26:42.198525] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:26:42.244742] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T17:26:42.748151] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-29T17:26:43.492271] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T17:26:43.548078] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-29T17:26:44.353346] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-29T17:26:44.370916] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T17:26:45.148102] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-29T17:26:45.531232] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:26:45.543973] [INFO ] [REMOTE ] BBD: Full fetch complete (77115 records). [2025-09-29T17:26:45.544170] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-29T17:26:45.950493] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-29T17:26:45.994776] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-29T17:26:45.995803] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-29T17:26:45.997442] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T17:26:45.998691] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-29T17:26:46.007905] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-29T17:26:46.009796] [DEBUG] [LOCAL ] BBD: Trimmed 77115 records to 53196 (keeping 200 days of data) [2025-09-29T17:26:46.332983] [DEBUG] [LOCAL ] BBD: Primary data saved (53196 records). [2025-09-29T17:26:46.333167] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-29T17:26:46.336413] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBD took 26.1s. Estimated remaining: 4h 23m 56s. Rate: 8.2 symbols/min [2025-09-29T17:26:46.519583] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:46.528129] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-29T17:26:46.528353] [INFO ] [MAIN ] BBDO: Loaded 5051 existing records. [2025-09-29T17:26:46.731604] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:46.732308] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-29T17:26:46.732402] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-29T17:26:46.732867] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-29T17:26:46.732972] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-29T17:26:46.769378] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-29T17:26:46.924447] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T17:26:47.155570] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:47.548122] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-29T17:26:48.091014] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:26:48.348183] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-29T17:26:48.491827] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T17:26:49.153882] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-29T17:26:49.174776] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (3.22 seconds). [2025-09-29T17:26:49.188750] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-29T17:26:49.188959] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-29T17:26:49.603772] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-29T17:26:49.603974] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-29T17:26:49.605030] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-29T17:26:49.605682] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-29T17:26:49.607712] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-29T17:26:49.813019] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T17:26:49.811863] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T17:26:49.950924] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-29T17:26:49.972071] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-29T17:26:49.972819] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-29T17:26:49.975493] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBAI took 46.3s. Estimated remaining: 4h 23m 12s. Rate: 8.2 symbols/min [2025-09-29T17:26:50.154549] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:50.176337] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-29T17:26:50.176605] [INFO ] [MAIN ] BBN: Loaded 18193 existing records. [2025-09-29T17:26:50.367352] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:50.367636] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-29T17:26:50.367730] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-29T17:26:50.367998] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-29T17:26:50.368058] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-29T17:26:50.750981] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-29T17:26:50.750867] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:51.353793] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T17:26:51.548121] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-29T17:26:51.591376] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:26:51.599882] [INFO ] [REMOTE ] BBDC: Full fetch complete (48846 records). [2025-09-29T17:26:51.600045] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-29T17:26:52.011516] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-29T17:26:52.011615] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-29T17:26:52.012346] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-29T17:26:52.012417] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-29T17:26:52.013776] [DEBUG] [LOCAL ] BBDC: Trimmed 48846 records to 33080 (keeping 200 days of data) [2025-09-29T17:26:52.222501] [DEBUG] [LOCAL ] BBDC: Primary data saved (33080 records). [2025-09-29T17:26:52.222668] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-29T17:26:52.222771] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDC took 26.5s. Estimated remaining: 4h 22m 15s. Rate: 8.2 symbols/min [2025-09-29T17:26:52.353257] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-29T17:26:52.411890] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:52.412076] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-29T17:26:52.412115] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-29T17:26:52.412265] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-29T17:26:52.412331] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-29T17:26:52.412406] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-29T17:26:52.412453] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-29T17:26:52.786912] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:53.129884] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T17:26:53.148074] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-29T17:26:53.400734] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T17:26:53.412352] [INFO ] [REMOTE ] BBAR: Full fetch complete (60781 records). [2025-09-29T17:26:53.412523] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-29T17:26:53.752998] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T17:26:53.845433] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-29T17:26:53.845526] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-29T17:26:53.846322] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-29T17:26:53.846395] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-29T17:26:53.847842] [DEBUG] [LOCAL ] BBAR: Trimmed 60781 records to 41378 (keeping 200 days of data) [2025-09-29T17:26:53.948213] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-29T17:26:54.123880] [DEBUG] [LOCAL ] BBAR: Primary data saved (41378 records). [2025-09-29T17:26:54.124024] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-29T17:26:54.124153] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBAR took 36.6s. Estimated remaining: 4h 21m 15s. Rate: 8.2 symbols/min [2025-09-29T17:26:54.309697] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:54.317588] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-29T17:26:54.317866] [INFO ] [MAIN ] BBU: Loaded 4478 existing records. [2025-09-29T17:26:54.513233] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:54.513495] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-29T17:26:54.513549] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-29T17:26:54.513862] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-29T17:26:54.513924] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-29T17:26:54.749814] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-29T17:26:54.835365] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T17:26:54.904845] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:55.021005] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:26:55.021311] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-29T17:26:55.021417] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:26:55.021552] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-29T17:26:55.021638] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:26:55.021755] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-29T17:26:55.021839] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-29T17:26:55.021880] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-29T17:26:55.021950] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-29T17:26:55.022010] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBT took 2.8s. Estimated remaining: 4h 20m 5s. Rate: 8.3 symbols/min [2025-09-29T17:26:55.201476] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:55.218057] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-29T17:26:55.218304] [INFO ] [MAIN ] BBUC: Loaded 13503 existing records. [2025-09-29T17:26:55.404052] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:55.404307] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-29T17:26:55.404365] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-29T17:26:55.404696] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-29T17:26:55.404756] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-29T17:26:55.553253] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-29T17:26:55.787815] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:56.348126] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-29T17:26:56.376548] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-29T17:26:57.148217] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-29T17:26:57.219065] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T17:26:57.582459] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T17:26:57.948103] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-29T17:26:58.652291] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:26:58.748139] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-29T17:26:59.548169] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-29T17:27:00.114121] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T17:27:00.155305] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T17:27:00.348204] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-29T17:27:01.138773] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-29T17:27:01.148124] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-29T17:27:01.738026] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T17:27:01.948127] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-29T17:27:02.364077] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T17:27:02.748118] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-29T17:27:03.335526] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T17:27:03.548155] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-29T17:27:04.269784] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T17:27:04.271322] [INFO ] [REMOTE ] BBDO: Full fetch complete (7676 records). [2025-09-29T17:27:04.271427] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-29T17:27:04.353210] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-29T17:27:04.721905] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-29T17:27:04.721993] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-29T17:27:04.722210] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-29T17:27:04.722253] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-29T17:27:04.722807] [DEBUG] [LOCAL ] BBDO: Trimmed 7676 records to 4954 (keeping 200 days of data) [2025-09-29T17:27:04.758985] [DEBUG] [LOCAL ] BBDO: Primary data saved (4954 records). [2025-09-29T17:27:04.759142] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-29T17:27:04.759276] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDO took 18.4s. Estimated remaining: 4h 20m 22s. Rate: 8.2 symbols/min [2025-09-29T17:27:04.942975] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T17:27:04.947592] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:05.016976] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-29T17:27:05.017379] [INFO ] [MAIN ] BBVA: Loaded 50167 existing records. [2025-09-29T17:27:05.162946] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-29T17:27:05.208072] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:05.208334] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-29T17:27:05.208384] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-29T17:27:05.209103] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-29T17:27:05.209164] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-29T17:27:05.585287] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:05.948107] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-29T17:27:06.053168] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:27:06.513293] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T17:27:06.748116] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-29T17:27:07.548092] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-29T17:27:07.856016] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:27:08.348156] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-29T17:27:08.554278] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T17:27:08.797725] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T17:27:09.148144] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-29T17:27:09.952334] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-29T17:27:09.955800] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T17:27:10.674382] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T17:27:10.748143] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-29T17:27:11.548140] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-29T17:27:11.820312] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:27:12.348080] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-29T17:27:12.402671] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T17:27:13.148114] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-29T17:27:13.405143] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T17:27:13.948128] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-29T17:27:14.748114] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-29T17:27:14.848163] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T17:27:14.850576] [INFO ] [REMOTE ] BBU: Full fetch complete (6478 records). [2025-09-29T17:27:14.850756] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-29T17:27:15.076471] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T17:27:15.308712] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-29T17:27:15.308822] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-29T17:27:15.309037] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-29T17:27:15.309128] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-29T17:27:15.309733] [DEBUG] [LOCAL ] BBU: Trimmed 6478 records to 4536 (keeping 200 days of data) [2025-09-29T17:27:15.340530] [DEBUG] [LOCAL ] BBU: Primary data saved (4536 records). [2025-09-29T17:27:15.340702] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-29T17:27:15.340849] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBU took 21.2s. Estimated remaining: 4h 20m 46s. Rate: 8.2 symbols/min [2025-09-29T17:27:15.528062] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:15.554477] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-29T17:27:15.567967] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-29T17:27:15.568259] [INFO ] [MAIN ] BBW: Loaded 27177 existing records. [2025-09-29T17:27:15.706862] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T17:27:15.777321] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:15.777713] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-29T17:27:15.777774] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-29T17:27:15.779061] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-29T17:27:15.779142] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-29T17:27:16.155718] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:16.348106] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-29T17:27:17.148141] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-29T17:27:17.291372] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T17:27:17.874364] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:27:17.948098] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-29T17:27:18.235126] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T17:27:18.748133] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-29T17:27:19.548141] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-29T17:27:19.642263] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:27:20.009257] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T17:27:20.348088] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-29T17:27:20.513468] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T17:27:21.148144] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-29T17:27:21.327107] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T17:27:21.948081] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-29T17:27:22.104833] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T17:27:22.748119] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-29T17:27:22.857239] [DEBUG] [REMOTE ] BBUC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-29T17:27:22.857673] [WARN ] [REMOTE ] BBUC: No data returned for month 2025-06 [2025-09-29T17:27:22.857766] [FATAL] [REMOTE ] BBUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:27:22.857912] [FATAL] [MAIN ] BBUC: Failed to fetch primary data. [2025-09-29T17:27:22.857984] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:27:22.858076] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-29T17:27:22.858199] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-09-29T17:27:22.858278] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-09-29T17:27:22.858961] [DEBUG] [LOCAL ] BBUC: Deleted derivative data file. [2025-09-29T17:27:22.859154] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBUC took 27.8s. Estimated remaining: 4h 20m 41s. Rate: 8.2 symbols/min [2025-09-29T17:27:23.042544] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:23.117433] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-29T17:27:23.117850] [INFO ] [MAIN ] BBWI: Loaded 54360 existing records. [2025-09-29T17:27:23.301854] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:23.302085] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-29T17:27:23.302135] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-29T17:27:23.303407] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-29T17:27:23.303481] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-29T17:27:23.556713] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-29T17:27:23.711749] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:23.759067] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:27:24.348128] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-29T17:27:24.414741] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T17:27:25.148116] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-29T17:27:25.950819] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-29T17:27:25.953359] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T17:27:26.199214] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T17:27:26.748117] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-29T17:27:27.225624] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T17:27:27.548129] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-29T17:27:28.348119] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-29T17:27:28.487957] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T17:27:29.072928] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T17:27:29.077238] [INFO ] [REMOTE ] BBN: Full fetch complete (26685 records). [2025-09-29T17:27:29.077411] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-29T17:27:29.152621] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-29T17:27:29.226756] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T17:27:29.504558] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-29T17:27:29.504709] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-29T17:27:29.505220] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-29T17:27:29.505299] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-29T17:27:29.506349] [DEBUG] [LOCAL ] BBN: Trimmed 26685 records to 18016 (keeping 200 days of data) [2025-09-29T17:27:29.625031] [DEBUG] [LOCAL ] BBN: Primary data saved (18016 records). [2025-09-29T17:27:29.625221] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-29T17:27:29.625330] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBN took 39.6s. Estimated remaining: 4h 20m 29s. Rate: 8.2 symbols/min [2025-09-29T17:27:29.800093] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:29.874308] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-29T17:27:29.874663] [INFO ] [MAIN ] BBY: Loaded 54253 existing records. [2025-09-29T17:27:29.953264] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-29T17:27:30.065892] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:30.066137] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-29T17:27:30.066197] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-29T17:27:30.067117] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-29T17:27:30.067177] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-29T17:27:30.431426] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:30.748115] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-29T17:27:31.062150] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-29T17:27:31.160437] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-29T17:27:31.548108] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-29T17:27:32.348104] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-29T17:27:32.715590] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T17:27:32.765818] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T17:27:33.148106] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-29T17:27:33.948108] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-29T17:27:34.183464] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T17:27:34.748150] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-29T17:27:34.804749] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T17:27:35.548159] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-29T17:27:35.840761] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T17:27:35.956975] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T17:27:36.348138] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-29T17:27:37.044271] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:27:37.148166] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-29T17:27:37.948108] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-29T17:27:38.038442] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T17:27:38.669417] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T17:27:38.748111] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-29T17:27:39.321474] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T17:27:39.548198] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-29T17:27:40.256368] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T17:27:40.348132] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-29T17:27:41.158062] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-29T17:27:41.180574] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T17:27:41.912741] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T17:27:41.948123] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-29T17:27:42.748157] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-29T17:27:42.881473] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:27:42.889191] [INFO ] [REMOTE ] BBW: Full fetch complete (39025 records). [2025-09-29T17:27:42.889345] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-29T17:27:43.299732] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-29T17:27:43.299848] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-29T17:27:43.300365] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-29T17:27:43.300416] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-29T17:27:43.301417] [DEBUG] [LOCAL ] BBW: Trimmed 39025 records to 26648 (keeping 200 days of data) [2025-09-29T17:27:43.475834] [DEBUG] [LOCAL ] BBW: Primary data saved (26648 records). [2025-09-29T17:27:43.475971] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-29T17:27:43.476071] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBW took 28.1s. Estimated remaining: 4h 21m 24s. Rate: 8.2 symbols/min [2025-09-29T17:27:43.550752] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-29T17:27:43.656242] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:43.701297] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-29T17:27:43.701611] [INFO ] [MAIN ] BC: Loaded 45020 existing records. [2025-09-29T17:27:43.913490] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:43.913871] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-29T17:27:43.913956] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-29T17:27:43.914703] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-29T17:27:43.914867] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-29T17:27:44.108040] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-29T17:27:44.338823] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:44.348080] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-29T17:27:44.757814] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T17:27:44.899254] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:27:45.148229] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-29T17:27:45.948088] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-29T17:27:46.262570] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T17:27:46.700022] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T17:27:46.748150] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-29T17:27:47.532568] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T17:27:47.548066] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-29T17:27:48.348103] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-29T17:27:48.590088] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T17:27:49.148154] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-29T17:27:49.364719] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:27:49.376092] [INFO ] [REMOTE ] BBWI: Full fetch complete (77415 records). [2025-09-29T17:27:49.376271] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-29T17:27:49.784594] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-29T17:27:49.784747] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-29T17:27:49.785530] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-29T17:27:49.785609] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-29T17:27:49.787170] [DEBUG] [LOCAL ] BBWI: Trimmed 77415 records to 53580 (keeping 200 days of data) [2025-09-29T17:27:49.971446] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-29T17:27:50.132364] [DEBUG] [LOCAL ] BBWI: Primary data saved (53580 records). [2025-09-29T17:27:50.132549] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-29T17:27:50.132870] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBWI took 27.3s. Estimated remaining: 4h 21m 10s. Rate: 8.2 symbols/min [2025-09-29T17:27:50.332983] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T17:27:50.351766] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:50.404433] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-29T17:27:50.404744] [INFO ] [MAIN ] BCAT: Loaded 34910 existing records. [2025-09-29T17:27:50.593249] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:50.593683] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-29T17:27:50.593837] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-29T17:27:50.594518] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-29T17:27:50.594585] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-29T17:27:50.750345] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-29T17:27:51.002428] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T17:27:51.008728] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:51.548108] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-29T17:27:51.727211] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:27:52.348093] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-29T17:27:52.616687] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:27:53.047888] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:27:53.148156] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-29T17:27:53.948150] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-29T17:27:54.221306] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T17:27:54.243749] [INFO ] [REMOTE ] BBVA: Full fetch complete (71586 records). [2025-09-29T17:27:54.244017] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-29T17:27:54.755483] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-29T17:27:54.813933] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-29T17:27:54.814167] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-29T17:27:54.815317] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-29T17:27:54.815465] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-29T17:27:54.844691] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T17:27:54.843025] [DEBUG] [LOCAL ] BBVA: Trimmed 71586 records to 49353 (keeping 200 days of data) [2025-09-29T17:27:55.183723] [DEBUG] [LOCAL ] BBVA: Primary data saved (49353 records). [2025-09-29T17:27:55.183925] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-29T17:27:55.184853] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBVA took 50.4s. Estimated remaining: 4h 20m 42s. Rate: 8.2 symbols/min [2025-09-29T17:27:55.359772] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:55.394799] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T17:27:55.443193] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-29T17:27:55.443626] [INFO ] [MAIN ] BCC: Loaded 28735 existing records. [2025-09-29T17:27:55.550598] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-29T17:27:55.636185] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:55.636515] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-29T17:27:55.636573] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-29T17:27:55.638121] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-29T17:27:55.638193] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-29T17:27:55.985091] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:56.348138] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-29T17:27:56.877499] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-29T17:27:57.148100] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-29T17:27:57.257399] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T17:27:57.487356] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T17:27:57.948162] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-29T17:27:58.748141] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-29T17:27:59.029182] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T17:27:59.041277] [INFO ] [REMOTE ] BBY: Full fetch complete (77243 records). [2025-09-29T17:27:59.041421] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-29T17:27:59.437158] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:27:59.497881] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-29T17:27:59.497980] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-29T17:27:59.498806] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-29T17:27:59.498873] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-29T17:27:59.500443] [DEBUG] [LOCAL ] BBY: Trimmed 77243 records to 53470 (keeping 200 days of data) [2025-09-29T17:27:59.561964] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-29T17:27:59.848767] [DEBUG] [LOCAL ] BBY: Primary data saved (53470 records). [2025-09-29T17:27:59.848915] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-29T17:27:59.850005] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBY took 30.2s. Estimated remaining: 4h 20m 10s. Rate: 8.2 symbols/min [2025-09-29T17:28:00.038117] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:00.057163] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T17:28:00.117919] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-29T17:28:00.118275] [INFO ] [MAIN ] BCE: Loaded 53072 existing records. [2025-09-29T17:28:00.311894] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:00.312169] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-29T17:28:00.312230] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-29T17:28:00.312845] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-29T17:28:00.312904] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-29T17:28:00.353219] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-29T17:28:00.745581] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:01.129582] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T17:28:01.148109] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-29T17:28:01.663322] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T17:28:01.948171] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-29T17:28:02.673252] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T17:28:02.748152] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-29T17:28:03.544281] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T17:28:03.553257] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-29T17:28:04.109133] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:28:04.348112] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-29T17:28:05.148126] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-29T17:28:05.366558] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T17:28:05.800558] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T17:28:05.948159] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-29T17:28:06.749794] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-29T17:28:06.753288] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T17:28:07.548088] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-29T17:28:07.843620] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T17:28:07.859669] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T17:28:08.348155] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-29T17:28:09.148136] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-29T17:28:09.308961] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T17:28:09.379005] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T17:28:09.948129] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-29T17:28:10.748137] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-29T17:28:10.839516] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:28:11.435426] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T17:28:11.548099] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-29T17:28:12.349376] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-29T17:28:12.354623] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T17:28:13.011201] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T17:28:13.148137] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-29T17:28:13.524036] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:28:13.948141] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-29T17:28:14.748164] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-29T17:28:14.811014] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T17:28:14.819413] [INFO ] [REMOTE ] BC: Full fetch complete (63836 records). [2025-09-29T17:28:14.819538] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-29T17:28:15.234160] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-29T17:28:15.234401] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-29T17:28:15.235381] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-29T17:28:15.235542] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-29T17:28:15.237108] [DEBUG] [LOCAL ] BC: Trimmed 63836 records to 44259 (keeping 200 days of data) [2025-09-29T17:28:15.488544] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T17:28:15.553637] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-29T17:28:15.564770] [DEBUG] [LOCAL ] BC: Primary data saved (44259 records). [2025-09-29T17:28:15.564927] [INFO ] [MAIN ] BC: Full history saved. [2025-09-29T17:28:15.565050] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 32.1s. Estimated remaining: 4h 21m 21s. Rate: 8.2 symbols/min [2025-09-29T17:28:15.758173] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:15.794892] [DEBUG] [LOCAL ] BCH: Loaded 30039 existing records from primary storage. [2025-09-29T17:28:15.795205] [INFO ] [MAIN ] BCH: Loaded 30039 existing records. [2025-09-29T17:28:15.992031] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:15.992257] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-29T17:28:15.992306] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-29T17:28:15.992871] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-29T17:28:15.992954] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-29T17:28:16.348366] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-29T17:28:16.414420] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:16.623912] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T17:28:17.148119] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-29T17:28:17.338801] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:28:17.346824] [INFO ] [REMOTE ] BCAT: Full fetch complete (49774 records). [2025-09-29T17:28:17.347070] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-29T17:28:17.348015] [FATAL] [VALIDATOR ] BCAT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:28:17.348109] [FATAL] [MAIN ] BCAT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:28:17.348156] [WARN ] [MAIN ] BCAT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:28:17.348199] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-29T17:28:17.348325] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-29T17:28:17.348385] [INFO ] [LOCAL ] BCAT: Starting deletion of derivative data. [2025-09-29T17:28:17.349354] [DEBUG] [LOCAL ] BCAT: Deleted derivative data file. [2025-09-29T17:28:17.349460] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 27.2s. Estimated remaining: 4h 20m 22s. Rate: 8.2 symbols/min [2025-09-29T17:28:17.487084] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:28:17.570388] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:17.604870] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-29T17:28:17.605177] [INFO ] [MAIN ] BCO: Loaded 26740 existing records. [2025-09-29T17:28:17.796862] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:17.797083] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-29T17:28:17.797152] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-29T17:28:17.798184] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-29T17:28:17.798246] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-29T17:28:17.955484] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-29T17:28:18.178731] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:18.748104] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-29T17:28:19.345398] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T17:28:19.548144] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-29T17:28:19.980420] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:28:20.313243] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-09-29T17:28:20.348087] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-29T17:28:21.148138] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-29T17:28:21.450455] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T17:28:21.477755] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T17:28:21.948086] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-29T17:28:22.209303] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T17:28:22.748098] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-29T17:28:23.554080] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-29T17:28:23.568595] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T17:28:23.943283] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T17:28:24.348107] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-29T17:28:24.989429] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T17:28:25.148115] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-29T17:28:25.948818] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-29T17:28:25.952174] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T17:28:26.312248] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T17:28:26.748190] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-29T17:28:27.302270] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:28:27.308891] [INFO ] [REMOTE ] BCC: Full fetch complete (40503 records). [2025-09-29T17:28:27.309012] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-29T17:28:27.553297] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-29T17:28:27.720380] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-29T17:28:27.720475] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-29T17:28:27.721041] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-29T17:28:27.721109] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-29T17:28:27.722099] [DEBUG] [LOCAL ] BCC: Trimmed 40503 records to 28242 (keeping 200 days of data) [2025-09-29T17:28:27.911892] [DEBUG] [LOCAL ] BCC: Primary data saved (28242 records). [2025-09-29T17:28:27.912036] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-29T17:28:27.912123] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 32.7s. Estimated remaining: 4h 20m 45s. Rate: 8.2 symbols/min [2025-09-29T17:28:28.110506] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:28:28.115367] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:28.189155] [DEBUG] [LOCAL ] BCS: Loaded 54242 existing records from primary storage. [2025-09-29T17:28:28.189539] [INFO ] [MAIN ] BCS: Loaded 54242 existing records. [2025-09-29T17:28:28.359211] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-29T17:28:28.408500] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:28.408839] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-29T17:28:28.408915] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-29T17:28:28.409937] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-29T17:28:28.410002] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-29T17:28:28.794034] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:29.148116] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-29T17:28:29.486992] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:28:29.898610] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:28:29.948131] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-29T17:28:30.748109] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-29T17:28:30.979959] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T17:28:31.548086] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-29T17:28:31.716016] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:28:31.834150] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T17:28:32.348095] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-29T17:28:32.777847] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:28:33.148162] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-29T17:28:33.948096] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-29T17:28:34.184948] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:28:34.195589] [INFO ] [REMOTE ] BCE: Full fetch complete (76083 records). [2025-09-29T17:28:34.195793] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-29T17:28:34.494624] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:28:34.648184] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-29T17:28:34.648268] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-29T17:28:34.649046] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-29T17:28:34.649134] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-29T17:28:34.650618] [DEBUG] [LOCAL ] BCE: Trimmed 76083 records to 52283 (keeping 200 days of data) [2025-09-29T17:28:34.748286] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-29T17:28:34.992504] [DEBUG] [LOCAL ] BCE: Primary data saved (52283 records). [2025-09-29T17:28:34.992689] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-29T17:28:34.993998] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 35.1s. Estimated remaining: 4h 20m 35s. Rate: 8.2 symbols/min [2025-09-29T17:28:35.183390] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:35.218405] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-29T17:28:35.218878] [INFO ] [MAIN ] BCSF: Loaded 28231 existing records. [2025-09-29T17:28:35.369837] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:28:35.438990] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:35.439192] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-29T17:28:35.439238] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-29T17:28:35.439621] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-29T17:28:35.439721] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-29T17:28:35.553245] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-29T17:28:35.820999] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:36.087147] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T17:28:36.348152] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-29T17:28:37.148095] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-29T17:28:37.454524] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T17:28:37.531846] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T17:28:37.948127] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-29T17:28:38.332175] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T17:28:38.748157] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-29T17:28:39.444419] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:28:39.548152] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-29T17:28:39.853746] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T17:28:39.860630] [INFO ] [REMOTE ] BCH: Full fetch complete (40868 records). [2025-09-29T17:28:39.860844] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-29T17:28:40.262665] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-29T17:28:40.262759] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-29T17:28:40.263247] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-29T17:28:40.263292] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-29T17:28:40.264218] [DEBUG] [LOCAL ] BCH: Trimmed 40868 records to 29497 (keeping 200 days of data) [2025-09-29T17:28:40.354927] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-29T17:28:40.446809] [DEBUG] [LOCAL ] BCH: Primary data saved (29497 records). [2025-09-29T17:28:40.446952] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-29T17:28:40.447039] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 24.9s. Estimated remaining: 4h 20m 11s. Rate: 8.2 symbols/min [2025-09-29T17:28:40.629255] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:40.655801] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-29T17:28:40.656078] [INFO ] [MAIN ] BCX: Loaded 21920 existing records. [2025-09-29T17:28:40.844110] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:40.844340] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-29T17:28:40.844387] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-29T17:28:40.845183] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-29T17:28:40.845242] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-29T17:28:41.153234] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-29T17:28:41.222129] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:41.645673] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:28:41.690746] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T17:28:41.948120] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-29T17:28:42.085408] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T17:28:42.748138] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-29T17:28:43.548167] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-29T17:28:43.648549] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T17:28:43.880183] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T17:28:44.348145] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-29T17:28:44.632828] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:28:45.148108] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-29T17:28:45.843108] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:28:45.948108] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-29T17:28:46.511685] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T17:28:46.748184] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-29T17:28:47.062315] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T17:28:47.548115] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-29T17:28:48.130350] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:28:48.348106] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-29T17:28:48.800368] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T17:28:49.148110] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-29T17:28:49.948127] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-29T17:28:50.229077] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T17:28:50.504480] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T17:28:50.748115] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-29T17:28:50.859938] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T17:28:50.865517] [INFO ] [REMOTE ] BCO: Full fetch complete (36743 records). [2025-09-29T17:28:50.865710] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-29T17:28:51.265102] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-29T17:28:51.265193] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-29T17:28:51.265767] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-29T17:28:51.265865] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-29T17:28:51.266832] [DEBUG] [LOCAL ] BCO: Trimmed 36743 records to 26212 (keeping 200 days of data) [2025-09-29T17:28:51.442753] [DEBUG] [LOCAL ] BCO: Primary data saved (26212 records). [2025-09-29T17:28:51.442898] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-29T17:28:51.442988] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCO took 34.1s. Estimated remaining: 4h 20m 37s. Rate: 8.2 symbols/min [2025-09-29T17:28:51.553413] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-29T17:28:51.622786] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:51.652036] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-29T17:28:51.652310] [INFO ] [MAIN ] BDC: Loaded 25073 existing records. [2025-09-29T17:28:51.839084] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:51.839288] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-29T17:28:51.839344] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-29T17:28:51.839889] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-29T17:28:51.839956] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-29T17:28:52.234062] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:52.236164] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T17:28:52.348084] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-29T17:28:52.678706] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T17:28:53.148138] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-29T17:28:53.598857] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T17:28:53.948124] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-29T17:28:54.285159] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:28:54.748131] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-29T17:28:55.271443] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T17:28:55.548090] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-29T17:28:55.588251] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T17:28:56.348131] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-29T17:28:57.148124] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-29T17:28:57.239923] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T17:28:57.568602] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T17:28:57.948122] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-29T17:28:58.398675] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T17:28:58.748255] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-29T17:28:59.180749] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T17:28:59.187322] [INFO ] [REMOTE ] BCSF: Full fetch complete (38264 records). [2025-09-29T17:28:59.187504] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-29T17:28:59.553304] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-29T17:28:59.675793] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-29T17:28:59.675907] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-29T17:28:59.676518] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-29T17:28:59.676591] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-29T17:28:59.678039] [DEBUG] [LOCAL ] BCSF: Trimmed 38264 records to 27789 (keeping 200 days of data) [2025-09-29T17:28:59.852071] [DEBUG] [LOCAL ] BCSF: Primary data saved (27789 records). [2025-09-29T17:28:59.852272] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-29T17:28:59.852382] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 24.9s. Estimated remaining: 4h 20m 40s. Rate: 8.2 symbols/min [2025-09-29T17:29:00.348086] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-29T17:29:00.439826] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:29:00.825427] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T17:29:01.148099] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-29T17:29:01.164524] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T17:29:01.948120] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-29T17:29:02.748086] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-29T17:29:03.016939] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T17:29:03.088787] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:29:03.548118] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-29T17:29:04.163907] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:29:04.348415] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-29T17:29:04.820061] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T17:29:05.148168] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-29T17:29:05.948127] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-29T17:29:06.125338] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T17:29:06.136965] [INFO ] [REMOTE ] BCS: Full fetch complete (77299 records). [2025-09-29T17:29:06.137163] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-29T17:29:06.294185] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T17:29:06.593244] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-29T17:29:06.593423] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-29T17:29:06.594376] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-29T17:29:06.594445] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-29T17:29:06.596205] [DEBUG] [LOCAL ] BCS: Trimmed 77299 records to 53457 (keeping 200 days of data) [2025-09-29T17:29:06.782407] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-29T17:29:06.940082] [DEBUG] [LOCAL ] BCS: Primary data saved (53457 records). [2025-09-29T17:29:06.940234] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-29T17:29:06.940889] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCS took 39.0s. Estimated remaining: 4h 20m 30s. Rate: 8.2 symbols/min [2025-09-29T17:29:07.873215] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T17:29:07.879528] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-29T17:29:07.926200] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T17:29:07.931320] [INFO ] [REMOTE ] BCX: Full fetch complete (33940 records). [2025-09-29T17:29:07.931420] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-29T17:29:08.358442] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-29T17:29:08.358541] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-29T17:29:08.359140] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-29T17:29:08.359203] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-29T17:29:08.361298] [DEBUG] [LOCAL ] BCX: Trimmed 33940 records to 21626 (keeping 200 days of data) [2025-09-29T17:29:08.497307] [DEBUG] [LOCAL ] BCX: Primary data saved (21626 records). [2025-09-29T17:29:08.497486] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-29T17:29:08.497592] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCX took 28.1s. Estimated remaining: 4h 19m 31s. Rate: 8.2 symbols/min [2025-09-29T17:29:08.751755] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T17:29:08.760072] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-29T17:29:09.890858] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T17:29:09.896614] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-29T17:29:11.095067] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T17:29:11.100846] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-29T17:29:12.348807] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T17:29:12.354994] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-29T17:29:13.546212] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:29:13.552247] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-29T17:29:14.899696] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:29:14.904959] [INFO ] [REMOTE ] BDC: Full fetch complete (35770 records). [2025-09-29T17:29:14.905060] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-29T17:29:15.325288] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-29T17:29:15.325376] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-29T17:29:15.325858] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-29T17:29:15.325921] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-29T17:29:15.326942] [DEBUG] [LOCAL ] BDC: Trimmed 35770 records to 24595 (keeping 200 days of data) [2025-09-29T17:29:15.488066] [DEBUG] [LOCAL ] BDC: Primary data saved (24595 records). [2025-09-29T17:29:15.488204] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-29T17:29:15.488285] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 24.0s. Estimated remaining: 4h 19m 21s. Rate: 8.2 symbols/min [2025-09-29T17:29:16.107719] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:16.145840] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:16.222867] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:16.243019] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:16.335350] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-29T17:29:16.353328] [INFO ] [MAIN ] BDJ: Loaded 29325 existing records. [2025-09-29T17:29:16.353488] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-29T17:29:16.359810] [INFO ] [MAIN ] BE: Loaded 54433 existing records. [2025-09-29T17:29:16.556198] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-29T17:29:16.604704] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-29T17:29:16.617615] [INFO ] [MAIN ] BDN: Loaded 48230 existing records. [2025-09-29T17:29:16.621532] [INFO ] [MAIN ] BDX: Loaded 53191 existing records. [2025-09-29T17:29:16.853701] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:16.964169] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:16.974701] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-29T17:29:17.008160] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-29T17:29:17.008226] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-29T17:29:17.024527] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-29T17:29:17.013544] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-29T17:29:17.034382] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-29T17:29:17.076267] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-29T17:29:17.123195] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-29T17:29:17.227945] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:17.288828] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-29T17:29:17.314963] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-29T17:29:17.361500] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-29T17:29:17.379348] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-29T17:29:17.471448] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:17.567489] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-29T17:29:17.567751] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-29T17:29:17.640724] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-29T17:29:17.707488] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-29T17:29:18.398532] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:18.427639] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-29T17:29:18.580322] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:18.603419] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-29T17:29:18.692575] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:18.719620] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-29T17:29:18.822193] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:18.822496] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-29T17:29:20.207020] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T17:29:20.213683] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-29T17:29:20.538195] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T17:29:20.548760] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-29T17:29:20.761774] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:29:20.773822] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-29T17:29:20.873131] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-29T17:29:20.885031] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-29T17:29:21.103757] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T17:29:21.110637] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-29T17:29:21.899456] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T17:29:21.909671] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-29T17:29:22.211603] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:29:22.218719] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-29T17:29:22.495726] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:29:22.507261] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-29T17:29:22.930105] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-29T17:29:22.941473] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-29T17:29:23.069585] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T17:29:23.076240] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-29T17:29:23.611580] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:29:23.621199] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-29T17:29:23.970849] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:29:24.348122] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-29T17:29:24.458602] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T17:29:24.705143] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T17:29:25.148122] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-29T17:29:25.296932] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:29:25.948101] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-29T17:29:26.057110] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:29:26.088375] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T17:29:26.748113] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-29T17:29:27.548098] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-29T17:29:27.830304] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T17:29:27.890017] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:29:28.348121] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-29T17:29:29.148101] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-29T17:29:29.310133] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:29:29.948109] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-29T17:29:30.269110] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T17:29:30.748105] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-29T17:29:30.792752] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T17:29:31.429802] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T17:29:31.548120] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-29T17:29:32.348121] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-29T17:29:32.647810] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T17:29:33.116806] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T17:29:33.148068] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-29T17:29:33.619566] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T17:29:33.948116] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-29T17:29:34.748128] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-29T17:29:34.927236] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T17:29:35.079939] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T17:29:35.548114] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-29T17:29:35.968075] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T17:29:36.348146] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-29T17:29:37.148089] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-29T17:29:37.290874] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:29:37.905408] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T17:29:37.948068] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-29T17:29:38.748142] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-29T17:29:38.813150] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T17:29:39.552770] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-29T17:29:39.559111] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T17:29:40.090597] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T17:29:40.096907] [INFO ] [REMOTE ] BDJ: Full fetch complete (42899 records). [2025-09-29T17:29:40.097060] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-29T17:29:40.353292] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-29T17:29:40.511522] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-29T17:29:40.511627] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-29T17:29:40.512261] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-29T17:29:40.512338] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-29T17:29:40.513561] [DEBUG] [LOCAL ] BDJ: Trimmed 42899 records to 28915 (keeping 200 days of data) [2025-09-29T17:29:40.693935] [DEBUG] [LOCAL ] BDJ: Primary data saved (28915 records). [2025-09-29T17:29:40.694075] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-29T17:29:40.694173] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 25.2s. Estimated remaining: 4h 21m 52s. Rate: 8.1 symbols/min [2025-09-29T17:29:40.879793] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:40.880006] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-29T17:29:40.880063] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-29T17:29:40.880181] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-29T17:29:40.880224] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-29T17:29:40.880267] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-29T17:29:40.880300] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-29T17:29:41.153258] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-29T17:29:41.257988] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:41.784623] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-29T17:29:41.861683] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T17:29:41.871987] [INFO ] [REMOTE ] BDN: Full fetch complete (69213 records). [2025-09-29T17:29:41.872126] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-29T17:29:41.953199] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-29T17:29:42.286156] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-29T17:29:42.286258] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-29T17:29:42.287100] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-29T17:29:42.287168] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-29T17:29:42.288845] [DEBUG] [LOCAL ] BDN: Trimmed 69213 records to 47512 (keeping 200 days of data) [2025-09-29T17:29:42.569408] [DEBUG] [LOCAL ] BDN: Primary data saved (47512 records). [2025-09-29T17:29:42.569572] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-29T17:29:42.570246] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 27.1s. Estimated remaining: 4h 20m 56s. Rate: 8.2 symbols/min [2025-09-29T17:29:42.766543] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-29T17:29:42.771513] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:42.849385] [DEBUG] [LOCAL ] BEKE: Loaded 54025 existing records from primary storage. [2025-09-29T17:29:42.849800] [INFO ] [MAIN ] BEKE: Loaded 54025 existing records. [2025-09-29T17:29:43.052891] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:43.053361] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-29T17:29:43.053551] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-29T17:29:43.054082] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-29T17:29:43.054147] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-29T17:29:43.345018] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-29T17:29:43.386107] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-29T17:29:43.488230] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:43.548079] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-29T17:29:44.348084] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-29T17:29:44.441714] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-29T17:29:45.148117] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-29T17:29:45.693539] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T17:29:45.948152] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-29T17:29:46.263671] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T17:29:46.274857] [INFO ] [REMOTE ] BDX: Full fetch complete (75795 records). [2025-09-29T17:29:46.275039] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-29T17:29:46.688378] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-29T17:29:46.688504] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-29T17:29:46.689347] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-29T17:29:46.689437] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-29T17:29:46.690931] [DEBUG] [LOCAL ] BDX: Trimmed 75795 records to 52378 (keeping 200 days of data) [2025-09-29T17:29:46.751819] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-29T17:29:47.041931] [DEBUG] [LOCAL ] BDX: Primary data saved (52378 records). [2025-09-29T17:29:47.042077] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-29T17:29:47.043299] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 31.5s. Estimated remaining: 4h 20m 24s. Rate: 8.2 symbols/min [2025-09-29T17:29:47.152358] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T17:29:47.225400] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:47.290065] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-29T17:29:47.290504] [INFO ] [MAIN ] BEN: Loaded 53833 existing records. [2025-09-29T17:29:47.480661] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:47.480938] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-29T17:29:47.480995] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-29T17:29:47.481404] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-29T17:29:47.481497] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-29T17:29:47.553268] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-29T17:29:47.925066] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:47.958499] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T17:29:47.962250] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-29T17:29:47.985907] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-29T17:29:48.004001] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-29T17:29:48.013147] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-29T17:29:48.353270] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-29T17:29:48.455078] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-29T17:29:48.455182] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-29T17:29:48.456103] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-29T17:29:48.456171] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-29T17:29:48.457805] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53653 (keeping 200 days of data) [2025-09-29T17:29:48.784771] [DEBUG] [LOCAL ] BE: Primary data saved (53653 records). [2025-09-29T17:29:48.784919] [INFO ] [MAIN ] BE: Full history saved. [2025-09-29T17:29:48.785034] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BE took 33.3s. Estimated remaining: 4h 19m 28s. Rate: 8.2 symbols/min [2025-09-29T17:29:48.873572] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T17:29:48.977119] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:49.017454] [DEBUG] [LOCAL ] BEP: Loaded 39244 existing records from primary storage. [2025-09-29T17:29:49.017792] [INFO ] [MAIN ] BEP: Loaded 39244 existing records. [2025-09-29T17:29:49.153271] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-29T17:29:49.215254] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:49.215486] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-29T17:29:49.215536] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-29T17:29:49.215971] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-29T17:29:49.216035] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-29T17:29:49.593425] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:49.948137] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-29T17:29:50.429525] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-29T17:29:50.748108] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-29T17:29:50.939638] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T17:29:51.097736] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T17:29:51.548160] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-29T17:29:52.348163] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-29T17:29:53.148120] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-29T17:29:53.605889] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-29T17:29:53.948137] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-29T17:29:54.217120] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T17:29:54.713004] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:29:54.748111] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-29T17:29:55.548163] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-29T17:29:55.968841] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T17:29:56.270327] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T17:29:56.348113] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-29T17:29:57.148231] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-29T17:29:57.288098] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T17:29:57.920720] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:29:57.948152] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-29T17:29:58.748108] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-29T17:29:58.999229] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T17:29:59.228237] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T17:29:59.548148] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-29T17:29:59.610320] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T17:30:00.348162] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-29T17:30:01.148147] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-29T17:30:01.377567] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T17:30:01.948230] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-29T17:30:02.465445] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T17:30:02.748173] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-29T17:30:02.978225] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T17:30:03.548155] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-29T17:30:03.848930] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T17:30:03.919312] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T17:30:04.348132] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-29T17:30:04.789805] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T17:30:05.148172] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-29T17:30:05.395369] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-29T17:30:05.948110] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-29T17:30:06.417688] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T17:30:06.568621] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-29T17:30:06.569455] [INFO ] [REMOTE ] BEDU: Full fetch complete (1429 records). [2025-09-29T17:30:06.569528] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-29T17:30:06.758057] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-29T17:30:06.764613] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-29T17:30:06.766017] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:30:06.766095] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:30:06.766242] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-29T17:30:06.766335] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-29T17:30:06.766393] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-29T17:30:06.766452] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-29T17:30:06.766536] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 26.1s. Estimated remaining: 4h 20m 53s. Rate: 8.1 symbols/min [2025-09-29T17:30:06.945875] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:07.000011] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-29T17:30:07.000375] [INFO ] [MAIN ] BEPC: Loaded 47209 existing records. [2025-09-29T17:30:07.192249] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:07.192486] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-29T17:30:07.192537] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-29T17:30:07.193147] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-29T17:30:07.193211] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-29T17:30:07.553405] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-29T17:30:07.589534] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:08.265062] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T17:30:08.348151] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-29T17:30:09.148080] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-29T17:30:09.655488] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-29T17:30:09.948146] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-29T17:30:10.183697] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:30:10.748154] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-29T17:30:11.034419] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T17:30:11.548137] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-29T17:30:11.668511] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:30:12.323961] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T17:30:12.348119] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-29T17:30:13.148114] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-29T17:30:13.509024] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T17:30:13.520989] [INFO ] [REMOTE ] BEKE: Full fetch complete (77191 records). [2025-09-29T17:30:13.521259] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-29T17:30:13.961407] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-29T17:30:13.992758] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-29T17:30:13.992942] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-29T17:30:13.994170] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-29T17:30:13.994694] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-29T17:30:14.024289] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T17:30:14.022994] [DEBUG] [LOCAL ] BEKE: Trimmed 77191 records to 53241 (keeping 200 days of data) [2025-09-29T17:30:14.368593] [DEBUG] [LOCAL ] BEKE: Primary data saved (53241 records). [2025-09-29T17:30:14.368798] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-29T17:30:14.369675] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEKE took 31.8s. Estimated remaining: 4h 20m 48s. Rate: 8.1 symbols/min [2025-09-29T17:30:14.551033] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:14.561439] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-29T17:30:14.561723] [INFO ] [MAIN ] BEPH: Loaded 5208 existing records. [2025-09-29T17:30:14.755963] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-29T17:30:14.755875] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:14.756180] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-29T17:30:14.757081] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-29T17:30:14.757304] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-29T17:30:14.757390] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-29T17:30:15.150594] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:15.183469] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T17:30:15.548125] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-29T17:30:15.949512] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T17:30:16.253530] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T17:30:16.348121] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-29T17:30:17.148081] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-29T17:30:17.252439] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T17:30:17.728207] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T17:30:17.736345] [INFO ] [REMOTE ] BEP: Full fetch complete (58325 records). [2025-09-29T17:30:17.736487] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-29T17:30:17.899619] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T17:30:17.955195] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-29T17:30:18.163282] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-29T17:30:18.163387] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-29T17:30:18.164065] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-29T17:30:18.164129] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-29T17:30:18.165324] [DEBUG] [LOCAL ] BEP: Trimmed 58325 records to 38575 (keeping 200 days of data) [2025-09-29T17:30:18.404472] [DEBUG] [LOCAL ] BEP: Primary data saved (38575 records). [2025-09-29T17:30:18.404626] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-29T17:30:18.404768] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 29.6s. Estimated remaining: 4h 20m 12s. Rate: 8.2 symbols/min [2025-09-29T17:30:18.581093] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:18.586956] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-29T17:30:18.587135] [INFO ] [MAIN ] BEPI: Loaded 3487 existing records. [2025-09-29T17:30:18.757088] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-29T17:30:18.780455] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:18.781561] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-29T17:30:18.781624] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-29T17:30:18.782054] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-29T17:30:18.782113] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-29T17:30:19.156914] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:19.548139] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-29T17:30:20.095862] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:30:20.107064] [INFO ] [REMOTE ] BEN: Full fetch complete (76889 records). [2025-09-29T17:30:20.107231] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-29T17:30:20.185575] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T17:30:20.355981] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-29T17:30:20.530263] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-29T17:30:20.530347] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-29T17:30:20.531170] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-29T17:30:20.531239] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-29T17:30:20.532736] [DEBUG] [LOCAL ] BEN: Trimmed 76889 records to 53054 (keeping 200 days of data) [2025-09-29T17:30:20.855571] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T17:30:20.879511] [DEBUG] [LOCAL ] BEN: Primary data saved (53054 records). [2025-09-29T17:30:20.879690] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-29T17:30:20.879811] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEN took 33.8s. Estimated remaining: 4h 19m 23s. Rate: 8.2 symbols/min [2025-09-29T17:30:21.068855] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:21.073985] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-29T17:30:21.074157] [INFO ] [MAIN ] BEPJ: Loaded 3268 existing records. [2025-09-29T17:30:21.153215] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-29T17:30:21.264943] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:21.265230] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-29T17:30:21.265288] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-29T17:30:21.265584] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-29T17:30:21.265669] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-29T17:30:21.639772] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:21.669323] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T17:30:21.948080] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-29T17:30:22.207572] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (3.45 seconds). [2025-09-29T17:30:22.590959] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T17:30:22.748108] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-29T17:30:23.102340] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T17:30:23.548122] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-29T17:30:24.178158] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T17:30:24.348116] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-29T17:30:24.838377] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T17:30:25.148111] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-29T17:30:25.653209] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T17:30:25.948107] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-29T17:30:26.525023] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-29T17:30:26.748091] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-29T17:30:27.495432] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T17:30:27.548113] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-29T17:30:28.145143] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T17:30:28.348123] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-29T17:30:28.924237] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T17:30:29.148115] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-29T17:30:29.948111] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-29T17:30:30.084298] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T17:30:30.748105] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-29T17:30:31.370822] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T17:30:31.548181] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-29T17:30:31.586322] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T17:30:32.029925] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T17:30:32.348163] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-29T17:30:33.148106] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-29T17:30:33.849956] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:30:33.948134] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-29T17:30:34.109324] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:30:34.352174] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-29T17:30:34.748125] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-29T17:30:35.362119] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T17:30:35.548160] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-29T17:30:36.246346] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T17:30:36.348165] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-29T17:30:36.821378] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T17:30:37.148114] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-29T17:30:37.695967] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T17:30:37.697189] [INFO ] [REMOTE ] BEPI: Full fetch complete (4998 records). [2025-09-29T17:30:37.697262] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-29T17:30:37.954209] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-29T17:30:38.082125] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-29T17:30:38.082204] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-29T17:30:38.082349] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-29T17:30:38.082389] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-29T17:30:38.082803] [DEBUG] [LOCAL ] BEPI: Trimmed 4998 records to 3481 (keeping 200 days of data) [2025-09-29T17:30:38.104574] [DEBUG] [LOCAL ] BEPI: Primary data saved (3481 records). [2025-09-29T17:30:38.104703] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-29T17:30:38.104797] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPI took 19.7s. Estimated remaining: 4h 20m 40s. Rate: 8.1 symbols/min [2025-09-29T17:30:38.282241] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:38.324045] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-29T17:30:38.324320] [INFO ] [MAIN ] BFAM: Loaded 33519 existing records. [2025-09-29T17:30:38.509005] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:38.509236] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-29T17:30:38.509286] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-29T17:30:38.509959] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-29T17:30:38.510020] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-29T17:30:38.758121] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-29T17:30:38.894580] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:39.366895] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T17:30:39.548108] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-29T17:30:39.637384] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T17:30:40.348133] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-29T17:30:40.805376] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-29T17:30:41.077689] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:30:41.148123] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-29T17:30:41.462187] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T17:30:41.948115] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-29T17:30:42.557521] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T17:30:42.748123] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-29T17:30:43.548116] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-29T17:30:44.156960] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T17:30:44.348099] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-29T17:30:44.437155] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T17:30:44.847411] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T17:30:45.148133] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-29T17:30:45.676126] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-29T17:30:45.677297] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4481 records). [2025-09-29T17:30:45.677425] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-29T17:30:45.956873] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-29T17:30:46.103796] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-29T17:30:46.103879] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-29T17:30:46.104029] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-29T17:30:46.104072] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-29T17:30:46.104488] [DEBUG] [LOCAL ] BEPJ: Trimmed 4481 records to 3138 (keeping 200 days of data) [2025-09-29T17:30:46.125373] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3138 records). [2025-09-29T17:30:46.125539] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-29T17:30:46.125709] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPJ took 25.2s. Estimated remaining: 4h 20m 38s. Rate: 8.1 symbols/min [2025-09-29T17:30:46.311535] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:46.360271] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-29T17:30:46.360596] [INFO ] [MAIN ] BFH: Loaded 42308 existing records. [2025-09-29T17:30:46.549277] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:46.549545] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-29T17:30:46.549606] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-29T17:30:46.550087] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-29T17:30:46.550149] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-29T17:30:46.753412] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-29T17:30:46.901524] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T17:30:46.943431] [INFO ] [REMOTE ] BEPH: Full fetch complete (7523 records). [2025-09-29T17:30:46.950154] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-29T17:30:46.949997] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:46.951424] [FATAL] [VALIDATOR ] BEPH: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:30:46.951525] [FATAL] [MAIN ] BEPH: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:30:46.951601] [WARN ] [MAIN ] BEPH: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:30:46.951701] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-29T17:30:46.951777] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-09-29T17:30:46.951817] [INFO ] [LOCAL ] BEPH: Starting deletion of derivative data. [2025-09-29T17:30:46.952608] [DEBUG] [LOCAL ] BEPH: Deleted derivative data file. [2025-09-29T17:30:46.952781] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPH took 32.6s. Estimated remaining: 4h 19m 35s. Rate: 8.2 symbols/min [2025-09-29T17:30:47.144320] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:47.165611] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-29T17:30:47.165907] [INFO ] [MAIN ] BFK: Loaded 14145 existing records. [2025-09-29T17:30:47.370989] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:47.371199] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-29T17:30:47.371271] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-29T17:30:47.371620] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-29T17:30:47.371717] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-29T17:30:47.550020] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-29T17:30:47.842608] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:48.137440] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T17:30:48.348132] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-29T17:30:49.148112] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-29T17:30:49.416491] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:30:49.708109] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T17:30:49.948125] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-29T17:30:50.178943] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T17:30:50.748138] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-29T17:30:51.452188] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:30:51.548128] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-29T17:30:51.972864] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T17:30:52.055969] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-29T17:30:52.348140] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-29T17:30:53.148758] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-29T17:30:53.629035] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-29T17:30:53.948181] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-29T17:30:54.552953] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T17:30:54.748162] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-29T17:30:54.903145] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T17:30:55.548122] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-29T17:30:56.238997] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:30:56.348121] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-29T17:30:56.606021] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T17:30:57.148134] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-29T17:30:57.948136] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-29T17:30:58.164310] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:30:58.164782] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T17:30:58.183548] [INFO ] [REMOTE ] BEPC: Full fetch complete (68464 records). [2025-09-29T17:30:58.183809] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-29T17:30:58.638125] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-29T17:30:58.638217] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-29T17:30:58.639011] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-29T17:30:58.639083] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-29T17:30:58.640621] [DEBUG] [LOCAL ] BEPC: Trimmed 68464 records to 46440 (keeping 200 days of data) [2025-09-29T17:30:58.748684] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-29T17:30:58.944474] [DEBUG] [LOCAL ] BEPC: Primary data saved (46440 records). [2025-09-29T17:30:58.944721] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-29T17:30:58.947559] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPC took 52.2s. Estimated remaining: 4h 20m 7s. Rate: 8.1 symbols/min [2025-09-29T17:30:59.134742] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:59.200664] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-29T17:30:59.201066] [INFO ] [MAIN ] BFLY: Loaded 52590 existing records. [2025-09-29T17:30:59.402941] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:59.403468] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-29T17:30:59.403614] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-29T17:30:59.412010] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-29T17:30:59.425582] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-29T17:30:59.427063] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T17:30:59.552541] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-29T17:30:59.835680] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:00.348090] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-29T17:31:00.426911] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:31:00.820514] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T17:31:01.148155] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-29T17:31:01.177037] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:31:01.948116] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-29T17:31:02.748107] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-29T17:31:03.023233] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T17:31:03.548146] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-29T17:31:03.849511] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:31:04.348134] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-29T17:31:04.385482] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T17:31:04.400604] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T17:31:05.148170] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-29T17:31:05.948116] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-29T17:31:06.065531] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T17:31:06.112593] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T17:31:06.748118] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-29T17:31:07.548131] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-29T17:31:07.597605] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T17:31:08.201377] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T17:31:08.348135] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-29T17:31:09.148083] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-29T17:31:09.443774] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-29T17:31:09.808224] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-29T17:31:09.838686] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T17:31:09.948116] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-29T17:31:10.748142] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-29T17:31:11.491923] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T17:31:11.499872] [INFO ] [REMOTE ] BFAM: Full fetch complete (46934 records). [2025-09-29T17:31:11.500059] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-29T17:31:11.553342] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-29T17:31:11.977845] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-29T17:31:11.977940] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-29T17:31:11.978560] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-29T17:31:11.978614] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-29T17:31:11.979875] [DEBUG] [LOCAL ] BFAM: Trimmed 46934 records to 33077 (keeping 200 days of data) [2025-09-29T17:31:12.201163] [DEBUG] [LOCAL ] BFAM: Primary data saved (33077 records). [2025-09-29T17:31:12.201340] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-29T17:31:12.201447] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFAM took 34.1s. Estimated remaining: 4h 20m 49s. Rate: 8.1 symbols/min [2025-09-29T17:31:12.356711] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-29T17:31:12.395636] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:12.412735] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-29T17:31:12.413055] [INFO ] [MAIN ] BFS: Loaded 9240 existing records. [2025-09-29T17:31:12.612979] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:12.633278] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-29T17:31:12.633484] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-29T17:31:12.634321] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-29T17:31:12.635751] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T17:31:12.635959] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-29T17:31:13.059699] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:13.148164] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-29T17:31:13.324759] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T17:31:13.593475] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T17:31:13.948123] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-29T17:31:14.488560] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:31:14.748162] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-29T17:31:14.850515] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T17:31:15.548158] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-29T17:31:15.580559] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T17:31:15.586405] [INFO ] [REMOTE ] BFK: Full fetch complete (19339 records). [2025-09-29T17:31:15.586524] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-29T17:31:16.018845] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-29T17:31:16.018937] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-29T17:31:16.019373] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-29T17:31:16.019444] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-29T17:31:16.020377] [DEBUG] [LOCAL ] BFK: Trimmed 19339 records to 13908 (keeping 200 days of data) [2025-09-29T17:31:16.116639] [DEBUG] [LOCAL ] BFK: Primary data saved (13908 records). [2025-09-29T17:31:16.116964] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-29T17:31:16.117073] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFK took 29.2s. Estimated remaining: 4h 20m 12s. Rate: 8.1 symbols/min [2025-09-29T17:31:16.295870] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:16.311844] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-29T17:31:16.312121] [INFO ] [MAIN ] BFZ: Loaded 12223 existing records. [2025-09-29T17:31:16.353389] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-29T17:31:16.510854] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:16.511172] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-29T17:31:16.511261] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-29T17:31:16.511601] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-29T17:31:16.511693] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-29T17:31:16.934207] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:17.148122] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-29T17:31:17.270097] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:31:17.270879] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T17:31:17.281899] [INFO ] [REMOTE ] BFH: Full fetch complete (59704 records). [2025-09-29T17:31:17.282022] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-29T17:31:17.720806] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-29T17:31:17.720911] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-29T17:31:17.721680] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-29T17:31:17.721748] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-29T17:31:17.723344] [DEBUG] [LOCAL ] BFH: Trimmed 59704 records to 41647 (keeping 200 days of data) [2025-09-29T17:31:17.950144] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-29T17:31:17.999211] [DEBUG] [LOCAL ] BFH: Primary data saved (41647 records). [2025-09-29T17:31:17.999346] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-29T17:31:17.999429] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFH took 31.9s. Estimated remaining: 4h 19m 19s. Rate: 8.2 symbols/min [2025-09-29T17:31:18.190375] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:18.251181] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-29T17:31:18.251531] [INFO ] [MAIN ] BG: Loaded 51118 existing records. [2025-09-29T17:31:18.467814] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T17:31:18.473779] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:18.478737] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-29T17:31:18.478798] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-29T17:31:18.479744] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-29T17:31:18.479806] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-29T17:31:18.753225] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-29T17:31:18.879413] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:19.548128] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-29T17:31:19.785771] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:31:19.797890] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T17:31:20.195080] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T17:31:20.348111] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-29T17:31:21.148102] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-29T17:31:21.283756] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T17:31:21.948094] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-29T17:31:22.749000] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-29T17:31:22.753444] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-29T17:31:22.986435] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:31:23.548123] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-29T17:31:24.348114] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-29T17:31:24.458981] [DEBUG] [REMOTE ] BFZ: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-29T17:31:24.459298] [WARN ] [REMOTE ] BFZ: No data returned for month 2025-03 [2025-09-29T17:31:24.459429] [FATAL] [REMOTE ] BFZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:31:24.459594] [FATAL] [MAIN ] BFZ: Failed to fetch primary data. [2025-09-29T17:31:24.459707] [WARN ] [MAIN ] BFZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:31:24.459797] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-29T17:31:24.459883] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-09-29T17:31:24.459940] [INFO ] [LOCAL ] BFZ: Starting deletion of derivative data. [2025-09-29T17:31:24.460484] [DEBUG] [LOCAL ] BFZ: Deleted derivative data file. [2025-09-29T17:31:24.460594] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFZ took 8.3s. Estimated remaining: 4h 19m 5s. Rate: 8.2 symbols/min [2025-09-29T17:31:24.659488] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:24.691900] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:31:24.730275] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-29T17:31:24.730628] [INFO ] [MAIN ] BGB: Loaded 17621 existing records. [2025-09-29T17:31:24.946081] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:24.946320] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-29T17:31:24.946370] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-29T17:31:24.946829] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-29T17:31:24.946988] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-29T17:31:25.152762] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-29T17:31:25.341848] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:25.375391] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T17:31:25.948115] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-29T17:31:26.748120] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-29T17:31:26.915262] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T17:31:27.070824] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T17:31:27.548098] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-29T17:31:28.348127] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-29T17:31:28.510433] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T17:31:28.511421] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:31:29.148115] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-29T17:31:29.274193] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-29T17:31:29.948124] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-29T17:31:30.227428] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T17:31:30.748214] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-29T17:31:31.548158] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-29T17:31:32.005307] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-29T17:31:32.336773] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T17:31:32.348052] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-29T17:31:32.590744] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T17:31:33.148112] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-29T17:31:33.171572] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T17:31:33.948161] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-29T17:31:34.748098] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-29T17:31:34.825041] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T17:31:35.190367] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T17:31:35.205098] [INFO ] [REMOTE ] BFLY: Full fetch complete (75269 records). [2025-09-29T17:31:35.205303] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-29T17:31:35.554852] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-29T17:31:35.621268] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-29T17:31:35.621371] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-29T17:31:35.622292] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-29T17:31:35.622380] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-29T17:31:35.624146] [DEBUG] [LOCAL ] BFLY: Trimmed 75269 records to 51799 (keeping 200 days of data) [2025-09-29T17:31:35.965996] [DEBUG] [LOCAL ] BFLY: Primary data saved (51799 records). [2025-09-29T17:31:35.966242] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-29T17:31:35.966453] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFLY took 37.0s. Estimated remaining: 4h 19m 32s. Rate: 8.1 symbols/min [2025-09-29T17:31:36.186735] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:36.209635] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-29T17:31:36.209941] [INFO ] [MAIN ] BGH: Loaded 16728 existing records. [2025-09-29T17:31:36.369603] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-29T17:31:36.429986] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:31:36.448614] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T17:31:36.476638] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:36.477901] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-29T17:31:36.478000] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-29T17:31:36.478354] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-29T17:31:36.478786] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-29T17:31:36.886660] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:37.148284] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-29T17:31:37.548787] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T17:31:37.948122] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-29T17:31:38.748096] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-29T17:31:38.998129] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T17:31:39.176079] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T17:31:39.548140] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-29T17:31:39.775666] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T17:31:39.778581] [INFO ] [REMOTE ] BFS: Full fetch complete (12592 records). [2025-09-29T17:31:39.778769] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-29T17:31:39.779274] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:31:39.779362] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:31:39.779407] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:31:39.779473] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-29T17:31:39.779545] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-09-29T17:31:39.779627] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-09-29T17:31:39.780790] [DEBUG] [LOCAL ] BFS: Deleted derivative data file. [2025-09-29T17:31:39.781114] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFS took 27.6s. Estimated remaining: 4h 18m 55s. Rate: 8.2 symbols/min [2025-09-29T17:31:39.961880] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:39.981549] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-29T17:31:39.981812] [INFO ] [MAIN ] BGR: Loaded 13658 existing records. [2025-09-29T17:31:40.171710] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:40.171978] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-29T17:31:40.172037] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-29T17:31:40.172547] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-29T17:31:40.172610] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-29T17:31:40.362898] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-29T17:31:40.559137] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:40.652589] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T17:31:41.148134] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-29T17:31:41.948106] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-29T17:31:42.116032] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T17:31:42.206849] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:31:42.748180] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-29T17:31:42.838463] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T17:31:43.548101] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-29T17:31:43.826336] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:31:44.348140] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-29T17:31:44.594570] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T17:31:45.148159] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-29T17:31:45.283715] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T17:31:45.873424] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T17:31:45.948129] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-29T17:31:46.748113] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-29T17:31:46.801229] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T17:31:47.485273] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-29T17:31:47.548127] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-29T17:31:48.348104] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-29T17:31:48.567573] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T17:31:48.573951] [INFO ] [REMOTE ] BGB: Full fetch complete (26906 records). [2025-09-29T17:31:48.574096] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-29T17:31:48.988631] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-29T17:31:48.988744] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-29T17:31:48.989144] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-29T17:31:48.989207] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-29T17:31:48.989938] [DEBUG] [LOCAL ] BGB: Trimmed 26906 records to 17484 (keeping 200 days of data) [2025-09-29T17:31:49.104607] [DEBUG] [LOCAL ] BGB: Primary data saved (17484 records). [2025-09-29T17:31:49.104869] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-29T17:31:49.104999] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGB took 24.6s. Estimated remaining: 4h 19m 4s. Rate: 8.2 symbols/min [2025-09-29T17:31:49.149667] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-29T17:31:49.290154] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:49.318469] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T17:31:49.364213] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-29T17:31:49.364571] [INFO ] [MAIN ] BGS: Loaded 51183 existing records. [2025-09-29T17:31:49.564485] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:49.564754] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-29T17:31:49.564811] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-29T17:31:49.565381] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-29T17:31:49.565447] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-29T17:31:49.954023] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-29T17:31:49.991898] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:50.748136] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-29T17:31:50.848147] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:31:50.878370] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-29T17:31:51.548171] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-29T17:31:52.348126] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-29T17:31:52.457478] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T17:31:52.533863] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T17:31:52.907446] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T17:31:53.148140] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-29T17:31:53.948142] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-29T17:31:54.748161] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-29T17:31:54.950855] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:31:55.534209] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-29T17:31:55.548091] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-29T17:31:56.348098] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-29T17:31:56.434872] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T17:31:57.148086] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-29T17:31:57.266813] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:31:57.357946] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T17:31:57.948099] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-29T17:31:58.748112] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-29T17:31:58.801196] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T17:31:58.837066] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:31:59.548134] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-29T17:32:00.348099] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-29T17:32:00.703132] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T17:32:00.715857] [INFO ] [REMOTE ] BG: Full fetch complete (72769 records). [2025-09-29T17:32:00.716107] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-29T17:32:01.156186] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-29T17:32:01.183061] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-29T17:32:01.183309] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-29T17:32:01.184289] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-29T17:32:01.184536] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-29T17:32:01.218390] [DEBUG] [LOCAL ] BG: Trimmed 72769 records to 50382 (keeping 200 days of data) [2025-09-29T17:32:01.220707] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:32:01.384776] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T17:32:01.595346] [DEBUG] [LOCAL ] BG: Primary data saved (50382 records). [2025-09-29T17:32:01.595498] [INFO ] [MAIN ] BG: Full history saved. [2025-09-29T17:32:01.595583] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BG took 43.6s. Estimated remaining: 4h 19m 38s. Rate: 8.1 symbols/min [2025-09-29T17:32:01.807074] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:01.817514] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-29T17:32:01.817800] [INFO ] [MAIN ] BGSF: Loaded 7050 existing records. [2025-09-29T17:32:01.951170] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-29T17:32:02.029792] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:02.030186] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-29T17:32:02.030303] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-29T17:32:02.030529] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-29T17:32:02.030589] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-29T17:32:02.253418] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T17:32:02.457531] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:02.748150] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-29T17:32:03.548129] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-29T17:32:03.662417] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T17:32:04.003358] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T17:32:04.240940] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T17:32:04.348159] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-29T17:32:05.148156] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-29T17:32:05.405309] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T17:32:05.948147] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-29T17:32:06.275088] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T17:32:06.278858] [INFO ] [REMOTE ] BGR: Full fetch complete (20239 records). [2025-09-29T17:32:06.279038] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-29T17:32:06.700049] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-29T17:32:06.700136] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-29T17:32:06.700557] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-29T17:32:06.700624] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-29T17:32:06.701425] [DEBUG] [LOCAL ] BGR: Trimmed 20239 records to 13477 (keeping 200 days of data) [2025-09-29T17:32:06.764366] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-29T17:32:06.793096] [DEBUG] [LOCAL ] BGR: Primary data saved (13477 records). [2025-09-29T17:32:06.793239] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-29T17:32:06.793324] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGR took 27.0s. Estimated remaining: 4h 19m 13s. Rate: 8.1 symbols/min [2025-09-29T17:32:06.975979] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:06.990203] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T17:32:07.011175] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-29T17:32:07.011477] [INFO ] [MAIN ] BGT: Loaded 16793 existing records. [2025-09-29T17:32:07.203018] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:07.203249] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-29T17:32:07.203304] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-29T17:32:07.203771] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-29T17:32:07.203833] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-29T17:32:07.553358] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-29T17:32:07.617052] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:08.125047] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-29T17:32:08.348135] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-29T17:32:08.575172] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:32:08.768541] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T17:32:09.148132] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-29T17:32:09.749477] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T17:32:09.948126] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-29T17:32:10.748129] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-29T17:32:10.980580] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T17:32:11.248036] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T17:32:11.548176] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-29T17:32:11.945060] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-29T17:32:12.348104] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-29T17:32:13.148121] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-29T17:32:13.174832] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:32:13.948097] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-29T17:32:14.274011] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T17:32:14.748115] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-29T17:32:15.046459] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:32:15.050576] [INFO ] [REMOTE ] BGH: Full fetch complete (22086 records). [2025-09-29T17:32:15.050698] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-29T17:32:15.473443] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-29T17:32:15.473557] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-29T17:32:15.474057] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-29T17:32:15.474140] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-29T17:32:15.475195] [DEBUG] [LOCAL ] BGH: Trimmed 22086 records to 16600 (keeping 200 days of data) [2025-09-29T17:32:15.549977] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-29T17:32:15.585497] [DEBUG] [LOCAL ] BGH: Primary data saved (16600 records). [2025-09-29T17:32:15.585673] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-29T17:32:15.585780] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGH took 39.6s. Estimated remaining: 4h 19m 17s. Rate: 8.1 symbols/min [2025-09-29T17:32:15.783697] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:15.798216] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-29T17:32:15.798505] [INFO ] [MAIN ] BGX: Loaded 10900 existing records. [2025-09-29T17:32:15.951810] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T17:32:16.030476] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:16.030763] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-29T17:32:16.030819] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-29T17:32:16.031178] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-29T17:32:16.031239] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-29T17:32:16.353273] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-29T17:32:16.431798] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:17.148131] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-29T17:32:17.410852] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T17:32:17.413573] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T17:32:17.737917] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T17:32:17.948111] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-29T17:32:18.600516] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T17:32:18.748120] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-29T17:32:19.548118] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-29T17:32:20.348088] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-29T17:32:20.499908] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T17:32:20.697576] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T17:32:21.118250] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T17:32:21.148112] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-29T17:32:21.620001] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T17:32:21.948125] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-29T17:32:22.748109] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-29T17:32:23.020437] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:32:23.548110] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-29T17:32:24.348074] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-29T17:32:24.362970] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-29T17:32:24.492991] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:32:25.148168] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-29T17:32:25.713938] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T17:32:25.717866] [INFO ] [REMOTE ] BGSF: Full fetch complete (8312 records). [2025-09-29T17:32:25.717958] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-29T17:32:25.718377] [FATAL] [VALIDATOR ] BGSF: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:32:25.718465] [FATAL] [MAIN ] BGSF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:32:25.718511] [WARN ] [MAIN ] BGSF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:32:25.718582] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-29T17:32:25.718672] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-09-29T17:32:25.718733] [INFO ] [LOCAL ] BGSF: Starting deletion of derivative data. [2025-09-29T17:32:25.719504] [DEBUG] [LOCAL ] BGSF: Deleted derivative data file. [2025-09-29T17:32:25.719601] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGSF took 24.1s. Estimated remaining: 4h 19m 32s. Rate: 8.1 symbols/min [2025-09-29T17:32:25.908608] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:25.937073] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-29T17:32:25.937408] [INFO ] [MAIN ] BGY: Loaded 22790 existing records. [2025-09-29T17:32:25.953199] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-29T17:32:26.098922] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T17:32:26.144312] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:26.144548] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-29T17:32:26.144597] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-29T17:32:26.145021] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-29T17:32:26.145084] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-29T17:32:26.535377] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:26.748150] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-29T17:32:27.149677] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T17:32:27.329521] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T17:32:27.548131] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-29T17:32:28.348152] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-29T17:32:28.480445] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T17:32:29.148122] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-29T17:32:29.312201] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T17:32:29.948129] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-29T17:32:30.097428] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T17:32:30.562827] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T17:32:30.748117] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-29T17:32:31.548164] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-29T17:32:31.911773] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T17:32:32.349182] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-29T17:32:32.354431] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T17:32:33.148113] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-29T17:32:33.224876] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T17:32:33.948180] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-29T17:32:34.748126] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-29T17:32:35.070484] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T17:32:35.205501] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T17:32:35.216448] [INFO ] [REMOTE ] BGS: Full fetch complete (72482 records). [2025-09-29T17:32:35.216607] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-29T17:32:35.553253] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-29T17:32:35.637630] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-29T17:32:35.637753] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-29T17:32:35.638572] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-29T17:32:35.638616] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-29T17:32:35.640303] [DEBUG] [LOCAL ] BGS: Trimmed 72482 records to 50439 (keeping 200 days of data) [2025-09-29T17:32:35.856591] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T17:32:35.862226] [INFO ] [REMOTE ] BGX: Full fetch complete (15942 records). [2025-09-29T17:32:35.862317] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-29T17:32:36.286117] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-29T17:32:36.286529] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-29T17:32:36.288172] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-29T17:32:36.289515] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-29T17:32:36.292072] [DEBUG] [LOCAL ] BGX: Trimmed 15942 records to 10834 (keeping 200 days of data) [2025-09-29T17:32:36.348121] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-29T17:32:36.431845] [DEBUG] [LOCAL ] BGS: Primary data saved (50439 records). [2025-09-29T17:32:36.433918] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-29T17:32:36.435320] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGS took 47.3s. Estimated remaining: 4h 19m 51s. Rate: 8.1 symbols/min [2025-09-29T17:32:36.524801] [DEBUG] [LOCAL ] BGX: Primary data saved (10834 records). [2025-09-29T17:32:36.550856] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-29T17:32:36.554754] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGX took 21.0s. Estimated remaining: 4h 18m 46s. Rate: 8.1 symbols/min [2025-09-29T17:32:36.700217] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:36.822049] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T17:32:36.855468] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:36.868508] [DEBUG] [LOCAL ] BH: Loaded 15938 existing records from primary storage. [2025-09-29T17:32:36.868846] [INFO ] [MAIN ] BH: Loaded 15938 existing records. [2025-09-29T17:32:37.079348] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:37.080419] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-29T17:32:37.080791] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-29T17:32:37.081286] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-29T17:32:37.081349] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-29T17:32:37.157026] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-29T17:32:37.229205] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-29T17:32:37.243942] [INFO ] [MAIN ] BHC: Loaded 47495 existing records. [2025-09-29T17:32:37.232848] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T17:32:37.653308] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:37.685139] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-29T17:32:37.686526] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-29T17:32:37.711379] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-29T17:32:37.722230] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-29T17:32:37.726122] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:37.953227] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-29T17:32:38.103477] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:38.408366] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T17:32:38.748167] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-29T17:32:39.166266] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T17:32:39.169997] [INFO ] [REMOTE ] BGT: Full fetch complete (24316 records). [2025-09-29T17:32:39.170107] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-29T17:32:39.550033] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-29T17:32:39.594477] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-29T17:32:39.594584] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-29T17:32:39.595044] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-29T17:32:39.595113] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-29T17:32:39.595889] [DEBUG] [LOCAL ] BGT: Trimmed 24316 records to 16594 (keeping 200 days of data) [2025-09-29T17:32:39.705229] [DEBUG] [LOCAL ] BGT: Primary data saved (16594 records). [2025-09-29T17:32:39.705459] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-29T17:32:39.705594] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGT took 32.9s. Estimated remaining: 4h 18m 5s. Rate: 8.2 symbols/min [2025-09-29T17:32:39.824121] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:32:39.906790] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:39.939578] [DEBUG] [LOCAL ] BHE: Loaded 25353 existing records from primary storage. [2025-09-29T17:32:39.939901] [INFO ] [MAIN ] BHE: Loaded 25353 existing records. [2025-09-29T17:32:40.140132] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:40.140384] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-29T17:32:40.141257] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-29T17:32:40.141817] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-29T17:32:40.141880] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-29T17:32:40.353238] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-29T17:32:40.517956] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:41.148108] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-29T17:32:41.222267] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T17:32:41.524944] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T17:32:41.917906] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T17:32:41.948095] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-29T17:32:42.533608] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T17:32:42.748136] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-29T17:32:43.548098] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-29T17:32:43.570262] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T17:32:44.348156] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-29T17:32:45.103799] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T17:32:45.151721] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-29T17:32:45.152791] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T17:32:45.948130] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-29T17:32:46.356272] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T17:32:46.748170] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-29T17:32:46.875101] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T17:32:47.548156] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-29T17:32:47.845992] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T17:32:48.348154] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-29T17:32:48.773743] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:32:49.148134] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-29T17:32:49.363613] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T17:32:49.948105] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-29T17:32:50.106424] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:32:50.748114] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-29T17:32:51.033978] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T17:32:51.548141] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-29T17:32:51.600845] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:32:52.348116] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-29T17:32:52.639378] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T17:32:53.148109] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-29T17:32:53.422050] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T17:32:53.948142] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-29T17:32:54.418705] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T17:32:54.748074] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-29T17:32:55.045881] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:32:55.049803] [INFO ] [REMOTE ] BGY: Full fetch complete (33379 records). [2025-09-29T17:32:55.049901] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-29T17:32:55.446375] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-29T17:32:55.446461] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-29T17:32:55.446921] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-29T17:32:55.446985] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-29T17:32:55.447842] [DEBUG] [LOCAL ] BGY: Trimmed 33379 records to 22400 (keeping 200 days of data) [2025-09-29T17:32:55.548374] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-29T17:32:55.587432] [DEBUG] [LOCAL ] BGY: Primary data saved (22400 records). [2025-09-29T17:32:55.587574] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-29T17:32:55.587685] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 29.9s. Estimated remaining: 4h 19m 5s. Rate: 8.1 symbols/min [2025-09-29T17:32:55.796549] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:55.828379] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-29T17:32:55.828699] [INFO ] [MAIN ] BHK: Loaded 22922 existing records. [2025-09-29T17:32:56.028690] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:56.028980] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-29T17:32:56.029050] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-29T17:32:56.029581] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-29T17:32:56.029678] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-29T17:32:56.316939] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T17:32:56.360520] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-29T17:32:56.447478] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:57.148170] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-29T17:32:57.412235] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:32:57.531812] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T17:32:57.537564] [INFO ] [REMOTE ] BH: Full fetch complete (19398 records). [2025-09-29T17:32:57.537887] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-29T17:32:57.538553] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:32:57.540044] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:32:57.540273] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:32:57.540374] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-29T17:32:57.540518] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-29T17:32:57.540589] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-09-29T17:32:57.541634] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-09-29T17:32:57.541866] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 21.1s. Estimated remaining: 4h 18m 15s. Rate: 8.1 symbols/min [2025-09-29T17:32:57.806020] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:57.880318] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-29T17:32:57.880733] [INFO ] [MAIN ] BHP: Loaded 54153 existing records. [2025-09-29T17:32:57.950763] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-29T17:32:58.083806] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:58.084273] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-29T17:32:58.084324] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-29T17:32:58.085502] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-29T17:32:58.085598] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-29T17:32:58.378987] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:32:58.491297] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:58.748162] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-29T17:32:59.392189] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T17:32:59.548158] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-29T17:33:00.135907] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T17:33:00.348114] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-29T17:33:00.672396] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T17:33:01.148117] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-29T17:33:01.948093] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-29T17:33:02.211884] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T17:33:02.248276] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T17:33:02.748121] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-29T17:33:03.011070] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T17:33:03.548145] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-29T17:33:03.666774] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-29T17:33:04.348148] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-29T17:33:05.158687] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-29T17:33:05.164552] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T17:33:05.884799] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T17:33:05.948176] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-29T17:33:06.139625] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T17:33:06.748089] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-29T17:33:07.113000] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T17:33:07.548135] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-29T17:33:08.348096] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-29T17:33:08.598585] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T17:33:08.670199] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T17:33:09.148119] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-29T17:33:09.683028] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T17:33:09.948166] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-29T17:33:10.748111] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-29T17:33:10.817996] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T17:33:11.183367] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T17:33:11.188416] [INFO ] [REMOTE ] BHE: Full fetch complete (36383 records). [2025-09-29T17:33:11.188524] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-29T17:33:11.190099] [FATAL] [VALIDATOR ] BHE: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:33:11.190203] [FATAL] [MAIN ] BHE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:33:11.190282] [WARN ] [MAIN ] BHE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:33:11.190384] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-29T17:33:11.190466] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-09-29T17:33:11.190507] [INFO ] [LOCAL ] BHE: Starting deletion of derivative data. [2025-09-29T17:33:11.191214] [DEBUG] [LOCAL ] BHE: Deleted derivative data file. [2025-09-29T17:33:11.191324] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHE took 31.5s. Estimated remaining: 4h 18m 57s. Rate: 8.1 symbols/min [2025-09-29T17:33:11.374346] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:11.397777] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-29T17:33:11.398065] [INFO ] [MAIN ] BHR: Loaded 21771 existing records. [2025-09-29T17:33:11.553188] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-29T17:33:11.593534] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:11.594425] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-29T17:33:11.594519] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-29T17:33:11.595108] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-29T17:33:11.595171] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-29T17:33:11.971932] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T17:33:12.096196] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:12.348095] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-29T17:33:13.148132] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-29T17:33:13.385541] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T17:33:13.438767] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T17:33:13.948076] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-29T17:33:14.150671] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T17:33:14.748117] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-29T17:33:15.548130] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-29T17:33:15.664191] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:33:15.673898] [INFO ] [REMOTE ] BHC: Full fetch complete (66607 records). [2025-09-29T17:33:15.674082] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-29T17:33:15.675042] [FATAL] [VALIDATOR ] BHC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:33:15.675161] [FATAL] [MAIN ] BHC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:33:15.675206] [WARN ] [MAIN ] BHC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:33:15.675275] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-29T17:33:15.675344] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-09-29T17:33:15.675425] [INFO ] [LOCAL ] BHC: Starting deletion of derivative data. [2025-09-29T17:33:15.676588] [DEBUG] [LOCAL ] BHC: Deleted derivative data file. [2025-09-29T17:33:15.676737] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHC took 39.1s. Estimated remaining: 4h 18m 27s. Rate: 8.1 symbols/min [2025-09-29T17:33:15.869303] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:15.869502] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-29T17:33:15.869542] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-29T17:33:15.869693] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-29T17:33:15.869748] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-29T17:33:15.869792] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-29T17:33:15.869825] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-29T17:33:16.263110] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:16.348129] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-29T17:33:16.832556] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-29T17:33:16.885279] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T17:33:17.148122] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-29T17:33:17.424467] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T17:33:17.948097] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-29T17:33:18.336867] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:33:18.748086] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-29T17:33:18.903628] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T17:33:19.548086] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-29T17:33:19.853473] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T17:33:19.859772] [INFO ] [REMOTE ] BHK: Full fetch complete (29915 records). [2025-09-29T17:33:19.859882] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-29T17:33:20.248169] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-29T17:33:20.248263] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-29T17:33:20.248733] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-29T17:33:20.248801] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-29T17:33:20.249610] [DEBUG] [LOCAL ] BHK: Trimmed 29915 records to 22906 (keeping 200 days of data) [2025-09-29T17:33:20.348701] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-29T17:33:20.398504] [DEBUG] [LOCAL ] BHK: Primary data saved (22906 records). [2025-09-29T17:33:20.398675] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-29T17:33:20.398785] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 24.8s. Estimated remaining: 4h 17m 59s. Rate: 8.1 symbols/min [2025-09-29T17:33:20.594426] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:20.659862] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-29T17:33:20.660313] [INFO ] [MAIN ] BHVN: Loaded 50401 existing records. [2025-09-29T17:33:20.854023] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:20.854320] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-29T17:33:20.854396] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-29T17:33:20.855100] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-29T17:33:20.855172] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-29T17:33:21.154304] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-29T17:33:21.241018] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:21.494812] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-29T17:33:21.531062] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T17:33:21.647478] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T17:33:21.948118] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-29T17:33:22.303333] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T17:33:22.748114] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-29T17:33:23.190011] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T17:33:23.548150] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-29T17:33:24.348146] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-29T17:33:24.694320] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T17:33:25.148152] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-29T17:33:25.382440] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T17:33:25.948151] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-29T17:33:26.748149] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-29T17:33:27.220277] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T17:33:27.222001] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:33:27.523196] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T17:33:27.548094] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-29T17:33:28.348122] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-29T17:33:28.704105] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T17:33:29.062903] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:33:29.148205] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-29T17:33:29.948153] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-29T17:33:30.304459] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T17:33:30.734888] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:33:30.748056] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-29T17:33:31.548124] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-29T17:33:32.062982] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T17:33:32.348105] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-29T17:33:32.538459] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T17:33:32.732379] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T17:33:33.148108] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-29T17:33:33.741234] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T17:33:33.742208] [INFO ] [REMOTE ] BHV: Full fetch complete (1363 records). [2025-09-29T17:33:33.742297] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-29T17:33:33.742722] [FATAL] [VALIDATOR ] BHV: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:33:33.742952] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:33:33.743026] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:33:33.743099] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-29T17:33:33.743165] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-29T17:33:33.743205] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-29T17:33:33.743245] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-29T17:33:33.743319] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHV took 18.1s. Estimated remaining: 4h 18m 37s. Rate: 8.1 symbols/min [2025-09-29T17:33:33.930707] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:33.948132] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-29T17:33:34.004471] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-29T17:33:34.004873] [INFO ] [MAIN ] BILL: Loaded 53105 existing records. [2025-09-29T17:33:34.212064] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:34.212292] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-29T17:33:34.212340] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-29T17:33:34.213246] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-29T17:33:34.213333] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-29T17:33:34.584227] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:34.748131] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-29T17:33:35.512283] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T17:33:35.548140] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-29T17:33:36.348086] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-29T17:33:36.753124] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T17:33:37.018541] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T17:33:37.148124] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-29T17:33:37.948101] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-29T17:33:38.111338] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T17:33:38.748103] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-29T17:33:38.980791] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T17:33:39.025413] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:33:39.548160] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-29T17:33:40.348094] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-29T17:33:40.827723] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-29T17:33:40.977868] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T17:33:41.148110] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-29T17:33:41.948114] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-29T17:33:42.154115] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T17:33:42.751483] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-29T17:33:42.757094] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T17:33:42.951293] [INFO ] [RE